2021-05-26T16:29:30.815 INFO:root:teuthology version: 1.1.0-0c70841a 2021-05-26T16:29:30.817 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136786 --owner scheduled_kchai@teuthology --verbose --name kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi --description rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} -- /home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136786/orig.config.yaml 2021-05-26T16:29:30.865 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-05-26T16:29:30.919 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136786 branch: wip-kefu-testing-2021-05-26-1620 description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} email: tchaikov@gmail.com first_in_suite: false job_id: '6136786' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: '8.3' overrides: admin_socket: branch: wip-kefu-testing-2021-05-26-1620 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: ed4edd0b7e1e319db25251072e10833142271766 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: ed4edd0b7e1e319db25251072e10833142271766 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-kefu-testing-2021-05-26-1620 sha1: ed4edd0b7e1e319db25251072e10833142271766 owner: scheduled_kchai@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 sha1: ed4edd0b7e1e319db25251072e10833142271766 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2021-05-26-1620 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: ed4edd0b7e1e319db25251072e10833142271766 targets: smithi003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWos8WqAmXBIjL+4kynrVOl+K/H5cPGRZE9whXNA4AiViWdLvNDWVkzjjAx8mOqJTbKEgwe4oi+Lvw7wvFpI7jmhCvaPPHVagmDXnYzuYS3ILeljwDLyjlT1vQIqPjjj+v2QxFbEgvM1stRcg0Ge0Q0ha5uO4psnTbjK8ouVFEfBxMjoFP1RibLqoG3FI3wZpWbydQQw0G6g26dDrkvJk6FT4m+b9HRV+f9Uy6n8FSGD9oaUS9JDflmfAzs1FyOjVsWES5J7NCS4mHLEXyAVYNx8MclbBtiguLtxYleLoHXWG/zqGNUJcI1ZqlKXUdwuUXB3wqGBad1Y5wWAkCG5fvvrGFEYgkjM2r25JkdJzcKx4/X2A2kksNDbFKvn4QSFsKdfRyrG41VzS5DOQVDPoaEYUi0QAi0R4sYsv1637GwkXO28Ih8F+3+ciC0Lwl+h+noLwRlpOtiTVIheQa0iUhTr5r4rOj7H6AFNXilDoWtWGfS7HKxAgJe1TtY1zASNk= smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+i9AsGsRbxUs3rMA4+AfXppvvkfnsem2139hBMb8+fIISlbs87JNrLEukEXVAHnkUEItyYeJUgwwwYiwEiAzr8kTf5IEYbKbYv+TOGPYcH5Z7+nhFyvNUGsNdMSSMeQxEFORtKCpkIOy4BNbCWaWyfJwrwDsfw6Rjs1b/gjIqHKUm3xRicErjsqWKwS/UTER09uA65b18xma/kk0aN8G0tE82s9aJOOsRBdhb5rC8KrfAx+1fks0fGhiT6YaqKbHBiQJ9Ntx04v4ksPAfMA4Vs/QenCTbfSLGp9rNipIh5waHdXX8vgnQ3APUKIzo+L09OnC/igRqAzrgCdzcbe7n6ngv2ZhnKIJDvjsPTLH3e0w5vm02r2cGsnv8kGp7ooa6CWBFpdEZBaLj4IFi1tg7QgSb10GHeCn/Gaj9kk9Yf5d39ram4DnFAIbempTrht89fnoh4r62eZO/vOo6DCnOmHRWq8LeIfGi9Vi0NpruR7tUEAK87a0b4KlwW6HVsSs= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology_branch: master teuthology_sha1: 0c70841acf4fb31ca05cdbebbd295620aac53ce4 timestamp: 2021-05-26_11:04:40 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.8274 2021-05-26T16:29:30.919 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa; will attempt to use it 2021-05-26T16:29:30.920 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa/tasks 2021-05-26T16:29:30.921 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-05-26T16:29:30.922 INFO:teuthology.task.internal:Checking packages... 2021-05-26T16:29:30.942 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'ed4edd0b7e1e319db25251072e10833142271766' 2021-05-26T16:29:30.942 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-05-26T16:29:30.943 INFO:teuthology.packaging:ref: None 2021-05-26T16:29:30.943 INFO:teuthology.packaging:tag: None 2021-05-26T16:29:30.944 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-05-26-1620 2021-05-26T16:29:30.944 INFO:teuthology.packaging:sha1: ed4edd0b7e1e319db25251072e10833142271766 2021-05-26T16:29:30.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-kefu-testing-2021-05-26-1620 2021-05-26T16:29:31.094 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-4646.ged4edd0b 2021-05-26T16:29:31.094 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-05-26T16:29:31.110 INFO:teuthology.task.internal:no buildpackages task found 2021-05-26T16:29:31.110 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-05-26T16:29:31.222 INFO:teuthology.task.internal:Saving configuration 2021-05-26T16:29:31.247 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-05-26T16:29:31.257 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-26T16:29:31.275 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-05-26 16:24:22.555434', 'description': '/home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136786', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKDuiEkV/1dVcnJME3O3PESkBYZioVQudEwvlICrfFSTmeU3KwDZcD8yJWkCgSKrUjvdHlg/nAIiEb7AfpqcdP4=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi003.front.sepia.ceph.com'} 2021-05-26T16:29:31.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-05-26 16:24:22.555414', 'description': '/home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136786', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxnbyTr97kpTO+ECQ+LY7UFnvc5Dq7zofGtFSwmMGq4pLRLsHVPZNDMPPGVt6MWD66sx4T31o2/voktyCSb71A=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi137.front.sepia.ceph.com'} 2021-05-26T16:29:31.291 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-05-26T16:29:31.437 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2021-05-26T16:29:31.438 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2021-05-26T16:29:31.438 INFO:teuthology.run_tasks:Running task console_log... 2021-05-26T16:29:31.543 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9070e51d90>, signals=[15]) 2021-05-26T16:29:31.544 INFO:teuthology.run_tasks:Running task internal.connect... 2021-05-26T16:29:31.555 INFO:teuthology.task.internal:Opening connections... 2021-05-26T16:29:31.555 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2021-05-26T16:29:31.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:29:31.630 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:29:31.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:29:31.702 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-05-26T16:29:31.713 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2021-05-26T16:29:31.760 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2021-05-26T16:29:31.760 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2021-05-26T16:29:31.816 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Linux" 2021-05-26T16:29:31.817 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2021-05-26T16:29:31.817 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2021-05-26T16:29:31.818 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2021-05-26T16:29:31.818 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2021-05-26T16:29:31.818 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2021-05-26T16:29:31.819 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Linux 8" 2021-05-26T16:29:31.819 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2021-05-26T16:29:31.819 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-05-26T16:29:31.819 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2021-05-26T16:29:31.820 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-05-26T16:29:31.820 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-05-26T16:29:31.820 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-05-26T16:29:31.821 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2021-05-26T16:29:31.836 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2021-05-26T16:29:31.851 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2021-05-26T16:29:31.852 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2021-05-26T16:29:31.906 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Linux" 2021-05-26T16:29:31.906 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2021-05-26T16:29:31.907 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2021-05-26T16:29:31.907 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2021-05-26T16:29:31.907 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2021-05-26T16:29:31.907 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2021-05-26T16:29:31.908 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Linux 8" 2021-05-26T16:29:31.908 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2021-05-26T16:29:31.908 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-05-26T16:29:31.908 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2021-05-26T16:29:31.908 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-05-26T16:29:31.909 INFO:teuthology.orchestra.run.smithi137.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-05-26T16:29:31.909 INFO:teuthology.orchestra.run.smithi137.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-05-26T16:29:31.909 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2021-05-26T16:29:31.924 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-05-26T16:29:31.937 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-05-26T16:29:31.971 INFO:teuthology.task.internal:Checking for old test directory... 2021-05-26T16:29:31.972 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2021-05-26T16:29:31.975 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2021-05-26T16:29:31.988 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-05-26T16:29:32.004 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-05-26T16:29:32.005 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2021-05-26T16:29:32.030 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2021-05-26T16:29:32.053 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-05-26T16:29:32.096 INFO:teuthology.run_tasks:Running task kernel... 2021-05-26T16:29:32.113 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mon.d': {'kdb': True, 'sha1': 'distro'}, 'mon.e': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'mon.f': {'kdb': True, 'sha1': 'distro'}, 'mon.g': {'kdb': True, 'sha1': 'distro'}, 'mon.h': {'kdb': True, 'sha1': 'distro'}, 'mon.i': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2021-05-26T16:29:32.114 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.f': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-05-26T16:29:32.114 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2021-05-26T16:29:32.132 INFO:teuthology.orchestra.run.smithi003.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-05-26T16:29:32.132 INFO:teuthology.task.kernel:Running kernel on smithi003: 4.18.0-240.10.1.el8_3.x86_64 2021-05-26T16:29:32.133 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2021-05-26T16:29:35.165 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - AppStream 33 MB/s | 6.3 MB 00:00 2021-05-26T16:29:36.323 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Base 25 MB/s | 2.3 MB 00:00 2021-05-26T16:29:36.790 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Extras 147 kB/s | 9.6 kB 00:00 2021-05-26T16:29:38.073 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - AppStream 5.1 MB/s | 6.3 MB 00:01 2021-05-26T16:29:39.960 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - BaseOS 2.9 MB/s | 2.3 MB 00:00 2021-05-26T16:29:40.741 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - Extras 26 kB/s | 9.6 kB 00:00 2021-05-26T16:29:41.581 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 12 MB/s | 9.4 MB 00:00 2021-05-26T16:29:43.670 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2021-05-26T16:29:45.267 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-05-26T16:29:45.267 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-05-26T16:29:45.497 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:29:45.515 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:29:45.516 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:29:45.516 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:29:45.516 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:29:45.516 INFO:teuthology.orchestra.run.smithi003.stdout: kernel x86_64 4.18.0-240.22.1.el8_3 CentOS-Base 4.4 M 2021-05-26T16:29:45.516 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:29:45.517 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core x86_64 4.18.0-240.22.1.el8_3 CentOS-Base 30 M 2021-05-26T16:29:45.517 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules x86_64 4.18.0-240.22.1.el8_3 CentOS-Base 26 M 2021-05-26T16:29:45.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:29:45.517 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:29:45.518 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:29:45.518 INFO:teuthology.orchestra.run.smithi003.stdout:Install 3 Packages 2021-05-26T16:29:45.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:29:45.518 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 60 M 2021-05-26T16:29:45.518 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 83 M 2021-05-26T16:29:45.519 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:29:45.659 INFO:teuthology.orchestra.run.smithi003.stdout:(1/3): kernel-4.18.0-240.22.1.el8_3.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2021-05-26T16:29:46.385 INFO:teuthology.orchestra.run.smithi003.stdout:(2/3): kernel-core-4.18.0-240.22.1.el8_3.x86_64 35 MB/s | 30 MB 00:00 2021-05-26T16:29:46.645 INFO:teuthology.orchestra.run.smithi003.stdout:(3/3): kernel-modules-4.18.0-240.22.1.el8_3.x86 23 MB/s | 26 MB 00:01 2021-05-26T16:29:46.648 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:29:46.649 INFO:teuthology.orchestra.run.smithi003.stdout:Total 53 MB/s | 60 MB 00:01 2021-05-26T16:29:46.739 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:29:47.080 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:29:47.081 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:29:48.189 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:29:48.200 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:29:50.590 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:29:51.020 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-core-4.18.0-240.22.1.el8_3.x86_64 1/3 2021-05-26T16:29:54.201 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-4.18.0-240.22.1.el8_3.x86_64 1/3 2021-05-26T16:29:54.503 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-4.18.0-240.22.1.el8_3.x86_64 2/3 2021-05-26T16:29:57.596 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-4.18.0-240.22.1.el8_3.x86_64 2/3 2021-05-26T16:29:57.781 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:30:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:30:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:30:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-4.18.0-240.22.1.el8_3.x86_64 1/3 2021-05-26T16:30:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-core-4.18.0-240.22.1.el8_3.x86_64 2/3 2021-05-26T16:30:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:30:20.279 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:30:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:30:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:30:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:30:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:30:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:30:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:30:20.644 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:30:20.714 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel --last | head -n 1 2021-05-26T16:30:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-4.18.0-240.22.1.el8_3.x86_64 Wed 26 May 2021 04:29:57 PM UTC 2021-05-26T16:30:20.853 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:30:20.854 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:30:20.854 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2021-05-26T16:30:20.872 INFO:teuthology.orchestra.run.smithi137.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-05-26T16:30:20.873 INFO:teuthology.task.kernel:Running kernel on smithi137: 4.18.0-240.10.1.el8_3.x86_64 2021-05-26T16:30:20.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum install -y kernel 2021-05-26T16:30:23.907 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-8 - AppStream 33 MB/s | 6.3 MB 00:00 2021-05-26T16:30:24.987 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-8 - Base 24 MB/s | 2.3 MB 00:00 2021-05-26T16:30:25.425 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-8 - Extras 142 kB/s | 9.6 kB 00:00 2021-05-26T16:30:26.542 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Linux 8 - AppStream 5.9 MB/s | 6.3 MB 00:01 2021-05-26T16:30:29.775 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Linux 8 - BaseOS 1.0 MB/s | 2.3 MB 00:02 2021-05-26T16:30:30.540 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Linux 8 - Extras 26 kB/s | 9.6 kB 00:00 2021-05-26T16:30:31.373 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 12 MB/s | 9.4 MB 00:00 2021-05-26T16:30:33.349 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2021-05-26T16:30:34.886 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-05-26T16:30:34.886 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-05-26T16:30:35.107 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:30:35.122 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:30:35.123 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:30:35.123 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:30:35.123 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:30:35.124 INFO:teuthology.orchestra.run.smithi137.stdout: kernel x86_64 4.18.0-240.22.1.el8_3 CentOS-Base 4.4 M 2021-05-26T16:30:35.124 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:30:35.124 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core x86_64 4.18.0-240.22.1.el8_3 CentOS-Base 30 M 2021-05-26T16:30:35.124 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules x86_64 4.18.0-240.22.1.el8_3 CentOS-Base 26 M 2021-05-26T16:30:35.124 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:30:35.125 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:30:35.125 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:30:35.125 INFO:teuthology.orchestra.run.smithi137.stdout:Install 3 Packages 2021-05-26T16:30:35.125 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:30:35.126 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 60 M 2021-05-26T16:30:35.126 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 83 M 2021-05-26T16:30:35.126 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:30:35.348 INFO:teuthology.orchestra.run.smithi137.stdout:(1/3): kernel-4.18.0-240.22.1.el8_3.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2021-05-26T16:30:36.858 INFO:teuthology.orchestra.run.smithi137.stdout:(2/3): kernel-modules-4.18.0-240.22.1.el8_3.x86 15 MB/s | 26 MB 00:01 2021-05-26T16:30:37.142 INFO:teuthology.orchestra.run.smithi137.stdout:(3/3): kernel-core-4.18.0-240.22.1.el8_3.x86_64 15 MB/s | 30 MB 00:02 2021-05-26T16:30:37.146 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:30:37.146 INFO:teuthology.orchestra.run.smithi137.stdout:Total 30 MB/s | 60 MB 00:02 2021-05-26T16:30:37.232 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:30:37.576 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:30:37.576 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:30:38.652 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:30:38.666 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:30:40.949 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:30:41.425 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-core-4.18.0-240.22.1.el8_3.x86_64 1/3 2021-05-26T16:30:44.431 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-4.18.0-240.22.1.el8_3.x86_64 1/3 2021-05-26T16:30:44.766 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-4.18.0-240.22.1.el8_3.x86_64 2/3 2021-05-26T16:30:47.649 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-4.18.0-240.22.1.el8_3.x86_64 2/3 2021-05-26T16:30:47.825 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:31:07.699 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:31:07.968 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:31:07.969 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-4.18.0-240.22.1.el8_3.x86_64 1/3 2021-05-26T16:31:07.969 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-core-4.18.0-240.22.1.el8_3.x86_64 2/3 2021-05-26T16:31:08.272 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-4.18.0-240.22.1.el8_3.x86_64 3/3 2021-05-26T16:31:08.272 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:31:08.609 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:31:08.610 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:31:08.610 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:08.610 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:08.610 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:08.611 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:31:08.611 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:31:08.680 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel --last | head -n 1 2021-05-26T16:31:08.805 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-4.18.0-240.22.1.el8_3.x86_64 Wed 26 May 2021 04:30:47 PM UTC 2021-05-26T16:31:08.806 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:08.807 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:08.807 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-05-26T16:31:08.807 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-05-26T16:31:08.808 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-05-26T16:31:08.808 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-05-26T16:31:08.808 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2021-05-26T16:31:08.808 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel --last | head -n 1 2021-05-26T16:31:08.929 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-4.18.0-240.22.1.el8_3.x86_64 Wed 26 May 2021 04:29:57 PM UTC 2021-05-26T16:31:08.931 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:08.932 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2021-05-26T16:31:08.964 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2021-05-26T16:31:08.964 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2021-05-26T16:31:08.964 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.02 2021-05-26T16:31:08.964 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 90.el8 2021-05-26T16:31:08.965 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2021-05-26T16:31:08.965 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Mon 01 Mar 2021 06:17:56 PM UTC 2021-05-26T16:31:08.965 INFO:teuthology.orchestra.run.smithi003.stdout:Group : System Environment/Base 2021-05-26T16:31:08.965 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 9197207 2021-05-26T16:31:08.966 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2021-05-26T16:31:08.966 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-05-26T16:31:08.966 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-05-26T16:31:08.966 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-05-26T16:31:08.967 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : kbuilder.bsys.centos.org 2021-05-26T16:31:08.967 INFO:teuthology.orchestra.run.smithi003.stdout:Relocations : (not relocatable) 2021-05-26T16:31:08.967 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : CentOS BuildSystem 2021-05-26T16:31:08.967 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2021-05-26T16:31:08.968 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2021-05-26T16:31:08.968 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2021-05-26T16:31:08.968 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2021-05-26T16:31:08.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:31:08.968 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-05-26T16:31:08.969 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2021-05-26T16:31:08.969 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2021-05-26T16:31:08.969 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2021-05-26T16:31:08.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:31:08.969 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2021-05-26T16:31:08.970 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-05-26T16:31:08.971 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:08.971 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-05-26T16:31:09.889 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2021-05-26T16:31:11.873 INFO:teuthology.orchestra.run.smithi003.stderr:done 2021-05-26T16:31:11.875 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2021-05-26T16:31:11.940 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.cLyP14zbeY 2021-05-26T16:31:11.941 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cLyP14zbeY 2021-05-26T16:31:11.969 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.cLyP14zbeY 2021-05-26T16:31:12.117 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.cLyP14zbeY is 6KB 2021-05-26T16:31:12.166 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.cLyP14zbeY 2021-05-26T16:31:12.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2021-05-26T16:31:12.252 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-0-rescue.conf 2021-05-26T16:31:12.252 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.10.1.el8_3.x86_64.conf 2021-05-26T16:31:12.253 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.22.1.el8_3.x86_64.conf 2021-05-26T16:31:12.253 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.el8.x86_64.conf 2021-05-26T16:31:12.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default 631d84db90f7409fbdd390573ae89718-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:12.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2021-05-26T16:31:12.420 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2021-05-26T16:31:12.420 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2021-05-26T16:31:12.421 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel --last | head -n 1 2021-05-26T16:31:12.536 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-4.18.0-240.22.1.el8_3.x86_64 Wed 26 May 2021 04:30:47 PM UTC 2021-05-26T16:31:12.538 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:12.538 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2021-05-26T16:31:12.568 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2021-05-26T16:31:12.569 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2021-05-26T16:31:12.569 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.02 2021-05-26T16:31:12.569 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 90.el8 2021-05-26T16:31:12.569 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2021-05-26T16:31:12.570 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Mon 01 Mar 2021 06:17:56 PM UTC 2021-05-26T16:31:12.570 INFO:teuthology.orchestra.run.smithi137.stdout:Group : System Environment/Base 2021-05-26T16:31:12.570 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 9197207 2021-05-26T16:31:12.570 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2021-05-26T16:31:12.571 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-05-26T16:31:12.571 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-05-26T16:31:12.571 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-05-26T16:31:12.571 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : kbuilder.bsys.centos.org 2021-05-26T16:31:12.571 INFO:teuthology.orchestra.run.smithi137.stdout:Relocations : (not relocatable) 2021-05-26T16:31:12.572 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : CentOS BuildSystem 2021-05-26T16:31:12.572 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2021-05-26T16:31:12.572 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2021-05-26T16:31:12.572 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2021-05-26T16:31:12.573 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2021-05-26T16:31:12.573 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:31:12.573 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-05-26T16:31:12.573 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2021-05-26T16:31:12.573 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2021-05-26T16:31:12.574 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2021-05-26T16:31:12.574 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:31:12.574 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2021-05-26T16:31:12.575 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-05-26T16:31:12.575 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:12.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-05-26T16:31:13.969 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2021-05-26T16:31:15.881 INFO:teuthology.orchestra.run.smithi137.stderr:done 2021-05-26T16:31:15.883 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2021-05-26T16:31:15.941 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.7EBzLOHXfe 2021-05-26T16:31:15.941 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7EBzLOHXfe 2021-05-26T16:31:15.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.7EBzLOHXfe 2021-05-26T16:31:16.128 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.7EBzLOHXfe is 6KB 2021-05-26T16:31:16.177 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.7EBzLOHXfe 2021-05-26T16:31:16.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2021-05-26T16:31:16.252 INFO:teuthology.orchestra.run.smithi137.stdout:631d84db90f7409fbdd390573ae89718-0-rescue.conf 2021-05-26T16:31:16.253 INFO:teuthology.orchestra.run.smithi137.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.10.1.el8_3.x86_64.conf 2021-05-26T16:31:16.253 INFO:teuthology.orchestra.run.smithi137.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.22.1.el8_3.x86_64.conf 2021-05-26T16:31:16.253 INFO:teuthology.orchestra.run.smithi137.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.el8.x86_64.conf 2021-05-26T16:31:16.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default 631d84db90f7409fbdd390573ae89718-4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:31:16.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2021-05-26T16:31:46.435 INFO:teuthology.misc:Re-opening connections... 2021-05-26T16:31:46.436 INFO:teuthology.misc:trying to connect to ubuntu@smithi003.front.sepia.ceph.com 2021-05-26T16:31:46.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:31:46.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:32:04.811 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2021-05-26T16:32:04.812 INFO:teuthology.misc:trying to connect to ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:32:04.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:32:04.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:32:39.375 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2021-05-26T16:32:39.376 DEBUG:teuthology.misc:waited 52.94011092185974 2021-05-26T16:32:40.377 INFO:teuthology.misc:trying to connect to ubuntu@smithi003.front.sepia.ceph.com 2021-05-26T16:32:40.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:32:40.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:32:43.783 DEBUG:teuthology.orchestra.run.smithi003:> true 2021-05-26T16:32:44.252 DEBUG:teuthology.misc:waited 57.81678080558777 2021-05-26T16:32:45.254 INFO:teuthology.misc:trying to connect to ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:32:45.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:32:45.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:32:48.330 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2021-05-26T16:32:48.331 DEBUG:teuthology.misc:waited 61.895530700683594 2021-05-26T16:32:49.332 INFO:teuthology.misc:trying to connect to ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:32:49.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:32:49.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:32:51.402 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2021-05-26T16:32:51.403 DEBUG:teuthology.misc:waited 64.96756219863892 2021-05-26T16:32:52.404 INFO:teuthology.misc:trying to connect to ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:32:52.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:32:52.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:32:53.113 DEBUG:teuthology.orchestra.run.smithi137:> true 2021-05-26T16:32:53.496 DEBUG:teuthology.misc:waited 67.06015133857727 2021-05-26T16:32:54.497 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-05-26T16:32:54.498 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-240.22.1.el8_3.x86_64"... 2021-05-26T16:32:54.498 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2021-05-26T16:32:54.516 INFO:teuthology.orchestra.run.smithi003.stdout:4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:32:54.516 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.22.1.el8_3.x86_64 vs 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:32:54.517 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-05-26T16:32:54.517 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-05-26T16:32:54.517 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2021-05-26T16:32:54.517 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "4.18.0-240.22.1.el8_3.x86_64"... 2021-05-26T16:32:54.518 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2021-05-26T16:32:54.539 INFO:teuthology.orchestra.run.smithi137.stdout:4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:32:54.540 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.22.1.el8_3.x86_64 vs 4.18.0-240.22.1.el8_3.x86_64 2021-05-26T16:32:54.540 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-05-26T16:32:54.541 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-05-26T16:32:55.542 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-05-26T16:32:55.542 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-05-26T16:32:55.627 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2021-05-26T16:32:55.643 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2021-05-26T16:32:55.643 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-05-26T16:32:55.726 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2021-05-26T16:32:55.758 INFO:teuthology.run_tasks:Running task internal.base... 2021-05-26T16:32:55.770 INFO:teuthology.task.internal:Creating test directory... 2021-05-26T16:32:55.770 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-05-26T16:32:55.773 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-05-26T16:32:55.788 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-05-26T16:32:55.813 INFO:teuthology.run_tasks:Running task internal.archive... 2021-05-26T16:32:55.863 INFO:teuthology.task.internal:Creating archive directory... 2021-05-26T16:32:55.863 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-05-26T16:32:55.866 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-05-26T16:32:55.894 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-05-26T16:32:55.912 INFO:teuthology.task.internal:Enabling coredump saving... 2021-05-26T16:32:55.913 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-05-26T16:32:55.930 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-05-26T16:32:55.964 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-05-26T16:32:55.976 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-05-26T16:32:55.986 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-05-26T16:32:55.997 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-05-26T16:32:55.999 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-05-26T16:32:56.007 INFO:teuthology.task.internal:Configuring sudo... 2021-05-26T16:32:56.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-05-26T16:32:56.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-05-26T16:32:56.049 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-05-26T16:32:56.065 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-05-26T16:32:56.066 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-05-26T16:32:56.091 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-05-26T16:32:56.106 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-05-26T16:32:56.182 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-05-26T16:32:56.245 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-05-26T16:32:56.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-05-26T16:32:56.370 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:32:56.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-05-26T16:32:56.436 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-05-26T16:32:56.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-05-26T16:32:56.535 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-05-26T16:32:56.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-05-26T16:32:56.655 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:32:56.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-05-26T16:32:56.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2021-05-26T16:32:56.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2021-05-26T16:32:56.808 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-05-26T16:32:56.840 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-05-26T16:32:57.094 INFO:teuthology.run_tasks:Running task internal.timer... 2021-05-26T16:32:57.105 INFO:teuthology.task.internal:Starting timer... 2021-05-26T16:32:57.105 INFO:teuthology.run_tasks:Running task pcp... 2021-05-26T16:32:57.156 INFO:teuthology.run_tasks:Running task selinux... 2021-05-26T16:32:57.205 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-05-26T16:32:57.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2021-05-26T16:32:57.288 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: [ OK ] 2021-05-26T16:32:57.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2021-05-26T16:32:57.356 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: [ OK ] 2021-05-26T16:32:57.357 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-05-26T16:32:57.358 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2021-05-26T16:32:57.376 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2021-05-26T16:32:57.377 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2021-05-26T16:32:57.405 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2021-05-26T16:32:57.406 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive'} 2021-05-26T16:32:57.407 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-05-26T16:32:57.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-05-26T16:32:57.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-05-26T16:32:57.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-05-26T16:32:57.472 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-05-26T16:32:57.473 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2021-05-26T16:32:57.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2021-05-26T16:32:57.537 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-05-26T16:32:57.549 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-05-26T16:32:57.555 INFO:teuthology.repo_utils:Fetching master from origin 2021-05-26T16:32:57.585 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-05-26T16:32:57.603 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-05-26T16:32:57.604 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-05-26T16:32:57.930 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-05-26T16:32:58.741 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-05-26T16:33:01.488 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-05-26T16:33:01.512 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:01 +0000 (0:00:00.041) 0:00:00.041 ********* 2021-05-26T16:33:01.526 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:01 +0000 (0:00:00.014) 0:00:00.055 ********* 2021-05-26T16:33:04.098 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi003.front.sepia.ceph.com] 2021-05-26T16:33:04.148 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:04 +0000 (0:00:02.621) 0:00:02.676 ********* 2021-05-26T16:33:04.168 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] 2021-05-26T16:33:04.225 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:04 +0000 (0:00:00.077) 0:00:02.753 ********* 2021-05-26T16:33:04.596 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-05-26T16:33:04.597 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-05-26T16:33:04.621 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:04 +0000 (0:00:00.395) 0:00:03.149 ********* 2021-05-26T16:33:04.627 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-05-26T16:33:04.651 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:04 +0000 (0:00:00.030) 0:00:03.179 ********* 2021-05-26T16:33:05.232 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-05-26T16:33:05.234 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-05-26T16:33:05.256 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:05 +0000 (0:00:00.605) 0:00:03.785 ********* 2021-05-26T16:33:05.264 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-05-26T16:33:05.288 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:05 +0000 (0:00:00.031) 0:00:03.816 ********* 2021-05-26T16:33:05.315 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-05-26T16:33:05.317 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:05.340 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:05 +0000 (0:00:00.051) 0:00:03.868 ********* 2021-05-26T16:33:05.357 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:05.383 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:05 +0000 (0:00:00.043) 0:00:03.911 ********* 2021-05-26T16:33:05.767 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-05-26T16:33:05.769 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:33:05.789 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:05 +0000 (0:00:00.406) 0:00:04.318 ********* 2021-05-26T16:33:05.796 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:33:05.819 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:05 +0000 (0:00:00.029) 0:00:04.348 ********* 2021-05-26T16:33:06.896 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-05-26T16:33:06.898 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622046785.8316429-536-26626706250346/source", "state": "file", "uid": 0} 2021-05-26T16:33:06.917 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:06 +0000 (0:00:01.098) 0:00:05.446 ********* 2021-05-26T16:33:06.924 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622046785.8606608-539-176948205826740/source", "state": "file", "uid": 0} 2021-05-26T16:33:06.947 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:06 +0000 (0:00:00.029) 0:00:05.475 ********* 2021-05-26T16:33:07.574 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-05-26T16:33:07.576 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-05-26T16:33:07.578 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-05-26T16:33:07.579 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-05-26T16:33:07.581 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-05-26T16:33:07.659 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-05-26T16:33:07.661 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-05-26T16:33:07.673 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-05-26T16:33:07.675 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:07 +0000 (0:00:00.726) 0:00:06.202 ********* 2021-05-26T16:33:08.254 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] 2021-05-26T16:33:09.247 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] 2021-05-26T16:33:09.264 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-05-26T16:33:09.265 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:09 +0000 (0:00:01.590) 0:00:07.792 ********* 2021-05-26T16:33:09.293 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-05-26T16:33:09.304 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-05-26T16:33:09.309 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-05-26T16:33:09.476 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:09 +0000 (0:00:00.211) 0:00:08.004 ********* 2021-05-26T16:33:09.494 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:09 +0000 (0:00:00.017) 0:00:08.022 ********* 2021-05-26T16:33:10.116 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi137.front.sepia.ceph.com] 2021-05-26T16:33:10.167 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-05-26T16:33:10.169 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:10 +0000 (0:00:00.673) 0:00:08.696 ********* 2021-05-26T16:33:10.694 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-05-26T16:33:10.695 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.167537", "end": "2021-05-26 16:33:10.672870", "rc": 0, "start": "2021-05-26 16:33:10.505333", "stderr": "", "stderr_lines": [], "stdout": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "stdout_lines": ["b2a91f5f527dcc382f8ed49697328a42af627ee8"]} 2021-05-26T16:33:10.715 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:10 +0000 (0:00:00.548) 0:00:09.244 ********* 2021-05-26T16:33:10.909 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-05-26T16:33:10.911 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014506", "end": "2021-05-26 16:33:10.892573", "failed_when_result": false, "rc": 0, "start": "2021-05-26 16:33:10.878067", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-05-26T16:33:10.931 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:10 +0000 (0:00:00.216) 0:00:09.460 ********* 2021-05-26T16:33:11.000 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-05-26T16:33:11.002 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:11.022 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.090) 0:00:09.550 ********* 2021-05-26T16:33:11.090 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-05-26T16:33:11.091 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:11.113 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.090) 0:00:09.641 ********* 2021-05-26T16:33:11.132 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi003.front.sepia.ceph.com] 2021-05-26T16:33:11.185 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.070) 0:00:09.711 ********* 2021-05-26T16:33:11.189 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-05-26T16:33:11.191 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:11.213 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.030) 0:00:09.742 ********* 2021-05-26T16:33:11.282 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-05-26T16:33:11.284 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:11.304 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.090) 0:00:09.833 ********* 2021-05-26T16:33:11.373 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-05-26T16:33:11.375 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:11.396 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.091) 0:00:09.924 ********* 2021-05-26T16:33:11.591 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-05-26T16:33:11.592 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.172693", "end": "2021-05-26 16:33:11.561214", "rc": 0, "start": "2021-05-26 16:33:11.388521", "stderr": "", "stderr_lines": [], "stdout": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "stdout_lines": ["b2a91f5f527dcc382f8ed49697328a42af627ee8"]} 2021-05-26T16:33:11.614 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.217) 0:00:10.142 ********* 2021-05-26T16:33:11.633 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-05-26T16:33:11.634 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:33:11.657 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.043) 0:00:10.186 ********* 2021-05-26T16:33:11.821 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-05-26T16:33:11.823 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009266", "end": "2021-05-26 16:33:11.800864", "failed_when_result": false, "rc": 0, "start": "2021-05-26 16:33:11.791598", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-05-26T16:33:11.844 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.186) 0:00:10.372 ********* 2021-05-26T16:33:11.912 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-05-26T16:33:11.914 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:11.935 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:11 +0000 (0:00:00.091) 0:00:10.464 ********* 2021-05-26T16:33:11.953 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-05-26T16:33:11.955 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-05-26T16:33:12.006 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-05-26T16:33:12.008 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:12.029 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:12 +0000 (0:00:00.093) 0:00:10.558 ********* 2021-05-26T16:33:12.098 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-05-26T16:33:12.100 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:12.120 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:12 +0000 (0:00:00.090) 0:00:10.648 ********* 2021-05-26T16:33:12.137 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-05-26T16:33:12.138 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-05-26T16:33:12.190 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:12.211 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:12 +0000 (0:00:00.091) 0:00:10.740 ********* 2021-05-26T16:33:12.281 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-05-26T16:33:12.283 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:12.303 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:12 +0000 (0:00:00.091) 0:00:10.831 ********* 2021-05-26T16:33:12.330 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-05-26T16:33:12.332 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-05-26T16:33:12.529 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-05-26T16:33:12.541 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-05-26T16:33:12.542 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:33:12.564 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:12 +0000 (0:00:00.261) 0:00:11.092 ********* 2021-05-26T16:33:12.715 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-05-26T16:33:12.717 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-05-26T16:33:12.845 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-05-26T16:33:12.908 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-05-26T16:33:13.043 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-05-26T16:33:13.096 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-05-26T16:33:13.253 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-05-26T16:33:13.295 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-05-26T16:33:13.452 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-05-26T16:33:13.484 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-05-26T16:33:13.650 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-05-26T16:33:13.683 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-05-26T16:33:13.850 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-05-26T16:33:13.872 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-05-26T16:33:14.060 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-05-26T16:33:14.061 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-05-26T16:33:14.248 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-05-26T16:33:14.282 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-05-26T16:33:14.447 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-05-26T16:33:14.459 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-05-26T16:33:14.635 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-05-26T16:33:14.668 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-05-26T16:33:14.834 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-05-26T16:33:14.866 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-05-26T16:33:15.024 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-05-26T16:33:15.067 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-05-26T16:33:15.223 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-05-26T16:33:15.267 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-05-26T16:33:15.413 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-05-26T16:33:15.477 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-05-26T16:33:15.613 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-05-26T16:33:15.676 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-05-26T16:33:15.801 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-05-26T16:33:15.875 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-05-26T16:33:16.001 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-05-26T16:33:16.074 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-05-26T16:33:16.189 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-05-26T16:33:16.283 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-05-26T16:33:16.398 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-05-26T16:33:16.483 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-05-26T16:33:16.598 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-05-26T16:33:16.682 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-05-26T16:33:16.786 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-05-26T16:33:16.881 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-05-26T16:33:16.985 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-05-26T16:33:17.080 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-05-26T16:33:17.175 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-05-26T16:33:17.279 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-05-26T16:33:17.373 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-05-26T16:33:17.499 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-05-26T16:33:17.562 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-05-26T16:33:17.698 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-05-26T16:33:17.761 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-05-26T16:33:17.898 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-05-26T16:33:17.951 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-05-26T16:33:18.098 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-05-26T16:33:18.140 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-05-26T16:33:18.296 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-05-26T16:33:18.338 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-05-26T16:33:18.495 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-05-26T16:33:18.527 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-05-26T16:33:18.705 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-05-26T16:33:18.716 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-05-26T16:33:18.913 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-05-26T16:33:18.914 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-05-26T16:33:19.112 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-05-26T16:33:19.113 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-05-26T16:33:19.301 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-05-26T16:33:19.312 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-05-26T16:33:19.493 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-05-26T16:33:19.516 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-05-26T16:33:19.693 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-05-26T16:33:19.725 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-05-26T16:33:19.882 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-05-26T16:33:19.924 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-05-26T16:33:20.071 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-05-26T16:33:20.124 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-05-26T16:33:20.259 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-05-26T16:33:20.333 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-05-26T16:33:20.459 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-05-26T16:33:20.533 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-05-26T16:33:20.648 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-05-26T16:33:20.732 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-05-26T16:33:20.837 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-05-26T16:33:20.943 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-05-26T16:33:21.028 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-05-26T16:33:21.143 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-05-26T16:33:21.230 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-05-26T16:33:21.346 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-05-26T16:33:21.421 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-05-26T16:33:21.547 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-05-26T16:33:21.611 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-05-26T16:33:21.759 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-05-26T16:33:21.804 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-05-26T16:33:21.961 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-05-26T16:33:22.004 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-05-26T16:33:22.164 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-05-26T16:33:22.196 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-05-26T16:33:22.365 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-05-26T16:33:22.387 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-05-26T16:33:22.564 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-05-26T16:33:22.586 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-05-26T16:33:22.775 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-05-26T16:33:22.787 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-05-26T16:33:22.978 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-05-26T16:33:22.981 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-05-26T16:33:23.179 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-05-26T16:33:23.180 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-05-26T16:33:23.369 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-05-26T16:33:23.380 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-05-26T16:33:23.561 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-05-26T16:33:23.583 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-05-26T16:33:23.761 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-05-26T16:33:23.794 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-05-26T16:33:23.950 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-05-26T16:33:23.993 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-05-26T16:33:24.139 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-05-26T16:33:24.192 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-05-26T16:33:24.338 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-05-26T16:33:24.402 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-05-26T16:33:24.528 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-05-26T16:33:24.604 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-05-26T16:33:24.721 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-05-26T16:33:24.805 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-05-26T16:33:24.910 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-05-26T16:33:25.005 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-05-26T16:33:25.114 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-05-26T16:33:25.210 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-05-26T16:33:25.314 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-05-26T16:33:25.409 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-05-26T16:33:25.504 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-05-26T16:33:25.610 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-05-26T16:33:25.695 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-05-26T16:33:25.810 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-05-26T16:33:25.884 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-05-26T16:33:26.011 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-05-26T16:33:26.084 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-05-26T16:33:26.221 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-05-26T16:33:26.274 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-05-26T16:33:26.421 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-05-26T16:33:26.464 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-05-26T16:33:26.623 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-05-26T16:33:26.655 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-05-26T16:33:26.824 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-05-26T16:33:26.857 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-05-26T16:33:27.025 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-05-26T16:33:27.047 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-05-26T16:33:27.235 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-05-26T16:33:27.236 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-05-26T16:33:27.435 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-05-26T16:33:27.446 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-05-26T16:33:27.629 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-05-26T16:33:27.641 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-05-26T16:33:27.822 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-05-26T16:33:27.844 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-05-26T16:33:28.011 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-05-26T16:33:28.055 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-05-26T16:33:28.212 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-05-26T16:33:28.255 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-05-26T16:33:28.401 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-05-26T16:33:28.454 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-05-26T16:33:28.591 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-05-26T16:33:28.654 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-05-26T16:33:28.781 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-05-26T16:33:28.855 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-05-26T16:33:28.981 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-05-26T16:33:29.056 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-05-26T16:33:29.171 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-05-26T16:33:29.266 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-05-26T16:33:29.361 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-05-26T16:33:29.465 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-05-26T16:33:29.560 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-05-26T16:33:29.665 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-05-26T16:33:29.759 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-05-26T16:33:29.876 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-05-26T16:33:29.951 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-05-26T16:33:30.088 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-05-26T16:33:30.142 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-05-26T16:33:30.278 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-05-26T16:33:30.331 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-05-26T16:33:30.488 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-05-26T16:33:30.520 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-05-26T16:33:30.687 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-05-26T16:33:30.719 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-05-26T16:33:30.886 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-05-26T16:33:30.910 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-05-26T16:33:31.096 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-05-26T16:33:31.097 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-05-26T16:33:31.285 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-05-26T16:33:31.296 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-05-26T16:33:31.483 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-05-26T16:33:31.505 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-05-26T16:33:31.672 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-05-26T16:33:31.703 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-05-26T16:33:31.861 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-05-26T16:33:31.904 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-05-26T16:33:32.059 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-05-26T16:33:32.112 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-05-26T16:33:32.248 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-05-26T16:33:32.311 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-05-26T16:33:32.446 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-05-26T16:33:32.509 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-05-26T16:33:32.634 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-05-26T16:33:32.718 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-05-26T16:33:32.823 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-05-26T16:33:32.917 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-05-26T16:33:33.011 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-05-26T16:33:33.126 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-05-26T16:33:33.210 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-05-26T16:33:33.335 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-05-26T16:33:33.397 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-05-26T16:33:33.533 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-05-26T16:33:33.596 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-05-26T16:33:33.742 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-05-26T16:33:33.785 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-05-26T16:33:33.942 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-05-26T16:33:33.984 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-05-26T16:33:34.141 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-05-26T16:33:34.174 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-05-26T16:33:34.351 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-05-26T16:33:34.362 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-05-26T16:33:34.550 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-05-26T16:33:34.561 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-05-26T16:33:34.749 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-05-26T16:33:34.760 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-05-26T16:33:34.948 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-05-26T16:33:34.948 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-05-26T16:33:35.137 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-05-26T16:33:35.148 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-05-26T16:33:35.335 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-05-26T16:33:35.358 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-05-26T16:33:35.527 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-05-26T16:33:35.560 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-05-26T16:33:35.719 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-05-26T16:33:35.762 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-05-26T16:33:35.910 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-05-26T16:33:35.963 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-05-26T16:33:36.109 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-05-26T16:33:36.162 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-05-26T16:33:36.300 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-05-26T16:33:36.363 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-05-26T16:33:36.499 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-05-26T16:33:36.563 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-05-26T16:33:36.689 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-05-26T16:33:36.774 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-05-26T16:33:36.879 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-05-26T16:33:36.974 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-05-26T16:33:37.071 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-05-26T16:33:37.177 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-05-26T16:33:37.272 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-05-26T16:33:37.388 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-05-26T16:33:37.463 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-05-26T16:33:37.590 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-05-26T16:33:37.653 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-05-26T16:33:37.791 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-05-26T16:33:37.856 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-05-26T16:33:38.003 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-05-26T16:33:38.047 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-05-26T16:33:38.205 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-05-26T16:33:38.237 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-05-26T16:33:38.404 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-05-26T16:33:38.436 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-05-26T16:33:38.614 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-05-26T16:33:38.815 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-05-26T16:33:39.016 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-05-26T16:33:39.226 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-05-26T16:33:39.426 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-05-26T16:33:39.629 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-05-26T16:33:39.838 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-05-26T16:33:40.025 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-05-26T16:33:40.036 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-05-26T16:33:40.245 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-05-26T16:33:40.445 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-05-26T16:33:40.645 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-05-26T16:33:41.967 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-05-26T16:33:42.332 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-05-26T16:33:43.434 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-05-26T16:33:44.144 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-05-26T16:33:45.005 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-05-26T16:33:45.783 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-05-26T16:33:46.490 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-05-26T16:33:47.442 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-05-26T16:33:48.080 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-05-26T16:33:48.203 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:48 +0000 (0:00:35.639) 0:00:46.732 ********* 2021-05-26T16:33:48.273 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-05-26T16:33:48.294 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:48 +0000 (0:00:00.090) 0:00:46.823 ********* 2021-05-26T16:33:48.386 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-05-26T16:33:48.388 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-05-26T16:33:48.390 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-05-26T16:33:48.392 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-05-26T16:33:48.393 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-05-26T16:33:48.395 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRah 2021-05-26T16:33:48.395 INFO:teuthology.task.ansible.out:w fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de 2021-05-26T16:33:48.397 INFO:teuthology.task.ansible.out:53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d 2021-05-26T16:33:48.399 INFO:teuthology.task.ansible.out:7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumra 2021-05-26T16:33:48.401 INFO:teuthology.task.ansible.out:o", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b76 2021-05-26T16:33:48.402 INFO:teuthology.task.ansible.out:8c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70f 2021-05-26T16:33:48.404 INFO:teuthology.task.ansible.out:f00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41 2021-05-26T16:33:48.406 INFO:teuthology.task.ansible.out:e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5 2021-05-26T16:33:48.407 INFO:teuthology.task.ansible.out:dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b6 2021-05-26T16:33:48.408 INFO:teuthology.task.ansible.out:90da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b 2021-05-26T16:33:48.409 INFO:teuthology.task.ansible.out:1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda77 2021-05-26T16:33:48.411 INFO:teuthology.task.ansible.out:63cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}]}, "changed": false} 2021-05-26T16:33:48.434 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:48 +0000 (0:00:00.139) 0:00:46.963 ********* 2021-05-26T16:33:49.149 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-05-26T16:33:49.152 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-05-26T16:33:49.705 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-05-26T16:33:49.707 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"after": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "attempts": 1, "before": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "changed": false, "remote_url_changed": false} 2021-05-26T16:33:49.727 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:49 +0000 (0:00:01.292) 0:00:48.255 ********* 2021-05-26T16:33:50.058 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:33:50.059 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-05-26T16:33:50.267 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-05-26T16:33:50.487 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-05-26T16:33:50.687 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-05-26T16:33:50.688 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-05-26T16:33:50.897 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-05-26T16:33:50.899 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvF 2021-05-26T16:33:50.900 INFO:teuthology.task.ansible.out:W5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-05-26T16:33:50.946 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-05-26T16:33:51.016 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:51 +0000 (0:00:01.288) 0:00:49.544 ********* 2021-05-26T16:33:51.085 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-05-26T16:33:51.107 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:51 +0000 (0:00:00.091) 0:00:49.635 ********* 2021-05-26T16:33:51.114 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:33:51.115 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-05-26T16:33:51.116 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-05-26T16:33:51.201 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-05-26T16:33:51.202 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-05-26T16:33:51.204 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-05-26T16:33:51.206 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-05-26T16:33:51.207 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-05-26T16:33:51.209 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de 2021-05-26T16:33:51.211 INFO:teuthology.task.ansible.out:53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d 2021-05-26T16:33:51.212 INFO:teuthology.task.ansible.out:7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846ab 2021-05-26T16:33:51.213 INFO:teuthology.task.ansible.out:d9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumra 2021-05-26T16:33:51.214 INFO:teuthology.task.ansible.out:o", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b76 2021-05-26T16:33:51.216 INFO:teuthology.task.ansible.out:8c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70f 2021-05-26T16:33:51.217 INFO:teuthology.task.ansible.out:f00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41 2021-05-26T16:33:51.219 INFO:teuthology.task.ansible.out:e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b97 2021-05-26T16:33:51.220 INFO:teuthology.task.ansible.out:15003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5 2021-05-26T16:33:51.222 INFO:teuthology.task.ansible.out:dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b 2021-05-26T16:33:51.223 INFO:teuthology.task.ansible.out:1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda77 2021-05-26T16:33:51.225 INFO:teuthology.task.ansible.out:63cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}]}, "changed": false} 2021-05-26T16:33:51.249 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:51 +0000 (0:00:00.141) 0:00:49.777 ********* 2021-05-26T16:33:51.307 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:33:51.309 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-05-26T16:33:51.508 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-05-26T16:33:51.718 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-05-26T16:33:51.741 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:51.887 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-05-26T16:33:51.889 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"after": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "attempts": 1, "before": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "changed": false, "remote_url_changed": false} 2021-05-26T16:33:51.908 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:33:51 +0000 (0:00:00.659) 0:00:50.437 ********* 2021-05-26T16:33:51.956 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:33:51.958 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-05-26T16:33:51.959 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-05-26T16:33:52.155 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-05-26T16:33:52.157 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-05-26T16:33:52.166 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:52.168 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:52.241 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-05-26T16:33:52.367 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-05-26T16:33:52.462 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-05-26T16:33:52.578 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-05-26T16:33:52.580 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-05-26T16:33:52.682 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-05-26T16:33:52.778 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-05-26T16:33:52.893 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-05-26T16:33:52.894 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-05-26T16:33:52.976 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-05-26T16:33:52.978 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-05-26T16:33:53.113 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-05-26T16:33:53.176 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-05-26T16:33:53.322 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-05-26T16:33:53.324 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-05-26T16:33:53.375 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-05-26T16:33:53.532 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-05-26T16:33:53.575 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-05-26T16:33:53.755 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-05-26T16:33:53.777 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-05-26T16:33:53.777 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-05-26T16:33:53.964 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-05-26T16:33:53.975 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:53.987 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-05-26T16:33:53.989 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-05-26T16:33:54.186 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-05-26T16:33:54.197 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-05-26T16:33:54.198 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-05-26T16:33:54.384 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-05-26T16:33:54.406 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-05-26T16:33:54.408 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-05-26T16:33:54.417 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:54.428 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:33:54.595 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-05-26T16:33:54.597 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-05-26T16:33:54.637 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-05-26T16:33:54.793 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-05-26T16:33:54.846 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-05-26T16:33:54.848 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-05-26T16:33:54.993 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-05-26T16:33:55.066 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-05-26T16:33:55.192 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-05-26T16:33:55.276 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-05-26T16:33:55.278 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-05-26T16:33:55.400 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-05-26T16:33:55.485 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-05-26T16:33:55.600 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-05-26T16:33:55.694 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-05-26T16:33:55.801 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-05-26T16:33:55.803 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-05-26T16:33:55.906 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-05-26T16:33:56.010 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-05-26T16:33:56.125 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-05-26T16:33:56.127 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-05-26T16:33:56.208 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-05-26T16:33:56.343 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-05-26T16:33:56.345 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-05-26T16:33:56.417 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-05-26T16:33:56.552 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-05-26T16:33:56.615 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-05-26T16:33:56.772 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-05-26T16:33:56.814 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-05-26T16:33:56.980 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-05-26T16:33:56.982 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-05-26T16:33:57.023 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-05-26T16:33:57.189 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-05-26T16:33:57.232 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-05-26T16:33:57.409 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-05-26T16:33:57.430 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-05-26T16:33:57.617 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-05-26T16:33:57.639 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-05-26T16:33:57.641 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-05-26T16:33:57.837 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-05-26T16:33:57.838 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-05-26T16:33:57.840 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-05-26T16:33:58.045 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-05-26T16:33:58.046 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-05-26T16:33:58.245 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-05-26T16:33:58.267 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-05-26T16:33:58.268 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-05-26T16:33:58.454 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-05-26T16:33:58.486 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-05-26T16:33:58.662 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-05-26T16:33:58.664 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-05-26T16:33:58.694 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-05-26T16:33:58.872 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-05-26T16:33:58.873 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-05-26T16:33:58.875 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-05-26T16:33:58.904 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-05-26T16:33:59.070 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-05-26T16:33:59.112 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-05-26T16:33:59.267 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-05-26T16:33:59.330 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-05-26T16:33:59.486 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-05-26T16:33:59.549 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-05-26T16:33:59.684 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-05-26T16:33:59.757 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-05-26T16:33:59.884 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-05-26T16:33:59.967 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-05-26T16:34:00.093 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-05-26T16:34:00.095 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-05-26T16:34:00.187 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-05-26T16:34:00.189 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-05-26T16:34:00.292 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-05-26T16:34:00.396 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-05-26T16:34:00.398 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-05-26T16:34:00.490 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-05-26T16:34:00.606 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-05-26T16:34:00.699 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-05-26T16:34:00.701 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-05-26T16:34:00.814 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-05-26T16:34:00.898 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-05-26T16:34:01.033 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-05-26T16:34:01.096 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-05-26T16:34:01.252 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-05-26T16:34:01.254 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-05-26T16:34:01.294 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-05-26T16:34:01.296 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-05-26T16:34:01.471 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-05-26T16:34:01.473 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-05-26T16:34:01.475 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-05-26T16:34:01.504 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-05-26T16:34:01.681 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-05-26T16:34:01.703 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-05-26T16:34:01.891 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-05-26T16:34:01.902 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-05-26T16:34:02.099 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-05-26T16:34:02.111 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-05-26T16:34:02.308 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-05-26T16:34:02.330 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-05-26T16:34:02.508 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-05-26T16:34:02.540 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-05-26T16:34:02.707 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-05-26T16:34:02.749 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-05-26T16:34:02.751 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-05-26T16:34:02.906 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-05-26T16:34:02.959 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-05-26T16:34:03.116 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-05-26T16:34:03.169 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-05-26T16:34:03.315 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-05-26T16:34:03.389 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-05-26T16:34:03.391 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-05-26T16:34:03.525 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-05-26T16:34:03.598 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-05-26T16:34:03.724 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-05-26T16:34:03.818 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-05-26T16:34:03.933 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-05-26T16:34:04.027 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-05-26T16:34:04.029 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-05-26T16:34:04.131 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-05-26T16:34:04.247 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-05-26T16:34:04.330 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-05-26T16:34:04.456 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-05-26T16:34:04.550 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-05-26T16:34:04.665 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-05-26T16:34:04.749 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-05-26T16:34:04.874 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-05-26T16:34:04.947 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-05-26T16:34:05.084 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-05-26T16:34:05.157 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-05-26T16:34:05.302 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-05-26T16:34:05.355 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-05-26T16:34:05.512 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-05-26T16:34:05.564 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-05-26T16:34:05.566 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-05-26T16:34:05.730 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-05-26T16:34:05.773 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-05-26T16:34:05.940 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-05-26T16:34:05.971 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-05-26T16:34:06.148 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-05-26T16:34:06.169 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-05-26T16:34:06.357 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-05-26T16:34:06.368 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-05-26T16:34:06.575 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-05-26T16:34:06.577 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-05-26T16:34:06.773 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-05-26T16:34:06.775 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-05-26T16:34:06.784 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-05-26T16:34:06.982 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-05-26T16:34:07.003 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-05-26T16:34:07.180 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-05-26T16:34:07.212 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-05-26T16:34:07.389 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-05-26T16:34:07.432 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-05-26T16:34:07.587 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-05-26T16:34:07.640 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-05-26T16:34:07.785 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-05-26T16:34:07.859 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-05-26T16:34:07.994 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-05-26T16:34:08.067 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-05-26T16:34:08.192 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-05-26T16:34:08.276 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-05-26T16:34:08.401 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-05-26T16:34:08.403 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-05-26T16:34:08.489 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-05-26T16:34:08.491 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-05-26T16:34:08.604 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-05-26T16:34:08.698 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-05-26T16:34:08.802 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-05-26T16:34:08.917 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-05-26T16:34:09.011 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-05-26T16:34:09.126 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-05-26T16:34:09.209 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-05-26T16:34:09.335 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-05-26T16:34:09.408 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-05-26T16:34:09.553 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-05-26T16:34:09.555 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-05-26T16:34:09.616 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-05-26T16:34:09.762 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-05-26T16:34:09.764 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-05-26T16:34:09.814 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-05-26T16:34:09.816 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-05-26T16:34:09.981 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-05-26T16:34:10.023 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-05-26T16:34:10.201 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-05-26T16:34:10.222 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-05-26T16:34:10.410 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-05-26T16:34:10.421 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-05-26T16:34:10.619 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-05-26T16:34:10.630 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-05-26T16:34:10.827 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-05-26T16:34:10.829 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-05-26T16:34:11.036 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-05-26T16:34:11.048 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-05-26T16:34:11.235 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-05-26T16:34:11.257 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-05-26T16:34:11.446 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-05-26T16:34:11.467 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-05-26T16:34:11.469 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-05-26T16:34:11.643 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-05-26T16:34:11.686 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-05-26T16:34:11.841 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-05-26T16:34:11.904 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-05-26T16:34:12.050 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-05-26T16:34:12.113 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-05-26T16:34:12.248 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-05-26T16:34:12.322 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-05-26T16:34:12.457 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-05-26T16:34:12.530 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-05-26T16:34:12.655 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-05-26T16:34:12.749 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-05-26T16:34:12.865 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-05-26T16:34:12.960 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-05-26T16:34:12.961 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-05-26T16:34:13.075 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-05-26T16:34:13.168 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-05-26T16:34:13.273 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-05-26T16:34:13.377 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-05-26T16:34:13.472 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-05-26T16:34:13.598 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-05-26T16:34:13.681 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-05-26T16:34:13.683 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-05-26T16:34:13.806 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-05-26T16:34:13.880 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-05-26T16:34:14.017 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-05-26T16:34:14.080 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-05-26T16:34:14.226 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-05-26T16:34:14.279 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-05-26T16:34:14.434 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-05-26T16:34:14.487 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-05-26T16:34:14.643 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-05-26T16:34:14.689 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-05-26T16:34:14.866 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-05-26T16:34:14.887 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-05-26T16:34:15.075 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-05-26T16:34:15.086 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-05-26T16:34:15.284 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-05-26T16:34:15.295 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-05-26T16:34:15.491 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-05-26T16:34:15.502 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-05-26T16:34:15.689 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-05-26T16:34:15.711 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-05-26T16:34:15.897 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-05-26T16:34:15.919 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-05-26T16:34:16.106 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-05-26T16:34:16.128 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-05-26T16:34:16.305 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-05-26T16:34:16.347 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-05-26T16:34:16.504 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-05-26T16:34:16.557 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-05-26T16:34:16.703 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-05-26T16:34:16.776 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-05-26T16:34:16.911 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-05-26T16:34:16.986 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-05-26T16:34:16.988 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-05-26T16:34:17.112 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-05-26T16:34:17.114 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-05-26T16:34:17.205 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-05-26T16:34:17.320 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-05-26T16:34:17.414 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-05-26T16:34:17.519 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-05-26T16:34:17.718 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-05-26T16:34:17.760 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-05-26T16:34:17.937 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-05-26T16:34:17.969 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-05-26T16:34:18.135 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-05-26T16:34:18.178 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-05-26T16:34:18.344 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-05-26T16:34:18.396 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-05-26T16:34:18.553 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-05-26T16:34:18.611 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-05-26T16:34:18.632 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:18 +0000 (0:00:26.723) 0:01:17.160 ********* 2021-05-26T16:34:18.715 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:18.717 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.727 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.728 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.739 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.750 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.751 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.761 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.762 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.825 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:18.827 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-05-26T16:34:18.982 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:18.984 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-05-26T16:34:18.993 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:18.995 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.036 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:19.037 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-05-26T16:34:19.192 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-05-26T16:34:19.255 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:19.257 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-05-26T16:34:19.401 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:19.403 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-05-26T16:34:19.464 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:19.466 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-05-26T16:34:19.537 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:19.539 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.549 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.560 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.562 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.571 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.573 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.583 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.593 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.595 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.605 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.606 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.616 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.627 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.629 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.639 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.640 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.650 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.652 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.662 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.673 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.674 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.685 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.696 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.698 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.707 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.709 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.718 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.729 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.731 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.740 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.742 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.752 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.753 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.763 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.765 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.774 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.785 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.786 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.797 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.798 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.808 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.809 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.819 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.830 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.832 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.841 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.843 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.852 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.854 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.864 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.874 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.876 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.886 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.887 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.898 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.900 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.909 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.920 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.922 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.931 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.933 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.942 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.944 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.954 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.965 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.976 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.978 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.987 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.989 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:19.999 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.000 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.010 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.021 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.022 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.032 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.034 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.043 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.054 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.065 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.076 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.078 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.087 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.089 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.099 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.110 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.111 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.122 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.133 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.144 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.155 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.157 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.166 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.168 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.177 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.188 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.199 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.210 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.221 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.222 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.232 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.234 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.244 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.254 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.256 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.266 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.277 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.278 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.288 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.290 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.300 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.311 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.311 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.322 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:20.324 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason" 2021-05-26T16:34:20.325 INFO:teuthology.task.ansible.out:: "Conditional result was False"} 2021-05-26T16:34:20.335 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.346 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.347 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.358 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.359 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.369 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.371 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.380 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.391 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.402 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.402 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.424 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.425 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.435 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.446 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.484 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:20 +0000 (0:00:01.852) 0:01:19.013 ********* 2021-05-26T16:34:20.532 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:20.535 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-05-26T16:34:20.709 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:20.731 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:20 +0000 (0:00:00.246) 0:01:19.259 ********* 2021-05-26T16:34:20.747 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:20.749 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-05-26T16:34:20.750 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-05-26T16:34:20.956 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-05-26T16:34:21.008 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:21.010 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-05-26T16:34:21.196 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-05-26T16:34:21.217 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:21.218 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-05-26T16:34:21.383 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:21.385 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-05-26T16:34:21.438 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:21.440 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-05-26T16:34:21.574 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:21.576 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-05-26T16:34:21.648 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-05-26T16:34:21.764 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:21.765 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-05-26T16:34:21.858 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:21.859 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-05-26T16:34:21.952 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:21.954 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-05-26T16:34:22.077 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:22.079 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-05-26T16:34:22.140 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:22.142 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-05-26T16:34:22.297 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-05-26T16:34:22.299 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-05-26T16:34:22.499 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:22.501 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-05-26T16:34:22.524 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:22 +0000 (0:00:01.793) 0:01:21.052 ********* 2021-05-26T16:34:22.531 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-05-26T16:34:22.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:22.610 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.620 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.622 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.631 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.642 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.644 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.654 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.655 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.706 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:22.708 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-05-26T16:34:22.865 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:22.867 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-05-26T16:34:22.876 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.887 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:22.889 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi137.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-05-26T16:34:23.076 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-05-26T16:34:23.097 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:23.099 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-05-26T16:34:23.265 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:23.266 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-05-26T16:34:23.297 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:23.299 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-05-26T16:34:23.308 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.319 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.321 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.330 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.332 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.341 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.343 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.353 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.364 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.366 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.375 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.377 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.386 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.388 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.398 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.399 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.409 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.420 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.422 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.431 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.433 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.442 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.453 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.455 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi137.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.466 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.467 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.478 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.488 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.490 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.500 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.500 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.511 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.522 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.533 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.534 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.544 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.546 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.556 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.567 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.578 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.589 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.590 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.600 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.611 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.622 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.633 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.644 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.645 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi137.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.656 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.658 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.668 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.669 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.679 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.681 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.690 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.701 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.702 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.712 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.714 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.723 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.725 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.735 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.746 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.748 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.757 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.759 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.769 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.770 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.780 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.781 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.792 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.803 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.804 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.814 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.816 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.826 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.828 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi137.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-05-26T16:34:23.838 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-05-26T16:34:23.840 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.849 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.851 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.861 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.863 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.872 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.874 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.883 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.885 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.895 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.906 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.907 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.917 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.919 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.928 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.939 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.941 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.951 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.952 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.962 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.964 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.973 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.975 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.996 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:23.998 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.009 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.019 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.020 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:24.022 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.033 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.035 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.044 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.046 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.056 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.067 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.069 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.079 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.081 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.090 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.092 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.102 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.113 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.114 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.124 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.126 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.135 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.147 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.149 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.159 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.171 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.173 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.211 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:24 +0000 (0:00:01.687) 0:01:22.740 ********* 2021-05-26T16:34:24.218 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:24.220 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-05-26T16:34:24.283 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-05-26T16:34:24.285 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:24.304 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:24 +0000 (0:00:00.092) 0:01:22.832 ********* 2021-05-26T16:34:24.403 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:24.405 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-05-26T16:34:24.581 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-05-26T16:34:24.592 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-05-26T16:34:24.772 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-05-26T16:34:24.783 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-05-26T16:34:24.960 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-05-26T16:34:24.981 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-05-26T16:34:25.148 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-05-26T16:34:25.169 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-05-26T16:34:25.335 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-05-26T16:34:25.368 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-05-26T16:34:25.534 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-05-26T16:34:25.577 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-05-26T16:34:25.722 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-05-26T16:34:25.775 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-05-26T16:34:25.910 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-05-26T16:34:25.973 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-05-26T16:34:26.099 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-05-26T16:34:26.173 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-05-26T16:34:26.287 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-05-26T16:34:26.371 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-05-26T16:34:26.476 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-05-26T16:34:26.570 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-05-26T16:34:26.664 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-05-26T16:34:26.769 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-05-26T16:34:26.852 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-05-26T16:34:26.967 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-05-26T16:34:27.040 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-05-26T16:34:27.165 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-05-26T16:34:27.228 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-05-26T16:34:27.374 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-05-26T16:34:27.416 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-05-26T16:34:27.572 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-05-26T16:34:27.604 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-05-26T16:34:27.760 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-05-26T16:34:27.803 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-05-26T16:34:27.961 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-05-26T16:34:27.983 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-05-26T16:34:28.161 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-05-26T16:34:28.359 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-05-26T16:34:28.557 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-05-26T16:34:28.755 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-05-26T16:34:28.953 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-05-26T16:34:29.150 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-05-26T16:34:29.352 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-05-26T16:34:29.552 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-05-26T16:34:29.750 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-05-26T16:34:29.761 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-05-26T16:34:29.949 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-05-26T16:34:29.960 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-05-26T16:34:30.149 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-05-26T16:34:30.150 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-05-26T16:34:30.338 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-05-26T16:34:30.340 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-05-26T16:34:30.526 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-05-26T16:34:30.538 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-05-26T16:34:30.725 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-05-26T16:34:30.737 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-05-26T16:34:30.904 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-05-26T16:34:30.936 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-05-26T16:34:31.093 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-05-26T16:34:31.136 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-05-26T16:34:31.281 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-05-26T16:34:31.334 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-05-26T16:34:31.469 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-05-26T16:34:31.532 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-05-26T16:34:31.658 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-05-26T16:34:31.711 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:31 +0000 (0:00:07.406) 0:01:30.239 ********* 2021-05-26T16:34:31.729 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-05-26T16:34:31.937 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-05-26T16:34:32.251 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-05-26T16:34:32.252 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "checksum": "09f175eb7e6987d91e85c0190334c5a90418c4b8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "0e849644a39b9e2ba2a1abd6a16b889e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622046871.8168075-7696-63935535600215/source", "state": "file", "uid": 0} 2021-05-26T16:34:32.273 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:32 +0000 (0:00:00.562) 0:01:30.802 ********* 2021-05-26T16:34:32.342 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-05-26T16:34:32.344 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => { "msg": "Host smithi137.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-05-26T16:34:32.371 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:32 +0000 (0:00:00.097) 0:01:30.899 ********* 2021-05-26T16:34:32.440 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-05-26T16:34:32.441 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-05-26T16:34:32.472 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:32 +0000 (0:00:00.101) 0:01:31.001 ********* 2021-05-26T16:34:32.541 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-05-26T16:34:32.542 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:32.563 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:32 +0000 (0:00:00.090) 0:01:31.091 ********* 2021-05-26T16:34:33.160 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-05-26T16:34:33.162 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.375262", "end": "2021-05-26 16:34:33.144016", "rc": 0, "start": "2021-05-26 16:34:32.768754", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-05-26T16:34:33.183 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.620) 0:01:31.711 ********* 2021-05-26T16:34:33.251 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:33.274 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.091) 0:01:31.803 ********* 2021-05-26T16:34:33.363 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-05-26T16:34:33.365 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:33.385 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.111) 0:01:31.914 ********* 2021-05-26T16:34:33.464 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:33.487 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.101) 0:01:32.015 ********* 2021-05-26T16:34:33.493 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:33.495 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-05-26T16:34:33.569 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-05-26T16:34:33.571 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:33.592 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.105) 0:01:32.121 ********* 2021-05-26T16:34:33.693 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:33.695 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:33.720 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.127) 0:01:32.248 ********* 2021-05-26T16:34:33.788 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-05-26T16:34:33.789 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:33.810 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.090) 0:01:32.338 ********* 2021-05-26T16:34:33.888 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-05-26T16:34:33.890 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi137.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:33.912 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.101) 0:01:32.440 ********* 2021-05-26T16:34:33.918 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:33.920 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-05-26T16:34:33.982 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-05-26T16:34:33.984 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.004 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:33 +0000 (0:00:00.092) 0:01:32.533 ********* 2021-05-26T16:34:34.088 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-05-26T16:34:34.089 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.090 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi003.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-05-26T16:34:34.112 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.107) 0:01:32.641 ********* 2021-05-26T16:34:34.181 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-05-26T16:34:34.183 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.203 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.090) 0:01:32.731 ********* 2021-05-26T16:34:34.271 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-05-26T16:34:34.273 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:34.296 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.093) 0:01:32.825 ********* 2021-05-26T16:34:34.302 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:34.304 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-05-26T16:34:34.367 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.389 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.092) 0:01:32.917 ********* 2021-05-26T16:34:34.457 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-05-26T16:34:34.459 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:34.480 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.090) 0:01:33.008 ********* 2021-05-26T16:34:34.497 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi003.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-05-26T16:34:34.560 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-05-26T16:34:34.562 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.582 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.102) 0:01:33.110 ********* 2021-05-26T16:34:34.671 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-05-26T16:34:34.673 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.695 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.112) 0:01:33.223 ********* 2021-05-26T16:34:34.701 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:34.702 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-05-26T16:34:34.766 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.789 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.094) 0:01:33.317 ********* 2021-05-26T16:34:34.867 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-05-26T16:34:34.869 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:34.889 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.100) 0:01:33.418 ********* 2021-05-26T16:34:34.896 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:34.897 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-05-26T16:34:34.960 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi137.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:34.985 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:34 +0000 (0:00:00.096) 0:01:33.514 ********* 2021-05-26T16:34:35.053 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-05-26T16:34:35.055 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.075 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.089) 0:01:33.603 ********* 2021-05-26T16:34:35.091 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:35.092 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-05-26T16:34:35.145 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.166 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.091) 0:01:33.694 ********* 2021-05-26T16:34:35.244 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-05-26T16:34:35.246 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.267 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.100) 0:01:33.795 ********* 2021-05-26T16:34:35.283 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:35.285 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-05-26T16:34:35.337 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.359 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.092) 0:01:33.888 ********* 2021-05-26T16:34:35.428 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-05-26T16:34:35.429 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.449 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.089) 0:01:33.978 ********* 2021-05-26T16:34:35.487 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-05-26T16:34:35.489 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-05-26T16:34:35.529 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.079) 0:01:34.057 ********* 2021-05-26T16:34:35.536 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-05-26T16:34:35.538 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.562 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.032) 0:01:34.090 ********* 2021-05-26T16:34:35.630 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-05-26T16:34:35.632 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:35.653 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.091) 0:01:34.181 ********* 2021-05-26T16:34:35.732 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-05-26T16:34:35.734 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.754 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.101) 0:01:34.282 ********* 2021-05-26T16:34:35.823 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-05-26T16:34:35.825 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:35.848 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:35 +0000 (0:00:00.094) 0:01:34.377 ********* 2021-05-26T16:34:36.098 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-05-26T16:34:36.099 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "checksum": "09f175eb7e6987d91e85c0190334c5a90418c4b8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "0e849644a39b9e2ba2a1abd6a16b889e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622046875.6249807-7948-156031414340365/source", "state": "file", "uid": 0} 2021-05-26T16:34:36.121 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:36 +0000 (0:00:00.272) 0:01:34.650 ********* 2021-05-26T16:34:36.129 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-05-26T16:34:36.129 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:34:36.155 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:36 +0000 (0:00:00.033) 0:01:34.683 ********* 2021-05-26T16:34:36.185 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-05-26T16:34:36.186 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => { "msg": "Host smithi003.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-05-26T16:34:36.220 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:36 +0000 (0:00:00.064) 0:01:34.748 ********* 2021-05-26T16:34:36.303 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-05-26T16:34:36.305 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-05-26T16:34:36.326 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:36 +0000 (0:00:00.106) 0:01:34.855 ********* 2021-05-26T16:34:36.395 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-05-26T16:34:36.398 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:36.417 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:36 +0000 (0:00:00.090) 0:01:34.946 ********* 2021-05-26T16:34:36.819 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-05-26T16:34:36.820 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-05-26T16:34:37.058 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-05-26T16:34:37.060 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.390058", "end": "2021-05-26 16:34:37.033972", "rc": 0, "start": "2021-05-26 16:34:36.643914", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-05-26T16:34:37.080 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.663) 0:01:35.609 ********* 2021-05-26T16:34:37.150 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-05-26T16:34:37.152 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.172 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.091) 0:01:35.701 ********* 2021-05-26T16:34:37.252 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-05-26T16:34:37.254 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-05-26T16:34:37.255 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.276 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.103) 0:01:35.805 ********* 2021-05-26T16:34:37.297 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.020) 0:01:35.826 ********* 2021-05-26T16:34:37.358 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-05-26T16:34:37.359 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.382 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.084) 0:01:35.910 ********* 2021-05-26T16:34:37.452 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-05-26T16:34:37.454 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.474 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.091) 0:01:36.002 ********* 2021-05-26T16:34:37.542 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-05-26T16:34:37.544 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.568 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.094) 0:01:36.096 ********* 2021-05-26T16:34:37.636 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-05-26T16:34:37.638 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.659 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.090) 0:01:36.187 ********* 2021-05-26T16:34:37.727 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-05-26T16:34:37.729 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:37.738 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:37.760 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.101) 0:01:36.288 ********* 2021-05-26T16:34:37.819 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-05-26T16:34:37.821 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-05-26T16:34:37.831 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-05-26T16:34:37.832 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.855 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.095) 0:01:36.383 ********* 2021-05-26T16:34:37.924 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-05-26T16:34:37.926 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:37.946 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:37 +0000 (0:00:00.091) 0:01:36.474 ********* 2021-05-26T16:34:38.025 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-05-26T16:34:38.027 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.047 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.101) 0:01:36.576 ********* 2021-05-26T16:34:38.150 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-05-26T16:34:38.152 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:38.173 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.125) 0:01:36.701 ********* 2021-05-26T16:34:38.253 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-05-26T16:34:38.255 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.276 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.102) 0:01:36.804 ********* 2021-05-26T16:34:38.283 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-05-26T16:34:38.284 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-05-26T16:34:38.310 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.034) 0:01:36.838 ********* 2021-05-26T16:34:38.368 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-05-26T16:34:38.370 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:38.394 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.083) 0:01:36.922 ********* 2021-05-26T16:34:38.401 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-05-26T16:34:38.402 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.425 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.031) 0:01:36.953 ********* 2021-05-26T16:34:38.465 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.491 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.065) 0:01:37.019 ********* 2021-05-26T16:34:38.499 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-05-26T16:34:38.501 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.523 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.031) 0:01:37.051 ********* 2021-05-26T16:34:38.570 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-05-26T16:34:38.572 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.599 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.076) 0:01:37.127 ********* 2021-05-26T16:34:38.607 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-05-26T16:34:38.609 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.631 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.032) 0:01:37.160 ********* 2021-05-26T16:34:38.680 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.703 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.071) 0:01:37.231 ********* 2021-05-26T16:34:38.710 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-05-26T16:34:38.712 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.734 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.031) 0:01:37.262 ********* 2021-05-26T16:34:38.783 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-05-26T16:34:38.784 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.809 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.075) 0:01:37.338 ********* 2021-05-26T16:34:38.827 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-05-26T16:34:38.829 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.853 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.043) 0:01:37.381 ********* 2021-05-26T16:34:38.870 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-05-26T16:34:38.871 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:38.894 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.040) 0:01:37.422 ********* 2021-05-26T16:34:38.922 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-05-26T16:34:38.924 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.946 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.052) 0:01:37.474 ********* 2021-05-26T16:34:38.973 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-05-26T16:34:38.975 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:38.998 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:38 +0000 (0:00:00.052) 0:01:37.526 ********* 2021-05-26T16:34:39.015 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-05-26T16:34:39.017 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.039 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.041) 0:01:37.568 ********* 2021-05-26T16:34:39.066 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-05-26T16:34:39.068 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.091 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.052) 0:01:37.620 ********* 2021-05-26T16:34:39.109 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.133 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.041) 0:01:37.661 ********* 2021-05-26T16:34:39.160 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-05-26T16:34:39.162 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.183 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.050) 0:01:37.712 ********* 2021-05-26T16:34:39.201 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-05-26T16:34:39.203 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.227 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.044) 0:01:37.756 ********* 2021-05-26T16:34:39.256 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-05-26T16:34:39.258 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.281 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.053) 0:01:37.810 ********* 2021-05-26T16:34:39.300 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.325 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.043) 0:01:37.853 ********* 2021-05-26T16:34:39.353 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-05-26T16:34:39.354 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.380 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.054) 0:01:37.908 ********* 2021-05-26T16:34:39.450 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-05-26T16:34:39.452 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.473 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.092) 0:01:38.001 ********* 2021-05-26T16:34:39.542 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-05-26T16:34:39.544 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-05-26T16:34:39.565 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.091) 0:01:38.093 ********* 2021-05-26T16:34:39.644 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.666 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.101) 0:01:38.195 ********* 2021-05-26T16:34:39.735 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-05-26T16:34:39.737 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:39.758 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:39 +0000 (0:00:00.092) 0:01:38.287 ********* 2021-05-26T16:34:40.040 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-05-26T16:34:40.042 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:34:40.062 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:40 +0000 (0:00:00.303) 0:01:38.591 ********* 2021-05-26T16:34:40.526 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-05-26T16:34:40.528 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.005124", "end": "2021-05-26 16:34:40.500336", "rc": 0, "start": "2021-05-26 16:34:39.495212", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:34:40.549 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:40 +0000 (0:00:00.486) 0:01:39.077 ********* 2021-05-26T16:34:40.610 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-05-26T16:34:40.611 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-05-26T16:34:41.061 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-05-26T16:34:41.086 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:41 +0000 (0:00:00.536) 0:01:39.614 ********* 2021-05-26T16:34:41.606 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-05-26T16:34:41.608 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-05-26T16:34:42.058 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-05-26T16:34:42.085 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.999) 0:01:40.613 ********* 2021-05-26T16:34:42.185 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-05-26T16:34:42.186 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.207 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.122) 0:01:40.735 ********* 2021-05-26T16:34:42.275 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-05-26T16:34:42.277 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.297 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.090) 0:01:40.826 ********* 2021-05-26T16:34:42.366 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-05-26T16:34:42.368 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.390 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.092) 0:01:40.918 ********* 2021-05-26T16:34:42.469 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.491 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.101) 0:01:41.020 ********* 2021-05-26T16:34:42.570 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-05-26T16:34:42.572 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.582 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.607 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.115) 0:01:41.135 ********* 2021-05-26T16:34:42.675 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-05-26T16:34:42.677 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.698 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.091) 0:01:41.226 ********* 2021-05-26T16:34:42.767 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-05-26T16:34:42.769 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.789 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.091) 0:01:41.318 ********* 2021-05-26T16:34:42.858 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-05-26T16:34:42.860 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.880 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.091) 0:01:41.409 ********* 2021-05-26T16:34:42.949 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-05-26T16:34:42.951 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:42.971 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:42 +0000 (0:00:00.090) 0:01:41.499 ********* 2021-05-26T16:34:43.039 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-05-26T16:34:43.041 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:43.061 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:43 +0000 (0:00:00.089) 0:01:41.589 ********* 2021-05-26T16:34:43.524 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-05-26T16:34:43.526 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.263555", "end": "2021-05-26 16:34:43.500359", "rc": 0, "start": "2021-05-26 16:34:43.236804", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:34:43.547 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:43 +0000 (0:00:00.485) 0:01:42.075 ********* 2021-05-26T16:34:44.935 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-05-26T16:34:44.936 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:34:44.958 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:44 +0000 (0:00:01.411) 0:01:43.487 ********* 2021-05-26T16:34:45.028 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-05-26T16:34:45.030 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:45.052 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:45 +0000 (0:00:00.094) 0:01:43.581 ********* 2021-05-26T16:34:45.120 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-05-26T16:34:45.122 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:45.143 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:45 +0000 (0:00:00.090) 0:01:43.671 ********* 2021-05-26T16:34:45.211 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-05-26T16:34:45.213 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:45.233 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:45 +0000 (0:00:00.090) 0:01:43.762 ********* 2021-05-26T16:34:45.301 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-05-26T16:34:45.303 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:45.323 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:45 +0000 (0:00:00.089) 0:01:43.851 ********* 2021-05-26T16:34:45.807 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-05-26T16:34:45.809 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-05-26T16:34:45.829 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:45 +0000 (0:00:00.506) 0:01:44.358 ********* 2021-05-26T16:34:47.190 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-05-26T16:34:47.192 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:34:47.211 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:47 +0000 (0:00:01.382) 0:01:45.740 ********* 2021-05-26T16:34:47.561 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-05-26T16:34:47.562 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:34:47.584 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:47 +0000 (0:00:00.372) 0:01:46.113 ********* 2021-05-26T16:34:47.653 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-05-26T16:34:47.655 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:47.677 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:47 +0000 (0:00:00.092) 0:01:46.206 ********* 2021-05-26T16:34:47.725 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-05-26T16:34:47.727 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-05-26T16:34:47.747 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-05-26T16:34:47.749 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:47.772 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:47 +0000 (0:00:00.094) 0:01:46.300 ********* 2021-05-26T16:34:47.840 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-05-26T16:34:47.842 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:47.863 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:47 +0000 (0:00:00.090) 0:01:46.391 ********* 2021-05-26T16:34:47.933 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-05-26T16:34:47.934 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:47.955 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:47 +0000 (0:00:00.091) 0:01:46.483 ********* 2021-05-26T16:34:48.160 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-05-26T16:34:48.161 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-05-26T16:34:48.451 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-05-26T16:34:48.453 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-05-26T16:34:48.473 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:48 +0000 (0:00:00.518) 0:01:47.002 ********* 2021-05-26T16:34:48.574 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-05-26T16:34:48.576 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-05-26T16:34:48.600 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:48 +0000 (0:00:00.126) 0:01:47.128 ********* 2021-05-26T16:34:48.793 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-05-26T16:34:48.795 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:34:48.816 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:48 +0000 (0:00:00.216) 0:01:47.344 ********* 2021-05-26T16:34:49.310 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-05-26T16:34:49.312 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-05-26T16:34:49.726 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-05-26T16:34:49.914 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-05-26T16:34:49.915 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:34:49.937 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:49 +0000 (0:00:01.120) 0:01:48.465 ********* 2021-05-26T16:34:50.195 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** changed: [smithi137.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622046889.7463799-9332-209600122610635/source", "state": "file", "uid": 0} 2021-05-26T16:34:50.216 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:50 +0000 (0:00:00.279) 0:01:48.745 ********* 2021-05-26T16:34:50.297 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-05-26T16:34:50.298 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:50.319 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:50 +0000 (0:00:00.102) 0:01:48.847 ********* 2021-05-26T16:34:50.398 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-05-26T16:34:50.400 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-05-26T16:34:50.421 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:50 +0000 (0:00:00.101) 0:01:48.949 ********* 2021-05-26T16:34:50.469 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-05-26T16:34:50.471 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-05-26T16:34:50.648 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi137.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-05-26T16:34:50.669 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:50 +0000 (0:00:00.248) 0:01:49.198 ********* 2021-05-26T16:34:50.758 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-05-26T16:34:50.760 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:50.780 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:50.791 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:50.802 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:50.824 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:50 +0000 (0:00:00.155) 0:01:49.353 ********* 2021-05-26T16:34:50.913 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-05-26T16:34:50.915 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-05-26T16:34:51.372 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-05-26T16:34:51.397 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:51 +0000 (0:00:00.572) 0:01:49.925 ********* 2021-05-26T16:34:51.592 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-05-26T16:34:51.594 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:34:51.615 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:51 +0000 (0:00:00.218) 0:01:50.144 ********* 2021-05-26T16:34:52.114 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-05-26T16:34:52.116 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-05-26T16:34:52.544 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-05-26T16:34:53.033 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622046892.5679488-9584-248243949880301/source", "state": "file", "uid": 0} 2021-05-26T16:34:53.060 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:53 +0000 (0:00:01.445) 0:01:51.589 ********* 2021-05-26T16:34:53.140 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-05-26T16:34:53.141 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:53.162 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:53 +0000 (0:00:00.101) 0:01:51.690 ********* 2021-05-26T16:34:53.242 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-05-26T16:34:53.244 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-05-26T16:34:53.266 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:53 +0000 (0:00:00.103) 0:01:51.794 ********* 2021-05-26T16:34:53.503 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-05-26T16:34:53.525 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:53 +0000 (0:00:00.258) 0:01:52.053 ********* 2021-05-26T16:34:53.614 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-05-26T16:34:53.616 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:53.625 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:53.646 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:53.657 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:53.680 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:53 +0000 (0:00:00.154) 0:01:52.208 ********* 2021-05-26T16:34:56.405 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-05-26T16:34:56.407 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-plugins-2.3.3-5.el8.x86_64", "Installed: nrpe-4.0.3-6.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-5.el8.x86_64", "Installed: nagios-common-4.4.6-4.el8.x86_64", "Removed: nagios-common-4.4.5-1.el8.x86_64", "Removed: nagios-plugins-2.3.3-4.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.3-1.el8.x86_64"]} 2021-05-26T16:34:56.430 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:56 +0000 (0:00:02.750) 0:01:54.959 ********* 2021-05-26T16:34:56.510 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-05-26T16:34:56.512 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:56.532 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:56 +0000 (0:00:00.101) 0:01:55.061 ********* 2021-05-26T16:34:57.037 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-05-26T16:34:57.039 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-05-26T16:34:57.059 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:57 +0000 (0:00:00.527) 0:01:55.588 ********* 2021-05-26T16:34:57.532 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-05-26T16:34:57.533 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-05-26T16:34:57.554 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:57 +0000 (0:00:00.494) 0:01:56.083 ********* 2021-05-26T16:34:57.633 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-05-26T16:34:57.635 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:57.645 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-05-26T16:34:57.668 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:57 +0000 (0:00:00.114) 0:01:56.197 ********* 2021-05-26T16:34:57.904 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-05-26T16:34:57.906 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:34:57.927 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:57 +0000 (0:00:00.258) 0:01:56.455 ********* 2021-05-26T16:34:58.203 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-05-26T16:34:58.205 INFO:teuthology.task.ansible.out:fatal: [smithi137.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-05-26T16:34:58.225 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:58 +0000 (0:00:00.297) 0:01:56.753 ********* 2021-05-26T16:34:58.304 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-05-26T16:34:58.305 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:58.325 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:58 +0000 (0:00:00.100) 0:01:56.854 ********* 2021-05-26T16:34:58.818 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-05-26T16:34:58.820 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-05-26T16:34:58.841 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:58 +0000 (0:00:00.515) 0:01:57.369 ********* 2021-05-26T16:34:59.580 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-05-26T16:34:59.581 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-05-26 16:34:54 UTC", "ActiveEnterTimestampMonotonic": "139122663", "ActiveExitTimestamp": "Wed 2021-05-26 16:34:54 UTC", "ActiveExitTimestampMonotonic": "139096529", "ActiveState": "active", "After": "basic.target system.slice nss-lookup.target systemd-tmpfiles-setup.service systemd-journald.socket -.mount network-online.target time-sync.target tmp.mount var-run.mount local-fs.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-05-26 16:34:54 UTC", "AssertTimestampMonotonic": "139121938", "Before": "multi-user.target plymouth-quit.service getty@tty1.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-05-26 16:34:54 UTC", "Co 2021-05-26T16:34:59.583 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "139121938", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "15303", "ExecMainStartTimestamp": "Wed 2021-05-26 16:34:54 UTC", "ExecMainStartTimestampMonotonic": "139122642", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "thawing", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-05-26 16:34:54 UTC", "InactiveEnterTimestampMonotonic": "139121372", "InactiveExitTimestamp": "Wed 2021-05-26 16:34:54 UTC", 2021-05-26T16:34:59.584 INFO:teuthology.task.ansible.out:"InactiveExitTimestampMonotonic": "139122663", "InvocationID": "81565624fd454991aa785e2dafdcd298", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127253", "LimitNPROCSoft": "127253", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127253", "LimitSIGPENDINGSoft": "127253", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "15303", "MemoryAccounting": "yes", "MemoryCurrent": "880640", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateT 2021-05-26T16:34:59.586 INFO:teuthology.task.ansible.out:mp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-05-26 16:34:54 UTC", "StateChangeTimestampMonotonic": "139122663", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203604", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-05-26 16:34:54 UTC", "WatchdogTimestampMonotonic": "139122662", "WatchdogUSec": "0"}} TASK [common 2021-05-26T16:34:59.587 INFO:teuthology.task.ansible.out:: Install nrpe package and dependencies (RHEL/CentOS)] ************ changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-plugins-2.3.3-5.el8.x86_64", "Installed: nrpe-4.0.3-6.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-5.el8.x86_64", "Installed: nagios-common-4.4.6-4.el8.x86_64", "Removed: nagios-common-4.4.5-1.el8.x86_64", "Removed: nagios-plugins-2.3.3-4.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.3-1.el8.x86_64"]} 2021-05-26T16:34:59.606 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:59 +0000 (0:00:00.765) 0:01:58.135 ********* 2021-05-26T16:34:59.627 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:59 +0000 (0:00:00.020) 0:01:58.155 ********* 2021-05-26T16:34:59.676 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:34:59.699 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:59 +0000 (0:00:00.071) 0:01:58.227 ********* 2021-05-26T16:34:59.855 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-05-26T16:34:59.857 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001844", "end": "2021-05-26 16:34:59.833747", "rc": 0, "start": "2021-05-26 16:34:59.831903", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-05-26T16:34:59.878 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:34:59 +0000 (0:00:00.179) 0:01:58.407 ********* 2021-05-26T16:35:00.220 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-05-26T16:35:00.222 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-05-26T16:35:00.244 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:00 +0000 (0:00:00.365) 0:01:58.772 ********* 2021-05-26T16:35:00.759 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-05-26T16:35:00.761 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-05-26T16:35:00.782 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:00 +0000 (0:00:00.538) 0:01:59.310 ********* 2021-05-26T16:35:00.871 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-05-26T16:35:00.873 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-05-26T16:35:00.882 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-05-26T16:35:00.905 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:00 +0000 (0:00:00.122) 0:01:59.433 ********* 2021-05-26T16:35:01.150 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-05-26T16:35:01.152 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:35:01.172 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:01 +0000 (0:00:00.267) 0:01:59.701 ********* 2021-05-26T16:35:01.252 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-05-26T16:35:01.255 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:35:01.277 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:01 +0000 (0:00:00.103) 0:01:59.805 ********* 2021-05-26T16:35:01.461 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-05-26T16:35:01.463 INFO:teuthology.task.ansible.out:fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-05-26T16:35:01.486 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:01 +0000 (0:00:00.210) 0:02:00.015 ********* 2021-05-26T16:35:01.556 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-05-26T16:35:01.557 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:35:01.577 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:01 +0000 (0:00:00.090) 0:02:00.106 ********* 2021-05-26T16:35:02.090 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-05-26T16:35:02.092 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-05-26T16:35:02.117 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:02 +0000 (0:00:00.540) 0:02:00.646 ********* 2021-05-26T16:35:02.469 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-05-26T16:35:02.471 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-05-26 16:34:57 UTC", "ActiveEnterTimestampMonotonic": "155189796", "ActiveExitTimestamp": "Wed 2021-05-26 16:34:57 UTC", "ActiveExitTimestampMonotonic": "155163047", "ActiveState": "active", "After": "basic.target system.slice systemd-journald.socket nss-lookup.target var-run.mount time-sync.target network-online.target tmp.mount local-fs.target systemd-tmpfiles-setup.service sysinit.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-05-26 16:34:57 UTC", "AssertTimestampMonotonic": "155189033", "Before": "plymouth-quit.service shutdown.target multi-user.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-05-26 16:34:57 UTC", "Co 2021-05-26T16:35:02.473 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "155189032", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "15344", "ExecMainStartTimestamp": "Wed 2021-05-26 16:34:57 UTC", "ExecMainStartTimestampMonotonic": "155189775", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "thawing", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-05-26 16:34:57 UTC", "InactiveEnterTimestampMonotonic": "155188344", "InactiveExitTimestamp": "Wed 2021-05-26 16:34:57 UTC", 2021-05-26T16:35:02.475 INFO:teuthology.task.ansible.out:"InactiveExitTimestampMonotonic": "155189796", "InvocationID": "266d6a8e604741f3a08dceee2913c425", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127277", "LimitNPROCSoft": "127277", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127277", "LimitSIGPENDINGSoft": "127277", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "15344", "MemoryAccounting": "yes", "MemoryCurrent": "872448", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateT 2021-05-26T16:35:02.476 INFO:teuthology.task.ansible.out:mp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-05-26 16:34:57 UTC", "StateChangeTimestampMonotonic": "155189796", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203643", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-05-26 16:34:57 UTC", "WatchdogTimestampMonotonic": "155189795", "WatchdogUSec": "0"}} 2021-05-26T16:35:02.492 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:02 +0000 (0:00:00.374) 0:02:01.021 ********* 2021-05-26T16:35:02.727 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-05-26T16:35:02.729 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001795", "end": "2021-05-26 16:35:02.707420", "rc": 0, "start": "2021-05-26 16:35:02.705625", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-05-26T16:35:02.750 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:02 +0000 (0:00:00.257) 0:02:01.278 ********* 2021-05-26T16:35:04.180 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-05-26T16:35:04.182 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:35:04.202 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:04 +0000 (0:00:01.452) 0:02:02.731 ********* 2021-05-26T16:35:39.752 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-05-26T16:35:39.754 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-3.14.3-54.el8_3.4.noarch", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.4.noarch", "Removed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch"]} 2021-05-26T16:35:39.776 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:39 +0000 (0:00:35.573) 0:02:38.304 ********* 2021-05-26T16:35:40.555 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-05-26T16:35:40.557 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-05-26T16:35:40.579 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:40 +0000 (0:00:00.803) 0:02:39.107 ********* 2021-05-26T16:35:44.242 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-05-26T16:35:44.244 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-3.14.3-54.el8_3.4.noarch", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.4.noarch", "Removed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch"]} 2021-05-26T16:35:44.267 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:44 +0000 (0:00:03.687) 0:02:42.795 ********* 2021-05-26T16:35:44.783 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-05-26T16:35:44.805 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:44 +0000 (0:00:00.538) 0:02:43.334 ********* 2021-05-26T16:35:57.218 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-05-26T16:35:57.220 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.406840", "end": "2021-05-26 16:35:57.194998", "failed_when_result": false, "rc": 0, "start": "2021-05-26 16:35:40.788158", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-05-26T16:35:57.241 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:57 +0000 (0:00:12.435) 0:02:55.769 ********* 2021-05-26T16:35:57.724 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-05-26T16:35:57.726 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-05-26T16:35:57.747 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:57 +0000 (0:00:00.506) 0:02:56.276 ********* 2021-05-26T16:35:57.991 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016599", "end": "2021-05-26 16:35:57.968522", "rc": 0, "start": "2021-05-26 16:35:57.951923", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:35:58.014 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:58 +0000 (0:00:00.266) 0:02:56.542 ********* 2021-05-26T16:35:58.238 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-05-26T16:35:58.240 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.006306", "end": "2021-05-26 16:35:58.223284", "rc": 0, "start": "2021-05-26 16:35:58.216978", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:35:58.261 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:35:58 +0000 (0:00:00.247) 0:02:56.789 ********* 2021-05-26T16:36:01.928 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-05-26T16:36:01.930 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.892343", "end": "2021-05-26 16:36:01.910276", "failed_when_result": false, "rc": 0, "start": "2021-05-26 16:35:45.017933", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-05-26T16:36:01.951 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:01 +0000 (0:00:03.690) 0:03:00.479 ********* 2021-05-26T16:36:02.476 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-05-26T16:36:02.478 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-05-26T16:36:02.498 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:02 +0000 (0:00:00.547) 0:03:01.027 ********* 2021-05-26T16:36:02.752 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-05-26T16:36:02.754 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.018974", "end": "2021-05-26 16:36:02.730847", "rc": 0, "start": "2021-05-26 16:36:02.711873", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:36:02.778 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:02 +0000 (0:00:00.279) 0:03:01.306 ********* 2021-05-26T16:36:03.013 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-05-26T16:36:03.014 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010691", "end": "2021-05-26 16:36:02.996752", "rc": 0, "start": "2021-05-26 16:36:02.986061", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:36:03.035 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:03 +0000 (0:00:00.256) 0:03:01.563 ********* 2021-05-26T16:36:14.828 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-05-26T16:36:14.830 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.338881", "end": "2021-05-26 16:36:14.802988", "rc": 0, "start": "2021-05-26 16:35:58.464107", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:36:14.851 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:14 +0000 (0:00:11.816) 0:03:13.380 ********* 2021-05-26T16:36:15.097 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-05-26T16:36:15.099 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-05-26T16:36:15.120 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:15 +0000 (0:00:00.268) 0:03:13.649 ********* 2021-05-26T16:36:15.188 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-05-26T16:36:15.190 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-05-26T16:36:15.211 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:15 +0000 (0:00:00.090) 0:03:13.739 ********* 2021-05-26T16:36:15.289 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-05-26T16:36:15.291 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-05-26T16:36:15.311 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:15 +0000 (0:00:00.100) 0:03:13.839 ********* 2021-05-26T16:36:15.390 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-05-26T16:36:15.392 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-05-26T16:36:15.413 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:15 +0000 (0:00:00.102) 0:03:13.942 ********* 2021-05-26T16:36:15.492 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-05-26T16:36:15.494 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-05-26T16:36:15.515 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:15 +0000 (0:00:00.101) 0:03:14.043 ********* 2021-05-26T16:36:15.697 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-05-26T16:36:15.698 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-05-26T16:36:15.719 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:15 +0000 (0:00:00.203) 0:03:14.247 ********* 2021-05-26T16:36:15.952 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-05-26T16:36:15.954 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-05-26T16:36:15.974 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:15 +0000 (0:00:00.255) 0:03:14.502 ********* 2021-05-26T16:36:16.043 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:16.064 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:16 +0000 (0:00:00.090) 0:03:14.593 ********* 2021-05-26T16:36:16.133 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-05-26T16:36:16.135 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:16.155 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:16 +0000 (0:00:00.090) 0:03:14.683 ********* 2021-05-26T16:36:16.412 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-05-26T16:36:16.414 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-05-26T16:36:16.437 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:16 +0000 (0:00:00.282) 0:03:14.965 ********* 2021-05-26T16:36:16.989 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-05-26T16:36:16.991 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-05-26T16:36:17.011 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:17 +0000 (0:00:00.574) 0:03:15.540 ********* 2021-05-26T16:36:17.081 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-05-26T16:36:17.083 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi137"}, "changed": false} 2021-05-26T16:36:17.114 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:17 +0000 (0:00:00.103) 0:03:15.643 ********* 2021-05-26T16:36:18.191 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-05-26T16:36:18.193 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi137.front.sepia.ceph.com", "ansible_hostname": "smithi137", "ansible_nodename": "smithi137"}, "changed": true, "name": "smithi137"} 2021-05-26T16:36:18.213 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:18 +0000 (0:00:01.098) 0:03:16.742 ********* 2021-05-26T16:36:18.699 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-05-26T16:36:18.700 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-05-26T16:36:18.722 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:18 +0000 (0:00:00.508) 0:03:17.250 ********* 2021-05-26T16:36:19.218 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-05-26T16:36:19.219 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-05-26T16:36:19.241 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:19 +0000 (0:00:00.518) 0:03:17.769 ********* 2021-05-26T16:36:19.847 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi137.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-05-26T16:36:19.869 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:19 +0000 (0:00:00.628) 0:03:18.397 ********* 2021-05-26T16:36:20.383 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-05-26T16:36:20.385 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-05-26T16:36:20.406 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:20 +0000 (0:00:00.537) 0:03:18.934 ********* 2021-05-26T16:36:20.444 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-05-26T16:36:20.445 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:17.145624", "end": "2021-05-26 16:36:20.417003", "rc": 0, "start": "2021-05-26 16:36:03.271379", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:36:20.468 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:20 +0000 (0:00:00.061) 0:03:18.996 ********* 2021-05-26T16:36:20.631 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-05-26T16:36:20.633 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-05-26T16:36:20.655 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:20 +0000 (0:00:00.187) 0:03:19.183 ********* 2021-05-26T16:36:20.703 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-05-26T16:36:20.705 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-05-26T16:36:20.727 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:20 +0000 (0:00:00.071) 0:03:19.255 ********* 2021-05-26T16:36:20.810 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-05-26T16:36:20.812 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-05-26T16:36:20.833 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:20 +0000 (0:00:00.106) 0:03:19.362 ********* 2021-05-26T16:36:20.882 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-05-26T16:36:20.884 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-05-26T16:36:20.905 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:20 +0000 (0:00:00.071) 0:03:19.434 ********* 2021-05-26T16:36:20.916 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-05-26T16:36:20.918 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-05-26T16:36:20.942 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:20 +0000 (0:00:00.036) 0:03:19.470 ********* 2021-05-26T16:36:21.021 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-05-26T16:36:21.023 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-05-26T16:36:21.046 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.103) 0:03:19.574 ********* 2021-05-26T16:36:21.126 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-05-26T16:36:21.128 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-05-26T16:36:21.150 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.104) 0:03:19.679 ********* 2021-05-26T16:36:21.169 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-05-26T16:36:21.170 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-05-26T16:36:21.192 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.041) 0:03:19.721 ********* 2021-05-26T16:36:21.344 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-05-26T16:36:21.346 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-05-26T16:36:21.381 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.188) 0:03:19.909 ********* 2021-05-26T16:36:21.620 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-05-26T16:36:21.622 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-05-26T16:36:21.642 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.261) 0:03:20.171 ********* 2021-05-26T16:36:21.680 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-05-26T16:36:21.682 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-05-26T16:36:21.705 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.062) 0:03:20.233 ********* 2021-05-26T16:36:21.712 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-05-26T16:36:21.714 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:21.738 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.032) 0:03:20.266 ********* 2021-05-26T16:36:21.808 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-05-26T16:36:21.809 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:21.830 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:21 +0000 (0:00:00.092) 0:03:20.359 ********* 2021-05-26T16:36:22.096 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-05-26T16:36:22.098 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-05-26T16:36:22.118 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:22 +0000 (0:00:00.288) 0:03:20.647 ********* 2021-05-26T16:36:22.199 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-05-26T16:36:22.201 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-05-26T16:36:22.225 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:22 +0000 (0:00:00.106) 0:03:20.754 ********* 2021-05-26T16:36:22.712 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-05-26T16:36:22.734 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:22 +0000 (0:00:00.508) 0:03:21.263 ********* 2021-05-26T16:36:22.804 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-05-26T16:36:22.805 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi003"}, "changed": false} 2021-05-26T16:36:22.827 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:22 +0000 (0:00:00.092) 0:03:21.355 ********* 2021-05-26T16:36:23.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-05-26T16:36:23.482 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi003.front.sepia.ceph.com", "ansible_hostname": "smithi003", "ansible_nodename": "smithi003"}, "changed": true, "name": "smithi003"} 2021-05-26T16:36:23.502 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:23 +0000 (0:00:00.675) 0:03:22.030 ********* 2021-05-26T16:36:24.001 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-05-26T16:36:24.002 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-05-26T16:36:24.022 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:24 +0000 (0:00:00.520) 0:03:22.550 ********* 2021-05-26T16:36:24.526 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-05-26T16:36:24.527 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-05-26T16:36:24.548 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:24 +0000 (0:00:00.526) 0:03:23.077 ********* 2021-05-26T16:36:24.712 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-05-26T16:36:24.714 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.244900", "end": "2021-05-26 16:36:24.687333", "rc": 0, "start": "2021-05-26 16:36:22.442433", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:36:24.736 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:24 +0000 (0:00:00.187) 0:03:23.264 ********* 2021-05-26T16:36:24.810 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-05-26T16:36:24.812 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:24.833 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:24 +0000 (0:00:00.097) 0:03:23.361 ********* 2021-05-26T16:36:24.902 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:24.924 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:24 +0000 (0:00:00.090) 0:03:23.452 ********* 2021-05-26T16:36:25.172 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-05-26T16:36:25.174 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-05-26T16:36:25.195 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:25 +0000 (0:00:00.270) 0:03:23.723 ********* 2021-05-26T16:36:25.441 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-05-26T16:36:25.443 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-05-26T16:36:25.704 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-05-26T16:36:25.706 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-05-26T16:36:25.726 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:25 +0000 (0:00:00.531) 0:03:24.254 ********* 2021-05-26T16:36:25.857 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-05-26T16:36:25.859 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-05-26T16:36:25.973 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-05-26T16:36:25.975 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-05-26T16:36:25.996 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:25 +0000 (0:00:00.269) 0:03:24.524 ********* 2021-05-26T16:36:26.231 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-05-26T16:36:26.253 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:26 +0000 (0:00:00.257) 0:03:24.782 ********* 2021-05-26T16:36:26.281 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-05-26T16:36:26.283 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-05-26T16:36:26.310 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:26 +0000 (0:00:00.056) 0:03:24.839 ********* 2021-05-26T16:36:26.518 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-05-26T16:36:26.520 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-05-26T16:36:26.542 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:26 +0000 (0:00:00.230) 0:03:25.070 ********* 2021-05-26T16:36:26.807 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-05-26T16:36:26.809 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-05-26T16:36:26.832 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:26 +0000 (0:00:00.290) 0:03:25.361 ********* 2021-05-26T16:36:27.049 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-05-26T16:36:27.051 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-05-26T16:36:27.073 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:27 +0000 (0:00:00.240) 0:03:25.601 ********* 2021-05-26T16:36:27.329 INFO:teuthology.task.ansible.out: 2021-05-26T16:36:27.331 INFO:teuthology.task.ansible.out:TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi137.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-05-26T16:36:27.592 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-05-26T16:36:27.593 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-05-26T16:36:27.614 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:27 +0000 (0:00:00.541) 0:03:26.143 ********* 2021-05-26T16:36:27.778 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-05-26T16:36:27.780 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-05-26T16:36:28.196 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-05-26T16:36:28.222 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.607) 0:03:26.751 ********* 2021-05-26T16:36:28.291 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-05-26T16:36:28.312 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.090) 0:03:26.841 ********* 2021-05-26T16:36:28.381 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-05-26T16:36:28.383 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:28.403 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.090) 0:03:26.932 ********* 2021-05-26T16:36:28.483 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-05-26T16:36:28.485 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:28.506 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.102) 0:03:27.034 ********* 2021-05-26T16:36:28.583 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-05-26T16:36:28.585 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:28.608 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.102) 0:03:27.137 ********* 2021-05-26T16:36:28.678 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:36:28.680 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-05-26T16:36:28.700 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.091) 0:03:27.228 ********* 2021-05-26T16:36:28.770 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-05-26T16:36:28.772 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:28.794 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.094) 0:03:27.323 ********* 2021-05-26T16:36:28.863 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-05-26T16:36:28.864 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:28.886 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:28 +0000 (0:00:00.091) 0:03:27.414 ********* 2021-05-26T16:36:29.123 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-05-26T16:36:29.125 INFO:teuthology.task.ansible.out:fatal: [smithi137.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007171", "end": "2021-05-26 16:36:29.104713", "msg": "non-zero return code", "rc": 1, "start": "2021-05-26 16:36:29.097542", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-05-26T16:36:29.146 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:29 +0000 (0:00:00.259) 0:03:27.674 ********* 2021-05-26T16:36:29.215 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-05-26T16:36:29.216 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:29.237 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:29 +0000 (0:00:00.090) 0:03:27.765 ********* 2021-05-26T16:36:30.202 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-05-26T16:36:30.204 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.356809", "end": "2021-05-26 16:36:30.180467", "rc": 0, "start": "2021-05-26 16:36:27.823658", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:36:30.227 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:30 +0000 (0:00:00.990) 0:03:28.755 ********* 2021-05-26T16:36:30.297 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-05-26T16:36:30.299 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:30.319 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:30 +0000 (0:00:00.092) 0:03:28.847 ********* 2021-05-26T16:36:30.387 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:36:30.389 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:30.410 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:30 +0000 (0:00:00.090) 0:03:28.938 ********* 2021-05-26T16:36:30.946 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-05-26T16:36:30.948 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-05-26T16:36:31.387 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-05-26T16:36:31.825 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-05-26T16:36:31.849 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:31 +0000 (0:00:01.438) 0:03:30.377 ********* 2021-05-26T16:36:32.187 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-05-26T16:36:32.189 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-05-26T16:36:32.210 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:32 +0000 (0:00:00.361) 0:03:30.738 ********* 2021-05-26T16:36:32.363 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-05-26T16:36:32.365 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-05-26T16:36:32.388 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:32 +0000 (0:00:00.177) 0:03:30.916 ********* 2021-05-26T16:36:32.914 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-05-26T16:36:32.916 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-05-26T16:36:33.353 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-05-26T16:36:33.792 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-05-26T16:36:33.817 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:33 +0000 (0:00:01.429) 0:03:32.346 ********* 2021-05-26T16:36:33.888 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-05-26T16:36:33.919 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:33 +0000 (0:00:00.101) 0:03:32.447 ********* 2021-05-26T16:36:33.988 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-05-26T16:36:33.989 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:34.012 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.093) 0:03:32.541 ********* 2021-05-26T16:36:34.082 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-05-26T16:36:34.083 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:34.093 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:34.115 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.103) 0:03:32.644 ********* 2021-05-26T16:36:34.184 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-05-26T16:36:34.186 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:34.206 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.090) 0:03:32.735 ********* 2021-05-26T16:36:34.285 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:36:34.287 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-05-26T16:36:34.307 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.100) 0:03:32.836 ********* 2021-05-26T16:36:34.376 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-05-26T16:36:34.377 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:34.399 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.092) 0:03:32.928 ********* 2021-05-26T16:36:34.479 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-05-26T16:36:34.481 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:34.501 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.102) 0:03:33.030 ********* 2021-05-26T16:36:34.757 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-05-26T16:36:34.759 INFO:teuthology.task.ansible.out:fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007203", "end": "2021-05-26 16:36:34.733903", "msg": "non-zero return code", "rc": 1, "start": "2021-05-26 16:36:34.726700", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-05-26T16:36:34.780 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.278) 0:03:33.308 ********* 2021-05-26T16:36:34.817 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-05-26T16:36:34.819 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-05-26T16:36:34.840 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.060) 0:03:33.369 ********* 2021-05-26T16:36:34.869 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-05-26T16:36:34.871 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:34.892 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:34 +0000 (0:00:00.051) 0:03:33.420 ********* 2021-05-26T16:36:37.883 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-05-26T16:36:37.885 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-05-26T16:36:37.905 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:37 +0000 (0:00:03.013) 0:03:36.434 ********* 2021-05-26T16:36:40.691 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-05-26T16:36:40.693 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-05-26T16:36:40.713 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:40 +0000 (0:00:02.807) 0:03:39.241 ********* 2021-05-26T16:36:41.941 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-05-26T16:36:41.943 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64"]} 2021-05-26T16:36:41.964 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:41 +0000 (0:00:01.251) 0:03:40.493 ********* 2021-05-26T16:36:42.043 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-05-26T16:36:42.045 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:42.065 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:42 +0000 (0:00:00.100) 0:03:40.594 ********* 2021-05-26T16:36:43.584 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-05-26T16:36:43.586 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:36:43.608 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:43 +0000 (0:00:01.542) 0:03:42.136 ********* 2021-05-26T16:36:45.019 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-05-26T16:36:45.021 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:36:45.047 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:45 +0000 (0:00:01.439) 0:03:43.576 ********* 2021-05-26T16:36:45.388 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-05-26T16:36:45.390 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice sysinit.target polkit.service dbus.socket dbus.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service nftables.service iptables.service ip6tables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2021-05-26T16:36:45.391 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2021-05-26T16:36:45.393 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127253", "LimitNPROCSoft": "127253", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127253", "LimitSIGPENDINGSoft": "127253", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2021-05-26T16:36:45.395 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203604", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-05-26T16:36:45.410 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:45 +0000 (0:00:00.363) 0:03:43.939 ********* 2021-05-26T16:36:45.729 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-05-26T16:36:45.731 INFO:teuthology.task.ansible.out:fatal: [smithi137.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-05-26T16:36:45.751 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:45 +0000 (0:00:00.340) 0:03:44.280 ********* 2021-05-26T16:36:46.467 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-05-26T16:36:46.468 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-05-26T16:36:46.491 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:46 +0000 (0:00:00.739) 0:03:45.019 ********* 2021-05-26T16:36:46.560 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-05-26T16:36:46.562 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:46.582 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:46 +0000 (0:00:00.091) 0:03:45.111 ********* 2021-05-26T16:36:46.662 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-05-26T16:36:46.663 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:46.683 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:46 +0000 (0:00:00.100) 0:03:45.212 ********* 2021-05-26T16:36:46.752 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-05-26T16:36:46.754 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:46.778 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:46 +0000 (0:00:00.094) 0:03:45.306 ********* 2021-05-26T16:36:46.847 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-05-26T16:36:46.849 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:46.870 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:46 +0000 (0:00:00.092) 0:03:45.398 ********* 2021-05-26T16:36:46.939 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:46.961 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:46 +0000 (0:00:00.091) 0:03:45.490 ********* 2021-05-26T16:36:47.020 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-05-26T16:36:47.022 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.047 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.082) 0:03:45.572 ********* 2021-05-26T16:36:47.104 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-05-26T16:36:47.129 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.085) 0:03:45.658 ********* 2021-05-26T16:36:47.201 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-05-26T16:36:47.203 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.223 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.093) 0:03:45.752 ********* 2021-05-26T16:36:47.293 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.315 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.091) 0:03:45.843 ********* 2021-05-26T16:36:47.394 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-05-26T16:36:47.396 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.406 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.427 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.112) 0:03:45.956 ********* 2021-05-26T16:36:47.496 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.518 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.090) 0:03:46.046 ********* 2021-05-26T16:36:47.586 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-05-26T16:36:47.616 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.098) 0:03:46.145 ********* 2021-05-26T16:36:47.687 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-05-26T16:36:47.689 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.711 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.095) 0:03:46.240 ********* 2021-05-26T16:36:47.782 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-05-26T16:36:47.783 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.803 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.091) 0:03:46.332 ********* 2021-05-26T16:36:47.872 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-05-26T16:36:47.874 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.897 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.093) 0:03:46.425 ********* 2021-05-26T16:36:47.966 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:47.968 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+755+88436ea4.5.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64"]} 2021-05-26T16:36:47.991 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:47 +0000 (0:00:00.094) 0:03:46.519 ********* 2021-05-26T16:36:48.014 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.022) 0:03:46.542 ********* 2021-05-26T16:36:48.063 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-05-26T16:36:48.065 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.087 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.073) 0:03:46.615 ********* 2021-05-26T16:36:48.094 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.118 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.031) 0:03:46.647 ********* 2021-05-26T16:36:48.188 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-05-26T16:36:48.190 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.210 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.091) 0:03:46.739 ********* 2021-05-26T16:36:48.269 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-05-26T16:36:48.270 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.291 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.080) 0:03:46.820 ********* 2021-05-26T16:36:48.350 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-05-26T16:36:48.352 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.373 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.081) 0:03:46.901 ********* 2021-05-26T16:36:48.442 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-05-26T16:36:48.444 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.464 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.091) 0:03:46.993 ********* 2021-05-26T16:36:48.532 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-05-26T16:36:48.534 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.554 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.090) 0:03:47.083 ********* 2021-05-26T16:36:48.623 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-05-26T16:36:48.625 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.645 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.090) 0:03:47.174 ********* 2021-05-26T16:36:48.714 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-05-26T16:36:48.716 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.736 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.090) 0:03:47.264 ********* 2021-05-26T16:36:48.803 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-05-26T16:36:48.805 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.825 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.089) 0:03:47.354 ********* 2021-05-26T16:36:48.894 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-05-26T16:36:48.896 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:48.917 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:48 +0000 (0:00:00.091) 0:03:47.445 ********* 2021-05-26T16:36:48.985 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-05-26T16:36:48.986 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.010 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.093) 0:03:47.538 ********* 2021-05-26T16:36:49.078 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-05-26T16:36:49.080 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.100 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.090) 0:03:47.628 ********* 2021-05-26T16:36:49.168 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-05-26T16:36:49.170 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.190 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.090) 0:03:47.718 ********* 2021-05-26T16:36:49.258 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-05-26T16:36:49.291 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.089) 0:03:47.808 ********* 2021-05-26T16:36:49.348 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-05-26T16:36:49.350 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.370 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.090) 0:03:47.899 ********* 2021-05-26T16:36:49.449 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-05-26T16:36:49.451 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.472 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.101) 0:03:48.000 ********* 2021-05-26T16:36:49.541 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.563 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.091) 0:03:48.092 ********* 2021-05-26T16:36:49.622 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-05-26T16:36:49.624 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:36:49.646 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.081) 0:03:48.174 ********* 2021-05-26T16:36:49.653 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-05-26T16:36:49.655 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.678 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.032) 0:03:48.207 ********* 2021-05-26T16:36:49.758 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-05-26T16:36:49.760 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.780 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.102) 0:03:48.309 ********* 2021-05-26T16:36:49.854 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:36:49.855 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.876 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.095) 0:03:48.405 ********* 2021-05-26T16:36:49.945 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-05-26T16:36:49.947 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:49.968 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:49 +0000 (0:00:00.091) 0:03:48.496 ********* 2021-05-26T16:36:50.037 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-05-26T16:36:50.039 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:50.059 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:50 +0000 (0:00:00.091) 0:03:48.588 ********* 2021-05-26T16:36:50.130 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-05-26T16:36:50.132 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:50.163 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:50 +0000 (0:00:00.103) 0:03:48.691 ********* 2021-05-26T16:36:50.235 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-05-26T16:36:50.237 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:50.263 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:50 +0000 (0:00:00.099) 0:03:48.791 ********* 2021-05-26T16:36:50.510 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-05-26T16:36:50.514 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-05-26T16:36:50.533 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:50 +0000 (0:00:00.270) 0:03:49.061 ********* 2021-05-26T16:36:50.782 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-05-26T16:36:50.784 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:36:50.803 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:50 +0000 (0:00:00.270) 0:03:49.332 ********* 2021-05-26T16:36:51.041 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-05-26T16:36:51.042 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-05-26T16:36:51.064 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.260) 0:03:49.592 ********* 2021-05-26T16:36:51.091 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-05-26T16:36:51.093 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:36:51.117 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.052) 0:03:49.645 ********* 2021-05-26T16:36:51.135 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-05-26T16:36:51.137 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.164 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.047) 0:03:49.692 ********* 2021-05-26T16:36:51.233 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-05-26T16:36:51.235 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.255 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.091) 0:03:49.784 ********* 2021-05-26T16:36:51.324 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-05-26T16:36:51.326 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.346 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.090) 0:03:49.875 ********* 2021-05-26T16:36:51.425 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-05-26T16:36:51.427 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.447 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.100) 0:03:49.975 ********* 2021-05-26T16:36:51.466 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-05-26T16:36:51.467 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket system.slice sysinit.target basic.target polkit.service dbus.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ipset.service ebtables.service nftables.service shutdown.target ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2021-05-26T16:36:51.469 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2021-05-26T16:36:51.471 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127277", "LimitNPROCSoft": "127277", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127277", "LimitSIGPENDINGSoft": "127277", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2021-05-26T16:36:51.472 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203643", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-05-26T16:36:51.494 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.046) 0:03:50.022 ********* 2021-05-26T16:36:51.544 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-05-26T16:36:51.546 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.566 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.072) 0:03:50.095 ********* 2021-05-26T16:36:51.634 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-05-26T16:36:51.636 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.657 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.090) 0:03:50.185 ********* 2021-05-26T16:36:51.725 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.752 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.095) 0:03:50.281 ********* 2021-05-26T16:36:51.823 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-05-26T16:36:51.825 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-05-26T16:36:51.848 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.096) 0:03:50.377 ********* 2021-05-26T16:36:51.869 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.020) 0:03:50.397 ********* 2021-05-26T16:36:51.939 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:51.970 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:51 +0000 (0:00:00.101) 0:03:50.499 ********* 2021-05-26T16:36:51.973 INFO:teuthology.task.ansible.out: 2021-05-26T16:36:52.032 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-05-26T16:36:52.034 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.056 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.085) 0:03:50.584 ********* 2021-05-26T16:36:52.126 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-05-26T16:36:52.128 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.148 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.092) 0:03:50.677 ********* 2021-05-26T16:36:52.187 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-05-26T16:36:52.215 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.067) 0:03:50.744 ********* 2021-05-26T16:36:52.223 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.249 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.033) 0:03:50.778 ********* 2021-05-26T16:36:52.299 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-05-26T16:36:52.301 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.332 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.082) 0:03:50.860 ********* 2021-05-26T16:36:52.341 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-05-26T16:36:52.343 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.366 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.034) 0:03:50.895 ********* 2021-05-26T16:36:52.404 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.428 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.061) 0:03:50.956 ********* 2021-05-26T16:36:52.435 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-05-26T16:36:52.437 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.459 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.031) 0:03:50.987 ********* 2021-05-26T16:36:52.518 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-05-26T16:36:52.520 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.542 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.082) 0:03:51.070 ********* 2021-05-26T16:36:52.549 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-05-26T16:36:52.551 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.573 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.031) 0:03:51.102 ********* 2021-05-26T16:36:52.614 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.644 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.071) 0:03:51.173 ********* 2021-05-26T16:36:52.662 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-05-26T16:36:52.664 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.685 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.040) 0:03:51.213 ********* 2021-05-26T16:36:52.713 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.738 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.053) 0:03:51.267 ********* 2021-05-26T16:36:52.756 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-05-26T16:36:52.758 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.781 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.043) 0:03:51.310 ********* 2021-05-26T16:36:52.809 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.834 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.052) 0:03:51.362 ********* 2021-05-26T16:36:52.852 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-05-26T16:36:52.854 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.876 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.041) 0:03:51.404 ********* 2021-05-26T16:36:52.904 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-05-26T16:36:52.932 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.055) 0:03:51.460 ********* 2021-05-26T16:36:52.949 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-05-26T16:36:52.952 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:52.973 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:52 +0000 (0:00:00.041) 0:03:51.501 ********* 2021-05-26T16:36:53.023 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-05-26T16:36:53.025 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.047 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.073) 0:03:51.575 ********* 2021-05-26T16:36:53.054 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-05-26T16:36:53.055 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.078 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.031) 0:03:51.606 ********* 2021-05-26T16:36:53.117 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-05-26T16:36:53.119 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.141 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.063) 0:03:51.670 ********* 2021-05-26T16:36:53.161 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-05-26T16:36:53.163 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.186 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.044) 0:03:51.714 ********* 2021-05-26T16:36:53.228 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-05-26T16:36:53.230 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.254 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.068) 0:03:51.783 ********* 2021-05-26T16:36:53.262 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-05-26T16:36:53.264 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.285 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.031) 0:03:51.814 ********* 2021-05-26T16:36:53.324 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.352 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.066) 0:03:51.880 ********* 2021-05-26T16:36:53.359 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:36:53.361 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-05-26T16:36:53.387 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.035) 0:03:51.915 ********* 2021-05-26T16:36:53.414 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-05-26T16:36:53.438 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.051) 0:03:51.966 ********* 2021-05-26T16:36:53.466 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-05-26T16:36:53.467 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.477 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-05-26T16:36:53.479 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.488 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.490 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.500 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.502 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.526 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.088) 0:03:52.054 ********* 2021-05-26T16:36:53.533 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-05-26T16:36:53.535 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.562 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.035) 0:03:52.090 ********* 2021-05-26T16:36:53.642 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-05-26T16:36:53.644 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.665 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.102) 0:03:52.193 ********* 2021-05-26T16:36:53.733 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-05-26T16:36:53.735 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.756 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.090) 0:03:52.284 ********* 2021-05-26T16:36:53.762 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-05-26T16:36:53.764 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004004", "end": "2021-05-26 16:36:53.735108", "rc": 0, "start": "2021-05-26 16:36:53.731104", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology-lock"]} 2021-05-26T16:36:53.790 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.034) 0:03:52.319 ********* 2021-05-26T16:36:53.828 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.852 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.061) 0:03:52.380 ********* 2021-05-26T16:36:53.870 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-05-26T16:36:53.872 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.899 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.046) 0:03:52.427 ********* 2021-05-26T16:36:53.918 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-05-26T16:36:53.920 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:53.945 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:53 +0000 (0:00:00.045) 0:03:52.473 ********* 2021-05-26T16:36:53.993 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-05-26T16:36:53.995 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.018 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.073) 0:03:52.547 ********* 2021-05-26T16:36:54.025 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-05-26T16:36:54.027 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.054 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.034) 0:03:52.582 ********* 2021-05-26T16:36:54.083 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.118 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.064) 0:03:52.647 ********* 2021-05-26T16:36:54.125 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-05-26T16:36:54.128 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.150 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.031) 0:03:52.678 ********* 2021-05-26T16:36:54.199 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-05-26T16:36:54.201 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.223 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.073) 0:03:52.752 ********* 2021-05-26T16:36:54.230 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-05-26T16:36:54.232 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.255 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.031) 0:03:52.783 ********* 2021-05-26T16:36:54.325 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-05-26T16:36:54.327 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.353 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.098) 0:03:52.882 ********* 2021-05-26T16:36:54.412 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-05-26T16:36:54.414 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.438 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.084) 0:03:52.966 ********* 2021-05-26T16:36:54.531 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.554 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.115) 0:03:53.082 ********* 2021-05-26T16:36:54.625 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-05-26T16:36:54.627 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.647 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.093) 0:03:53.175 ********* 2021-05-26T16:36:54.716 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-05-26T16:36:54.718 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.739 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.091) 0:03:53.267 ********* 2021-05-26T16:36:54.818 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-05-26T16:36:54.820 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.840 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.101) 0:03:53.368 ********* 2021-05-26T16:36:54.909 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-05-26T16:36:54.911 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:54.931 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:54 +0000 (0:00:00.091) 0:03:53.460 ********* 2021-05-26T16:36:55.000 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-05-26T16:36:55.002 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.022 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.090) 0:03:53.550 ********* 2021-05-26T16:36:55.091 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-05-26T16:36:55.093 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.123 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.101) 0:03:53.652 ********* 2021-05-26T16:36:55.197 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-05-26T16:36:55.199 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.219 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.095) 0:03:53.747 ********* 2021-05-26T16:36:55.287 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-05-26T16:36:55.289 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.312 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.093) 0:03:53.841 ********* 2021-05-26T16:36:55.382 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.403 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.090) 0:03:53.932 ********* 2021-05-26T16:36:55.472 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-05-26T16:36:55.474 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.495 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.091) 0:03:54.023 ********* 2021-05-26T16:36:55.564 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-05-26T16:36:55.566 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.587 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.092) 0:03:54.115 ********* 2021-05-26T16:36:55.595 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-05-26T16:36:55.597 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:36:55.622 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.034) 0:03:54.150 ********* 2021-05-26T16:36:55.650 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.675 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.052) 0:03:54.203 ********* 2021-05-26T16:36:55.703 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-05-26T16:36:55.705 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930278223872, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227118707, 'block_used': 12976401, 'inode_total': 61054976, 'inode_available': 60985790, 'inode_used': 69186, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227118707, "block_size": 4096, "block_total": 240095108, "block_used": 12976401, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985790, "inode_total": 61054976, "inode_used": 69186, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930278223872, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}} 2021-05-26T16:36:55.728 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.052) 0:03:54.256 ********* 2021-05-26T16:36:55.745 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:36:55.746 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.768 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.040) 0:03:54.297 ********* 2021-05-26T16:36:55.839 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-05-26T16:36:55.841 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.861 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.092) 0:03:54.390 ********* 2021-05-26T16:36:55.931 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-05-26T16:36:55.933 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:55.954 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.092) 0:03:54.482 ********* 2021-05-26T16:36:55.961 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-05-26T16:36:55.962 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005044", "end": "2021-05-26 16:36:55.937449", "rc": 0, "start": "2021-05-26 16:36:55.932405", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:36:55.985 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:55 +0000 (0:00:00.030) 0:03:54.513 ********* 2021-05-26T16:36:56.024 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-05-26T16:36:56.026 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:56.048 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:56 +0000 (0:00:00.063) 0:03:54.576 ********* 2021-05-26T16:36:56.086 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-05-26T16:36:56.088 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930278223872, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227118707, 'block_used': 12976401, 'inode_total': 61054976, 'inode_available': 60985790, 'inode_used': 69186, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227118707, "block_size": 4096, "block_total": 240095108, "block_used": 12976401, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985790, "inode_total": 61054976, "inode_used": 69186, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930278223872, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:56.111 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:56 +0000 (0:00:00.063) 0:03:54.640 ********* 2021-05-26T16:36:56.118 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-05-26T16:36:56.120 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:56.143 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:56 +0000 (0:00:00.031) 0:03:54.672 ********* 2021-05-26T16:36:56.182 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-05-26T16:36:56.207 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:56 +0000 (0:00:00.062) 0:03:54.735 ********* 2021-05-26T16:36:56.414 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-05-26T16:36:56.416 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-05-26T16:36:56.438 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:56 +0000 (0:00:00.231) 0:03:54.966 ********* 2021-05-26T16:36:56.693 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-05-26T16:36:56.695 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:36:56.715 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:56 +0000 (0:00:00.277) 0:03:55.244 ********* 2021-05-26T16:36:56.952 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-05-26T16:36:56.954 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-05-26T16:36:56.975 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:56 +0000 (0:00:00.259) 0:03:55.503 ********* 2021-05-26T16:36:57.046 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.068 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.092) 0:03:55.596 ********* 2021-05-26T16:36:57.138 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-05-26T16:36:57.139 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.160 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.091) 0:03:55.688 ********* 2021-05-26T16:36:57.229 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-05-26T16:36:57.231 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.252 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.092) 0:03:55.781 ********* 2021-05-26T16:36:57.321 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-05-26T16:36:57.323 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.345 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.092) 0:03:55.874 ********* 2021-05-26T16:36:57.414 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.436 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.090) 0:03:55.965 ********* 2021-05-26T16:36:57.506 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-05-26T16:36:57.507 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.528 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.091) 0:03:56.057 ********* 2021-05-26T16:36:57.599 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-05-26T16:36:57.600 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.631 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.103) 0:03:56.160 ********* 2021-05-26T16:36:57.704 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-05-26T16:36:57.706 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.736 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.104) 0:03:56.265 ********* 2021-05-26T16:36:57.757 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:36:57.758 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoXwoHPCIX7CygozTyvgR1a46SOYHLQUEm'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.285188", "end": "2021-05-26 16:36:57.730404", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoXwoHPCIX7CygozTyvgR1a46SOYHLQUEm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:36:56.445216", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:36:57.812 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-05-26T16:36:57.814 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.844 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.107) 0:03:56.373 ********* 2021-05-26T16:36:57.916 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-05-26T16:36:57.918 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:57.941 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:57 +0000 (0:00:00.096) 0:03:56.469 ********* 2021-05-26T16:36:58.009 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.031 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.090) 0:03:56.559 ********* 2021-05-26T16:36:58.100 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.122 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.091) 0:03:56.650 ********* 2021-05-26T16:36:58.191 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.213 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.090) 0:03:56.741 ********* 2021-05-26T16:36:58.282 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.304 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.091) 0:03:56.832 ********* 2021-05-26T16:36:58.374 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.401 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.091) 0:03:56.924 ********* 2021-05-26T16:36:58.464 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-05-26T16:36:58.466 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.486 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.090) 0:03:57.015 ********* 2021-05-26T16:36:58.555 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.577 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.091) 0:03:57.106 ********* 2021-05-26T16:36:58.646 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-05-26T16:36:58.648 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.668 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.090) 0:03:57.196 ********* 2021-05-26T16:36:58.736 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-05-26T16:36:58.738 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.758 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.090) 0:03:57.287 ********* 2021-05-26T16:36:58.839 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-05-26T16:36:58.841 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.862 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.103) 0:03:57.390 ********* 2021-05-26T16:36:58.943 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-05-26T16:36:58.944 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:58.965 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:58 +0000 (0:00:00.103) 0:03:57.494 ********* 2021-05-26T16:36:59.014 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:36:59.017 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-1k13pk-vj9J-jIf7-2NBo-vVF5-Xju6-9gWPWt', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233004A400BGN', 'nvme-nvme.8086-43564654363233333030344134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.069266", "end": "2021-05-26 16:36:58.983058", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1k13pk-vj9J-jIf7-2NBo-vVF5-Xju6-9gWPWt", "nvme-INTEL_SSDPEDMD400G4_CVFT6233004A400BGN", "nvme-nvme.8086-43564654363233333030344134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:36:57.913792", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-05-26T16:36:59.018 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:36:59.047 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.073 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.107) 0:03:57.601 ********* 2021-05-26T16:36:59.142 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:36:59.144 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-05-26T16:36:59.164 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.091) 0:03:57.693 ********* 2021-05-26T16:36:59.248 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-05-26T16:36:59.250 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.259 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-05-26T16:36:59.270 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.272 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.281 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.293 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.294 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.319 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.154) 0:03:57.847 ********* 2021-05-26T16:36:59.567 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-05-26T16:36:59.568 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003314", "end": "2021-05-26 16:36:59.539856", "rc": 0, "start": "2021-05-26 16:36:59.536542", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology-lock"]} 2021-05-26T16:36:59.592 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.273) 0:03:58.120 ********* 2021-05-26T16:36:59.661 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.685 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.093) 0:03:58.214 ********* 2021-05-26T16:36:59.755 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-05-26T16:36:59.757 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.777 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.091) 0:03:58.306 ********* 2021-05-26T16:36:59.858 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-05-26T16:36:59.861 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.884 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.106) 0:03:58.412 ********* 2021-05-26T16:36:59.964 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-05-26T16:36:59.966 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:36:59.986 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:36:59 +0000 (0:00:00.102) 0:03:58.515 ********* 2021-05-26T16:37:00.294 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:00.296 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFo1sFSbU24ipwbsFdw9s0kZRJ0y2mMWa3s'], 'uuids': ['06a7ba53-85a5-47a2-ae38-4996a56ce3cb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.092261", "end": "2021-05-26 16:37:00.261901", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFo1sFSbU24ipwbsFdw9s0kZRJ0y2mMWa3s"], "labels": [], "masters": [], "uuids": ["06a7ba53-85a5-47a2-ae38-4996a56ce3cb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:36:59.169640", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:01.481 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-05-26T16:37:01.483 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:37:01.507 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:01 +0000 (0:00:01.520) 0:04:00.035 ********* 2021-05-26T16:37:01.525 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:01.526 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoNPrJJncmxT5meUvGktX87qvdG0HX6co7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.044012", "end": "2021-05-26 16:37:01.487341", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoNPrJJncmxT5meUvGktX87qvdG0HX6co7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:00.443329", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:01.591 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi003.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930278141952, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227118687, 'block_used': 12976421, 'inode_total': 61054976, 'inode_available': 60985798, 'inode_used': 69178, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227118687, "block_size": 4096, "block_total": 240095108, "block_used": 12976421, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985798, "inode_total": 61054976, "inode_used": 69178, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930278141952, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}} 2021-05-26T16:37:01.614 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:01 +0000 (0:00:00.106) 0:04:00.142 ********* 2021-05-26T16:37:01.849 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-05-26T16:37:01.851 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005326", "end": "2021-05-26 16:37:01.830949", "rc": 0, "start": "2021-05-26 16:37:01.825623", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:01.871 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:01 +0000 (0:00:00.257) 0:04:00.400 ********* 2021-05-26T16:37:01.950 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-05-26T16:37:01.951 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930278141952, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227118687, 'block_used': 12976421, 'inode_total': 61054976, 'inode_available': 60985798, 'inode_used': 69178, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227118687, "block_size": 4096, "block_total": 240095108, "block_used": 12976421, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985798, "inode_total": 61054976, "inode_used": 69178, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930278141952, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:01.973 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:01 +0000 (0:00:00.101) 0:04:00.501 ********* 2021-05-26T16:37:02.041 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-05-26T16:37:02.063 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:02 +0000 (0:00:00.090) 0:04:00.592 ********* 2021-05-26T16:37:02.743 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:02.745 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoEfcXLEJE9k1oZXDa92bWmqoeQvhQaG2L'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.047636", "end": "2021-05-26 16:37:02.714057", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoEfcXLEJE9k1oZXDa92bWmqoeQvhQaG2L"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:01.666421", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi137.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM 2021-05-26T16:37:02.747 INFO:teuthology.task.ansible.out:0033-9ZM173_Z1W5XLAR', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLAR', 'scsi-35000c5009293fb5d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR', 'wwn-0x5000c5009293fb5d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XLAR', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293fb5d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLAR-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLAR-part1', 'scsi-35000c5009293fb5d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR-part1', 'wwn-0x5000c5009293fb5d-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLAR", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLAR", "scsi-35000c5009293fb5d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR", "wwn-0x5000c5009293fb5d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLAR-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLAR-part1", "scsi-35000c5009293fb5d-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR-part1", "wwn-0x5000c5009293fb5d-part 2021-05-26T16:37:02.748 INFO:teuthology.task.ansible.out:1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLAR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293fb5d"}}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:03.793 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mYz9v31aoM8acHiDOQvT1dr1cOXrcZdAD'], 'uuids': ['7d5028b8-5cf4-46f6-ba1b-cbf3593d6a8f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.467231", "end": "2021-05-26 16:37:03.767737", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mYz9v31aoM8acHiDOQvT1dr1cOXrcZdAD"], "labels": [], "masters": [], "uuids": ["7d5028b8-5cf4-46f6-ba1b-cbf3593d6a8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:02.300506", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:03.981 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoUCfQb7S8Z9POwVR7MeI1EddELZFkVGvr'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.052643", "end": "2021-05-26 16:37:03.954335", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoUCfQb7S8Z9POwVR7MeI1EddELZFkVGvr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:02.901692", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:04.009 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:04 +0000 (0:00:01.946) 0:04:02.538 ********* 2021-05-26T16:37:04.423 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-05-26T16:37:04.425 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoXwoHPCIX7CygozTyvgR1a46SOYHLQUEm'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.148980", "end": "2021-05-26 16:37:04.397761", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoXwoHPCIX7CygozTyvgR1a46SOYHLQUEm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:04.248781", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146315 s, 788 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146315 s, 788 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:04.632 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-1k13pk-vj9J-jIf7-2NBo-vVF5-Xju6-9gWPWt', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233004A400BGN', 'nvme-nvme.8086-43564654363233333030344134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037545", "end": "2021-05-26 16:37:04.603988", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1k13pk-vj9J-jIf7-2NBo-vVF5-Xju6-9gWPWt", "nvme-INTEL_SSDPEDMD400G4_CVFT6233004A400BGN", "nvme-nvme.8086-43564654363233333030344134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:04.566443", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0349256 s, 3.3 GB/s", "std 2021-05-26T16:37:04.716 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349256 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:04.955 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFo1sFSbU24ipwbsFdw9s0kZRJ0y2mMWa3s'], 'uuids': ['06a7ba53-85a5-47a2-ae38-4996a56ce3cb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139805", "end": "2021-05-26 16:37:04.935176", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFo1sFSbU24ipwbsFdw9s0kZRJ0y2mMWa3s"], "labels": [], "masters": [], "uuids": ["06a7ba53-85a5-47a2-ae38-4996a56ce3cb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:04.795371", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137175 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137175 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:05.039 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:05.041 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-SQdTAM-lFa2-QYS6-PZ2Q-7RXD-1Ybw-tFILFt', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN', 'nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.056123", "end": "2021-05-26 16:37:05.013506", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-SQdTAM-lFa2-QYS6-PZ2Q-7RXD-1Ybw-tFILFt", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN", "nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:03.957383", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-05-26T16:37:05.042 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:05.268 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoNPrJJncmxT5meUvGktX87qvdG0HX6co7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.142139", "end": "2021-05-26 16:37:05.244983", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoNPrJJncmxT5meUvGktX87qvdG0HX6co7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:05.102844", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139527 s, 827 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139527 s, 827 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:05.580 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoEfcXLEJE9k1oZXDa92bWmqoeQvhQaG2L'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141059", "end": "2021-05-26 16:37:05.558173", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoEfcXLEJE9k1oZXDa92bWmqoeQvhQaG2L"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:05.417114", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138419 s, 833 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138419 s, 833 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:05.592 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLAR', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLAR', 'scsi-35000c5009293fb5d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR', 'wwn-0x5000c5009293fb5d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XLAR', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293fb5d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLAR-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLAR-part1', 'scsi-35000c5009293fb5d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR-part1', 'wwn-0x5000c5009293fb5d-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLAR", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLAR", "scsi-35000c5009293fb5d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR", "wwn-0x5000c5009293fb5d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLAR-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLAR-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-05-26T16:37:05.594 INFO:teuthology.task.ansible.out:Z1W5XLAR-part1", "scsi-35000c5009293fb5d-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLAR-part1", "wwn-0x5000c5009293fb5d-part1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLAR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293fb5d"}}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:05.894 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoUCfQb7S8Z9POwVR7MeI1EddELZFkVGvr'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139686", "end": "2021-05-26 16:37:05.873419", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ywQfGyZWbNdupNdhbKSBh67omKDeeYFoUCfQb7S8Z9POwVR7MeI1EddELZFkVGvr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:05.733733", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137107 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137107 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:05.922 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:05 +0000 (0:00:01.912) 0:04:04.450 ********* 2021-05-26T16:37:06.198 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-05-26T16:37:06.200 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.045455", "end": "2021-05-26 16:37:06.129926", "rc": 0, "start": "2021-05-26 16:37:06.084471", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:06.221 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:06 +0000 (0:00:00.298) 0:04:04.749 ********* 2021-05-26T16:37:06.280 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:06.282 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mosFBL86oe7M3zLrJG8RGp19MW1iOzPr2'], 'uuids': ['07911c00-0a97-4a00-85eb-64fd064a3140'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.046136", "end": "2021-05-26 16:37:06.250167", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mosFBL86oe7M3zLrJG8RGp19MW1iOzPr2"], "labels": [], "masters": [], "uuids": ["07911c00-0a97-4a00-85eb-64fd064a3140"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:05.204031", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:06.450 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-05-26T16:37:06.452 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049479", "end": "2021-05-26 16:37:06.429469", "rc": 0, "start": "2021-05-26 16:37:06.379990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:06.472 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:06 +0000 (0:00:00.251) 0:04:05.001 ********* 2021-05-26T16:37:06.541 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-05-26T16:37:06.602 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:06 +0000 (0:00:00.129) 0:04:05.130 ********* 2021-05-26T16:37:06.631 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-05-26T16:37:06.633 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:06.655 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:06 +0000 (0:00:00.053) 0:04:05.184 ********* 2021-05-26T16:37:06.657 INFO:teuthology.task.ansible.out: 2021-05-26T16:37:06.684 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-05-26T16:37:06.686 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:06.708 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:06 +0000 (0:00:00.051) 0:04:05.235 ********* 2021-05-26T16:37:06.734 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-05-26T16:37:06.736 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:06.759 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:06 +0000 (0:00:00.052) 0:04:05.287 ********* 2021-05-26T16:37:06.786 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:06.808 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:06 +0000 (0:00:00.049) 0:04:05.337 ********* 2021-05-26T16:37:06.994 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-05-26T16:37:06.996 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:37:07.017 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.208) 0:04:05.546 ********* 2021-05-26T16:37:07.065 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-05-26T16:37:07.067 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930278223872, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227118707, 'block_used': 12976401, 'inode_total': 61054976, 'inode_available': 60985790, 'inode_used': 69186, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227118707, "block_size": 4096, "block_total": 240095108, "block_used": 12976401, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985790, "inode_total": 61054976, "inode_used": 69186, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930278223872, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:07.092 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.074) 0:04:05.620 ********* 2021-05-26T16:37:07.120 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:07.142 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.049) 0:04:05.670 ********* 2021-05-26T16:37:07.168 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:07.170 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:07.190 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.048) 0:04:05.719 ********* 2021-05-26T16:37:07.217 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:07.239 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.049) 0:04:05.768 ********* 2021-05-26T16:37:07.277 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-05-26T16:37:07.282 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:07.302 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.063) 0:04:05.831 ********* 2021-05-26T16:37:07.330 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-05-26T16:37:07.332 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:07.352 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.049) 0:04:05.880 ********* 2021-05-26T16:37:07.648 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:07.650 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mW0s4eXivXbSWSooqFESKD1y06FJqvaSK'], 'uuids': ['c5cfdf44-5d28-402b-88a0-70246572a6f6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.068496", "end": "2021-05-26 16:37:07.508814", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mW0s4eXivXbSWSooqFESKD1y06FJqvaSK"], "labels": [], "masters": [], "uuids": ["c5cfdf44-5d28-402b-88a0-70246572a6f6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:06.440318", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Create logical_volumes dict 2021-05-26T16:37:07.651 INFO:teuthology.task.ansible.out:] ********************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:07.670 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:07 +0000 (0:00:00.318) 0:04:06.199 ********* 2021-05-26T16:37:08.251 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-05-26T16:37:08.279 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:08 +0000 (0:00:00.608) 0:04:06.807 ********* 2021-05-26T16:37:08.800 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:08.802 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mRB8fh7uigNi68PXK3YcjmrgsA5LWlCoE'], 'uuids': ['daae0931-a873-40c0-8045-2a0751c0e049'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.066954", "end": "2021-05-26 16:37:08.767711", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mRB8fh7uigNi68PXK3YcjmrgsA5LWlCoE"], "labels": [], "masters": [], "uuids": ["daae0931-a873-40c0-8045-2a0751c0e049"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:07.700757", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:08.804 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:08.805 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi003.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-35000c500871a3370', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7', 'wwn-0x5000c500871a3370'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HRN7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a3370', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-35000c500871a3370-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'wwn-0x5000c500871a3370-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-35000c500871a3370", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7", "wwn-0x5000c500871a3370"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7- 2021-05-26T16:37:08.807 INFO:teuthology.task.ansible.out:part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7-part1", "scsi-35000c500871a3370-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "wwn-0x5000c500871a3370-part1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRN7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a3370"}}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:09.122 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-05-26T16:37:09.124 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:09.446 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:09.795 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:10.024 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-05-26T16:37:10.026 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mkVsjq7E3hK9EqLK1h9vLQIuMkYxOQR8L'], 'uuids': ['7e6c3cbb-59ca-4cb0-9603-eef98af871b9'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.037673", "end": "2021-05-26 16:37:10.000721", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mkVsjq7E3hK9EqLK1h9vLQIuMkYxOQR8L"], "labels": [], "masters": [], "uuids": ["7e6c3cbb-59ca-4cb0-9603-eef98af871b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:08.963048", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-05-26T16:37:10.066 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:10 +0000 (0:00:01.787) 0:04:08.595 ********* 2021-05-26T16:37:10.126 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-05-26T16:37:10.128 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:10.153 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:10 +0000 (0:00:00.086) 0:04:08.681 ********* 2021-05-26T16:37:10.338 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-05-26T16:37:10.340 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-05-26T16:37:10.362 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:10 +0000 (0:00:00.208) 0:04:08.890 ********* 2021-05-26T16:37:10.431 INFO:teuthology.task.ansible.out: 2021-05-26T16:37:10.433 INFO:teuthology.task.ansible.out:TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mYz9v31aoM8acHiDOQvT1dr1cOXrcZdAD'], 'uuids': ['7d5028b8-5cf4-46f6-ba1b-cbf3593d6a8f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.136528", "end": "2021-05-26 16:37:10.402653", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mYz9v31aoM8acHiDOQvT1dr1cOXrcZdAD"], "labels": [], "masters": [], "uuids": ["7d5028b8-5cf4-46f6-ba1b-cbf3593d6a8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:10.266125", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.133753 s, 862 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.133753 s, 862 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:10.570 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-05-26T16:37:10.572 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:10.646 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-05-26T16:37:10.649 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-SQdTAM-lFa2-QYS6-PZ2Q-7RXD-1Ybw-tFILFt', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN', 'nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036724", "end": "2021-05-26 16:37:10.621064", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-SQdTAM-lFa2-QYS6-PZ2Q-7RXD-1Ybw-tFILFt", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN", "nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:10.584340", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0340385 s, 3.4 GB/s", "std 2021-05-26T16:37:10.651 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0340385 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:10.742 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-05-26T16:37:10.744 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:10.909 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:10.983 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-05-26T16:37:10.985 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mosFBL86oe7M3zLrJG8RGp19MW1iOzPr2'], 'uuids': ['07911c00-0a97-4a00-85eb-64fd064a3140'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.148022", "end": "2021-05-26 16:37:10.953401", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mosFBL86oe7M3zLrJG8RGp19MW1iOzPr2"], "labels": [], "masters": [], "uuids": ["07911c00-0a97-4a00-85eb-64fd064a3140"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:10.805379", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145342 s, 794 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145342 s, 794 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:11.089 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-05-26T16:37:11.090 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:11.100 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:11.125 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:11 +0000 (0:00:00.763) 0:04:09.653 ********* 2021-05-26T16:37:11.152 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-05-26T16:37:11.153 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:11.173 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:11 +0000 (0:00:00.048) 0:04:09.702 ********* 2021-05-26T16:37:11.200 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-05-26T16:37:11.202 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:11.223 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:11 +0000 (0:00:00.049) 0:04:09.751 ********* 2021-05-26T16:37:11.303 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-05-26T16:37:11.304 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mW0s4eXivXbSWSooqFESKD1y06FJqvaSK'], 'uuids': ['c5cfdf44-5d28-402b-88a0-70246572a6f6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.146664", "end": "2021-05-26 16:37:11.276848", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mW0s4eXivXbSWSooqFESKD1y06FJqvaSK"], "labels": [], "masters": [], "uuids": ["c5cfdf44-5d28-402b-88a0-70246572a6f6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:11.130184", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143834 s, 802 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143834 s, 802 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:11.411 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:37:11.433 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:11 +0000 (0:00:00.210) 0:04:09.962 ********* 2021-05-26T16:37:11.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-05-26T16:37:11.472 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-05-26T16:37:11.495 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:11 +0000 (0:00:00.061) 0:04:10.024 ********* 2021-05-26T16:37:11.627 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-05-26T16:37:11.629 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mRB8fh7uigNi68PXK3YcjmrgsA5LWlCoE'], 'uuids': ['daae0931-a873-40c0-8045-2a0751c0e049'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.138446", "end": "2021-05-26 16:37:11.598900", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mRB8fh7uigNi68PXK3YcjmrgsA5LWlCoE"], "labels": [], "masters": [], "uuids": ["daae0931-a873-40c0-8045-2a0751c0e049"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:11.460454", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135614 s, 851 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135614 s, 851 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:11.630 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-35000c500871a3370', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7', 'wwn-0x5000c500871a3370'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HRN7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a3370', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-35000c500871a3370-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'wwn-0x5000c500871a3370-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-35000c500871a3370", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7", "wwn-0x5000c500871a3370"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-05-26T16:37:11.632 INFO:teuthology.task.ansible.out:Z1W4HRN7-part1", "scsi-35000c500871a3370-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "wwn-0x5000c500871a3370-part1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRN7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a3370"}}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:11.911 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-05-26T16:37:11.913 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true} 2021-05-26T16:37:11.935 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:11 +0000 (0:00:00.440) 0:04:10.464 ********* 2021-05-26T16:37:11.952 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-05-26T16:37:11.954 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mkVsjq7E3hK9EqLK1h9vLQIuMkYxOQR8L'], 'uuids': ['7e6c3cbb-59ca-4cb0-9603-eef98af871b9'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.137238", "end": "2021-05-26 16:37:11.918464", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-LlI9v66B0zKfBvMs3vjUsbmvfobCA26mkVsjq7E3hK9EqLK1h9vLQIuMkYxOQR8L"], "labels": [], "masters": [], "uuids": ["7e6c3cbb-59ca-4cb0-9603-eef98af871b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-05-26 16:37:11.781226", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134529 s, 857 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134529 s, 857 MB/s"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:11.984 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:11 +0000 (0:00:00.048) 0:04:10.512 ********* 2021-05-26T16:37:12.234 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-05-26T16:37:12.236 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.060535", "end": "2021-05-26 16:37:12.211260", "rc": 0, "start": "2021-05-26 16:37:12.150725", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:12.256 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.271) 0:04:10.784 ********* 2021-05-26T16:37:12.378 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-05-26T16:37:12.379 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-05-26T16:37:12.401 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.145) 0:04:10.929 ********* 2021-05-26T16:37:12.428 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-05-26T16:37:12.430 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.451 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.049) 0:04:10.979 ********* 2021-05-26T16:37:12.477 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-05-26T16:37:12.479 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.499 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.048) 0:04:11.028 ********* 2021-05-26T16:37:12.516 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-05-26T16:37:12.518 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051105", "end": "2021-05-26 16:37:12.486083", "rc": 0, "start": "2021-05-26 16:37:12.434978", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:12.548 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.048) 0:04:11.077 ********* 2021-05-26T16:37:12.558 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-05-26T16:37:12.560 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.581 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.032) 0:04:11.110 ********* 2021-05-26T16:37:12.588 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-05-26T16:37:12.615 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.033) 0:04:11.144 ********* 2021-05-26T16:37:12.622 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-05-26T16:37:12.623 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.646 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.031) 0:04:11.175 ********* 2021-05-26T16:37:12.652 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-05-26T16:37:12.654 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.678 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.031) 0:04:11.206 ********* 2021-05-26T16:37:12.684 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-05-26T16:37:12.686 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.710 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.031) 0:04:11.238 ********* 2021-05-26T16:37:12.716 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-05-26T16:37:12.717 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.741 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.031) 0:04:11.269 ********* 2021-05-26T16:37:12.748 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-05-26T16:37:12.749 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.773 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.031) 0:04:11.301 ********* 2021-05-26T16:37:12.780 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-05-26T16:37:12.781 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.806 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.033) 0:04:11.335 ********* 2021-05-26T16:37:12.813 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-05-26T16:37:12.815 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.838 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.031) 0:04:11.366 ********* 2021-05-26T16:37:12.845 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-05-26T16:37:12.846 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.869 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.031) 0:04:11.397 ********* 2021-05-26T16:37:12.876 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-05-26T16:37:12.877 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.907 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.038) 0:04:11.436 ********* 2021-05-26T16:37:12.938 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-05-26T16:37:12.940 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:12.970 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:12 +0000 (0:00:00.062) 0:04:11.499 ********* 2021-05-26T16:37:12.997 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-05-26T16:37:12.999 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.020 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.049) 0:04:11.548 ********* 2021-05-26T16:37:13.058 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-05-26T16:37:13.059 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-05-26T16:37:13.082 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.061) 0:04:11.610 ********* 2021-05-26T16:37:13.102 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.020) 0:04:11.631 ********* 2021-05-26T16:37:13.120 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-05-26T16:37:13.121 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930278141952, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227118687, 'block_used': 12976421, 'inode_total': 61054976, 'inode_available': 60985798, 'inode_used': 69178, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227118687, "block_size": 4096, "block_total": 240095108, "block_used": 12976421, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985798, "inode_total": 61054976, "inode_used": 69178, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930278141952, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.144 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.041) 0:04:11.673 ********* 2021-05-26T16:37:13.151 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-05-26T16:37:13.153 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.175 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.031) 0:04:11.704 ********* 2021-05-26T16:37:13.181 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-05-26T16:37:13.183 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.209 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.034) 0:04:11.738 ********* 2021-05-26T16:37:13.215 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-05-26T16:37:13.218 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.240 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.030) 0:04:11.769 ********* 2021-05-26T16:37:13.251 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:13.254 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.276 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.035) 0:04:11.804 ********* 2021-05-26T16:37:13.283 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-05-26T16:37:13.285 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.306 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.029) 0:04:11.834 ********* 2021-05-26T16:37:13.312 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:13.314 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.338 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.032) 0:04:11.866 ********* 2021-05-26T16:37:13.346 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-05-26T16:37:13.348 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.372 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.034) 0:04:11.901 ********* 2021-05-26T16:37:13.379 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-05-26T16:37:13.381 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.404 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.031) 0:04:11.932 ********* 2021-05-26T16:37:13.431 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.454 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.049) 0:04:11.982 ********* 2021-05-26T16:37:13.480 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-05-26T16:37:13.482 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:13.502 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.049) 0:04:12.031 ********* 2021-05-26T16:37:13.832 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-05-26T16:37:13.834 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-05-26T16:37:13.855 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.352) 0:04:12.384 ********* 2021-05-26T16:37:13.937 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-05-26T16:37:13.939 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-05-26T16:37:13.962 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:13 +0000 (0:00:00.106) 0:04:12.491 ********* 2021-05-26T16:37:14.148 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-05-26T16:37:14.150 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-05-26 16:32:47 UTC", "ActiveEnterTimestampMonotonic": "12366322", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service basic.target systemd-tmpfiles-setup.service systemd-journald.socket ntpdate.service -.mount sntp.service tmp.mount sysinit.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-05-26 16:32:47 UTC", "AssertTimestampMonotonic": "11771395", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-05-26 16:32:47 UTC", "ConditionTimestampMonotonic": "11771339", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGro 2021-05-26T16:37:14.151 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "893", "ExecMainStartTimestamp": "Wed 2021-05-26 16:32:47 UTC", "ExecMainStartTimestampMonotonic": "12275052", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-05-26 16:32:47 UTC", "InactiveExitTimestampMonotonic": "11915595", "InvocationID": "59a0c17465be428c9f9702d3c7530047", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity" 2021-05-26T16:37:14.154 INFO:teuthology.task.ansible.out:, "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127253", "LimitNPROCSoft": "127253", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127253", "LimitSIGPENDINGSoft": "127253", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "893", "MemoryAccounting": "yes", "MemoryCurrent": "3530752", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no 2021-05-26T16:37:14.156 INFO:teuthology.task.ansible.out:", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-05-26 16:32:47 UTC", "StateChangeTimestampMonotonic": "12366322", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203604", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-05-26 16:32:47 UTC", "WatchdogTimestampMonotonic": "12275063", "WatchdogUSec": "0"}} 2021-05-26T16:37:14.175 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:14 +0000 (0:00:00.212) 0:04:12.703 ********* 2021-05-26T16:37:14.203 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:14.205 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-05-26T16:37:14.226 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:14 +0000 (0:00:00.050) 0:04:12.754 ********* 2021-05-26T16:37:14.265 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:14.267 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-05-26T16:37:14.299 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:14 +0000 (0:00:00.073) 0:04:12.828 ********* 2021-05-26T16:37:14.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-05-26T16:37:14.331 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:14.361 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:14 +0000 (0:00:00.061) 0:04:12.889 ********* 2021-05-26T16:37:14.368 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-05-26T16:37:14.369 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:14.392 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:14.414 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:14 +0000 (0:00:00.053) 0:04:12.943 ********* 2021-05-26T16:37:14.452 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-05-26T16:37:14.454 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:14.478 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:14 +0000 (0:00:00.063) 0:04:13.006 ********* 2021-05-26T16:37:14.670 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-05-26T16:37:14.672 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-05-26T16:37:14.693 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:14 +0000 (0:00:00.215) 0:04:13.222 ********* 2021-05-26T16:37:14.700 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-05-26T16:37:14.700 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:15.034 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:15.159 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-05-26T16:37:15.160 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-05-26T16:37:15.181 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:15 +0000 (0:00:00.488) 0:04:13.710 ********* 2021-05-26T16:37:15.366 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-05-26T16:37:15.368 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:15.703 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-05-26T16:37:15.728 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:15 +0000 (0:00:00.546) 0:04:14.256 ********* 2021-05-26T16:37:15.921 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-05-26T16:37:15.923 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-05-26T16:37:15.945 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:15 +0000 (0:00:00.217) 0:04:14.473 ********* 2021-05-26T16:37:16.160 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:16.340 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:16.383 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-05-26T16:37:16.386 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-05-26T16:37:16.406 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.461) 0:04:14.935 ********* 2021-05-26T16:37:16.434 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-05-26T16:37:16.436 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:16.456 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.049) 0:04:14.985 ********* 2021-05-26T16:37:16.483 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-05-26T16:37:16.485 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-05-26T16:37:16.506 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.049) 0:04:15.034 ********* 2021-05-26T16:37:16.523 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-05-26T16:37:16.525 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:16.680 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-05-26T16:37:16.703 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.197) 0:04:15.231 ********* 2021-05-26T16:37:16.711 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-05-26T16:37:16.711 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-05-26T16:37:16.713 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:16.737 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.034) 0:04:15.266 ********* 2021-05-26T16:37:16.744 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-05-26T16:37:16.746 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:16.768 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.030) 0:04:15.296 ********* 2021-05-26T16:37:16.774 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-05-26T16:37:16.776 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:16.801 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.033) 0:04:15.329 ********* 2021-05-26T16:37:16.808 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-05-26T16:37:16.809 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-05-26T16:37:16.831 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.030) 0:04:15.359 ********* 2021-05-26T16:37:16.837 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-05-26T16:37:16.838 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:16.861 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.030) 0:04:15.390 ********* 2021-05-26T16:37:16.868 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-05-26T16:37:16.870 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:16.891 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:16 +0000 (0:00:00.029) 0:04:15.420 ********* 2021-05-26T16:37:17.063 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-05-26T16:37:17.065 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:37:17.086 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.194) 0:04:15.614 ********* 2021-05-26T16:37:17.094 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-05-26T16:37:17.096 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-05-26T16:37:17.119 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.032) 0:04:15.647 ********* 2021-05-26T16:37:17.126 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-05-26T16:37:17.127 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-05-26T16:37:17.152 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.032) 0:04:15.680 ********* 2021-05-26T16:37:17.305 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-05-26T16:37:17.307 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-05-26T16:37:17.329 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.177) 0:04:15.857 ********* 2021-05-26T16:37:17.359 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-05-26T16:37:17.361 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.381 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.052) 0:04:15.910 ********* 2021-05-26T16:37:17.419 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-05-26T16:37:17.421 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.430 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.432 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.455 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.074) 0:04:15.984 ********* 2021-05-26T16:37:17.462 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-05-26T16:37:17.463 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true} 2021-05-26T16:37:17.487 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.031) 0:04:16.015 ********* 2021-05-26T16:37:17.494 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-05-26T16:37:17.496 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.506 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.507 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.509 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi137.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.533 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.046) 0:04:16.061 ********* 2021-05-26T16:37:17.560 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:17.562 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.585 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.051) 0:04:16.113 ********* 2021-05-26T16:37:17.611 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-05-26T16:37:17.614 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.634 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.049) 0:04:16.163 ********* 2021-05-26T16:37:17.661 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-05-26T16:37:17.664 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.686 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.051) 0:04:16.214 ********* 2021-05-26T16:37:17.723 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.749 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.062) 0:04:16.277 ********* 2021-05-26T16:37:17.778 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-05-26T16:37:17.780 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.810 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.061) 0:04:16.339 ********* 2021-05-26T16:37:17.850 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-05-26T16:37:17.852 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.879 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.068) 0:04:16.407 ********* 2021-05-26T16:37:17.905 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-05-26T16:37:17.907 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.929 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.050) 0:04:16.458 ********* 2021-05-26T16:37:17.956 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-05-26T16:37:17.958 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:17.977 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:17 +0000 (0:00:00.048) 0:04:16.506 ********* 2021-05-26T16:37:18.195 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-05-26T16:37:18.197 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004818", "end": "2021-05-26 16:37:18.159555", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-05-26 16:37:18.154737", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:18.361 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003044", "end": "2021-05-26 16:37:18.332124", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-05-26 16:37:18.329080", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:18.529 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002718", "end": "2021-05-26 16:37:18.500513", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-05-26 16:37:18.497795", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:18.696 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003182", "end": "2021-05-26 16:37:18.667883", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-05-26 16:37:18.664701", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:18.719 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:18 +0000 (0:00:00.741) 0:04:17.247 ********* 2021-05-26T16:37:18.745 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-05-26T16:37:18.767 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:18 +0000 (0:00:00.047) 0:04:17.295 ********* 2021-05-26T16:37:18.792 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-05-26T16:37:18.794 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-05-26T16:37:18.815 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:18 +0000 (0:00:00.048) 0:04:17.344 ********* 2021-05-26T16:37:18.855 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:18.876 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:18 +0000 (0:00:00.060) 0:04:17.405 ********* 2021-05-26T16:37:18.902 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-05-26T16:37:18.904 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:18.925 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:18 +0000 (0:00:00.048) 0:04:17.453 ********* 2021-05-26T16:37:18.951 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-05-26T16:37:18.953 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:18.973 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:18 +0000 (0:00:00.047) 0:04:17.501 ********* 2021-05-26T16:37:18.999 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-05-26T16:37:19.000 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.021 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.048) 0:04:17.549 ********* 2021-05-26T16:37:19.047 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-05-26T16:37:19.049 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.069 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.048) 0:04:17.598 ********* 2021-05-26T16:37:19.096 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-05-26T16:37:19.098 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.119 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.049) 0:04:17.647 ********* 2021-05-26T16:37:19.145 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-05-26T16:37:19.147 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.166 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.047) 0:04:17.695 ********* 2021-05-26T16:37:19.192 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-05-26T16:37:19.194 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.214 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.047) 0:04:17.743 ********* 2021-05-26T16:37:19.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-05-26T16:37:19.242 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.262 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.047) 0:04:17.790 ********* 2021-05-26T16:37:19.299 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-05-26T16:37:19.301 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.326 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.063) 0:04:17.854 ********* 2021-05-26T16:37:19.353 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-05-26T16:37:19.355 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.374 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.048) 0:04:17.903 ********* 2021-05-26T16:37:19.403 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-05-26T16:37:19.405 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.425 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.050) 0:04:17.954 ********* 2021-05-26T16:37:19.451 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-05-26T16:37:19.453 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.473 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.048) 0:04:18.002 ********* 2021-05-26T16:37:19.500 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.522 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.048) 0:04:18.051 ********* 2021-05-26T16:37:19.549 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-05-26T16:37:19.551 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:19.569 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:19 +0000 (0:00:00.047) 0:04:18.098 ********* 2021-05-26T16:37:20.041 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-05-26T16:37:20.043 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-05-26T16:37:20.063 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.493) 0:04:18.592 ********* 2021-05-26T16:37:20.372 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-05-26T16:37:20.373 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-05-26 16:32:38 UTC", "ActiveEnterTimestampMonotonic": "15632581", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target sntp.service -.mount basic.target tmp.mount systemd-tmpfiles-setup.service system.slice ntpd.service ntpdate.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-05-26 16:32:36 UTC", "AssertTimestampMonotonic": "14475646", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-05-26 16:32:36 UTC", "ConditionTimestampMonotonic": "14475580", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGro 2021-05-26T16:37:20.375 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "902", "ExecMainStartTimestamp": "Wed 2021-05-26 16:32:36 UTC", "ExecMainStartTimestampMonotonic": "14602437", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-05-26 16:32:36 UTC", "InactiveExitTimestampMonotonic": "14499393", "InvocationID": "2e2e2f0e7ba144f89953c45f3f5378f1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity" 2021-05-26T16:37:20.376 INFO:teuthology.task.ansible.out:, "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127277", "LimitNPROCSoft": "127277", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127277", "LimitSIGPENDINGSoft": "127277", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "902", "MemoryAccounting": "yes", "MemoryCurrent": "3657728", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no 2021-05-26T16:37:20.378 INFO:teuthology.task.ansible.out:", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-05-26 16:32:38 UTC", "StateChangeTimestampMonotonic": "15632581", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203643", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-05-26 16:32:36 UTC", "WatchdogTimestampMonotonic": "14602459", "WatchdogUSec": "0"}} 2021-05-26T16:37:20.396 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.333) 0:04:18.925 ********* 2021-05-26T16:37:20.423 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:20.425 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-05-26T16:37:20.445 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.048) 0:04:18.973 ********* 2021-05-26T16:37:20.482 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:20.484 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-05-26T16:37:20.504 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.059) 0:04:19.033 ********* 2021-05-26T16:37:20.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:20.553 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.049) 0:04:19.082 ********* 2021-05-26T16:37:20.580 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:20.601 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.047) 0:04:19.129 ********* 2021-05-26T16:37:20.627 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-05-26T16:37:20.629 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:20.648 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.047) 0:04:19.177 ********* 2021-05-26T16:37:20.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-05-26T16:37:20.853 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-05-26T16:37:20.873 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:20 +0000 (0:00:00.224) 0:04:19.402 ********* 2021-05-26T16:37:21.357 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-05-26T16:37:21.359 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-05-26T16:37:21.383 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:21 +0000 (0:00:00.509) 0:04:19.911 ********* 2021-05-26T16:37:22.449 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-05-26T16:37:22.451 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-05-26T16:37:22.471 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:22 +0000 (0:00:01.088) 0:04:21.000 ********* 2021-05-26T16:37:22.498 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-05-26T16:37:22.499 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:22.520 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:22 +0000 (0:00:00.048) 0:04:21.048 ********* 2021-05-26T16:37:22.546 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-05-26T16:37:22.548 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-05-26T16:37:22.568 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:22 +0000 (0:00:00.048) 0:04:21.097 ********* 2021-05-26T16:37:22.751 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-05-26T16:37:22.753 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-05-26T16:37:22.774 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:22 +0000 (0:00:00.205) 0:04:21.302 ********* 2021-05-26T16:37:22.801 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-05-26T16:37:22.802 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:22.823 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:22 +0000 (0:00:00.049) 0:04:21.352 ********* 2021-05-26T16:37:22.850 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-05-26T16:37:22.852 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-05-26T16:37:22.871 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:22 +0000 (0:00:00.048) 0:04:21.400 ********* 2021-05-26T16:37:22.898 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:22.920 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:22 +0000 (0:00:00.048) 0:04:21.449 ********* 2021-05-26T16:37:23.116 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-05-26T16:37:23.118 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-05-26T16:37:23.150 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.229) 0:04:21.678 ********* 2021-05-26T16:37:23.345 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-05-26T16:37:23.347 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-05-26T16:37:23.369 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.219) 0:04:21.897 ********* 2021-05-26T16:37:23.396 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-05-26T16:37:23.398 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.419 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.049) 0:04:21.947 ********* 2021-05-26T16:37:23.457 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-05-26T16:37:23.458 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.468 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.469 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.506 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.087) 0:04:22.035 ********* 2021-05-26T16:37:23.544 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-05-26T16:37:23.546 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.556 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.557 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.580 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.073) 0:04:22.108 ********* 2021-05-26T16:37:23.607 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-05-26T16:37:23.608 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.630 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.050) 0:04:22.159 ********* 2021-05-26T16:37:23.658 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-05-26T16:37:23.660 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.679 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.048) 0:04:22.208 ********* 2021-05-26T16:37:23.706 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.729 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.049) 0:04:22.257 ********* 2021-05-26T16:37:23.755 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-05-26T16:37:23.757 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.777 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.047) 0:04:22.305 ********* 2021-05-26T16:37:23.804 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-05-26T16:37:23.805 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.828 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.050) 0:04:22.356 ********* 2021-05-26T16:37:23.855 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-05-26T16:37:23.857 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.879 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.051) 0:04:22.408 ********* 2021-05-26T16:37:23.907 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-05-26T16:37:23.909 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.930 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.051) 0:04:22.459 ********* 2021-05-26T16:37:23.957 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-05-26T16:37:23.959 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:23.978 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:23 +0000 (0:00:00.047) 0:04:22.507 ********* 2021-05-26T16:37:24.191 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-05-26T16:37:24.193 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005380", "end": "2021-05-26 16:37:24.164355", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-05-26 16:37:24.158975", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:24.367 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003160", "end": "2021-05-26 16:37:24.340655", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-05-26 16:37:24.337495", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:24.544 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003036", "end": "2021-05-26 16:37:24.515368", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-05-26 16:37:24.512332", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:24.720 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003424", "end": "2021-05-26 16:37:24.689941", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-05-26 16:37:24.686517", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:24.742 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:24 +0000 (0:00:00.764) 0:04:23.271 ********* 2021-05-26T16:37:24.768 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-05-26T16:37:24.790 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:24 +0000 (0:00:00.047) 0:04:23.319 ********* 2021-05-26T16:37:24.817 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-05-26T16:37:24.818 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:24.888 INFO:teuthology.task.ansible.out: 2021-05-26T16:37:24.890 INFO:teuthology.task.ansible.out:PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-05-26T16:37:24.914 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:24 +0000 (0:00:00.124) 0:04:23.443 ********* 2021-05-26T16:37:24.935 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:24 +0000 (0:00:00.020) 0:04:23.463 ********* 2021-05-26T16:37:25.558 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi003.front.sepia.ceph.com] 2021-05-26T16:37:25.606 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:25 +0000 (0:00:00.671) 0:04:24.134 ********* 2021-05-26T16:37:25.634 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-05-26T16:37:25.635 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:25.658 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:25 +0000 (0:00:00.051) 0:04:24.186 ********* 2021-05-26T16:37:25.697 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-05-26T16:37:25.699 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-05-26T16:37:25.724 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:25 +0000 (0:00:00.066) 0:04:24.252 ********* 2021-05-26T16:37:25.761 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-05-26T16:37:25.763 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-05-26T16:37:25.786 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:25 +0000 (0:00:00.062) 0:04:24.314 ********* 2021-05-26T16:37:26.588 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi137.front.sepia.ceph.com] 2021-05-26T16:37:26.636 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:26 +0000 (0:00:00.849) 0:04:25.164 ********* 2021-05-26T16:37:26.664 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:26.685 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:26 +0000 (0:00:00.049) 0:04:25.214 ********* 2021-05-26T16:37:26.722 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-05-26T16:37:26.724 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-05-26T16:37:26.745 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:26 +0000 (0:00:00.059) 0:04:25.273 ********* 2021-05-26T16:37:26.782 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-05-26T16:37:26.784 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-05-26T16:37:26.804 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:26 +0000 (0:00:00.059) 0:04:25.333 ********* 2021-05-26T16:37:27.205 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-05-26T16:37:27.207 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:37:27.241 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:27 +0000 (0:00:00.436) 0:04:25.770 ********* 2021-05-26T16:37:27.272 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-05-26T16:37:27.274 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-05-26T16:37:27.304 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:27 +0000 (0:00:00.062) 0:04:25.832 ********* 2021-05-26T16:37:27.331 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-05-26T16:37:27.333 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:27.354 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:27 +0000 (0:00:00.050) 0:04:25.882 ********* 2021-05-26T16:37:27.569 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-05-26T16:37:27.571 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:37:27.748 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:37:27.774 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:27 +0000 (0:00:00.420) 0:04:26.302 ********* 2021-05-26T16:37:28.158 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-05-26T16:37:28.160 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-05-26T16:37:28.193 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:28 +0000 (0:00:00.418) 0:04:26.721 ********* 2021-05-26T16:37:28.233 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-05-26T16:37:28.235 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-05-26T16:37:28.257 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:28 +0000 (0:00:00.063) 0:04:26.785 ********* 2021-05-26T16:37:28.284 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-05-26T16:37:28.286 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:28.306 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:28 +0000 (0:00:00.049) 0:04:26.834 ********* 2021-05-26T16:37:28.313 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-05-26T16:37:28.315 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622047047.846733-22788-29105456151310/source", "state": "file", "uid": 0} 2021-05-26T16:37:28.514 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi137.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:37:28.709 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-05-26T16:37:28.732 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:28 +0000 (0:00:00.426) 0:04:27.261 ********* 2021-05-26T16:37:28.805 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-05-26T16:37:28.807 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622047048.344452-22788-229045885544903/source", "state": "file", "uid": 0} 2021-05-26T16:37:28.830 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:28 +0000 (0:00:00.097) 0:04:27.359 ********* 2021-05-26T16:37:29.247 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622047048.8041751-22904-55701630165521/source", "state": "file", "uid": 0} 2021-05-26T16:37:29.727 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1622047049.2811413-22904-118836891067477/source", "state": "file", "uid": 0} 2021-05-26T16:37:29.753 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:29 +0000 (0:00:00.922) 0:04:28.282 ********* 2021-05-26T16:37:32.059 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-05-26T16:37:32.060 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-hc_nghql-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-hc_nghql-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-05-26T16:37:32.062 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-05-26T16:37:32.083 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:32 +0000 (0:00:02.330) 0:04:30.612 ********* 2021-05-26T16:37:32.110 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-05-26T16:37:32.112 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:32.134 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:32 +0000 (0:00:00.050) 0:04:30.663 ********* 2021-05-26T16:37:32.161 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-05-26T16:37:32.162 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:32.183 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:32 +0000 (0:00:00.048) 0:04:30.712 ********* 2021-05-26T16:37:32.553 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-05-26T16:37:32.554 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.169613", "end": "2021-05-26 16:37:32.527120", "rc": 0, "start": "2021-05-26 16:37:32.357507", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:32.575 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:32 +0000 (0:00:00.392) 0:04:31.104 ********* 2021-05-26T16:37:32.603 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-05-26T16:37:32.605 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:32.936 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-05-26T16:37:32.937 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-e_jg3wjt-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-e_jg3wjt-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-05-26T16:37:32.939 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-05-26T16:37:32.957 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:32 +0000 (0:00:00.381) 0:04:31.485 ********* 2021-05-26T16:37:32.983 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-05-26T16:37:32.984 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:33.005 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:33 +0000 (0:00:00.048) 0:04:31.533 ********* 2021-05-26T16:37:33.032 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-05-26T16:37:33.034 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:33.053 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:33 +0000 (0:00:00.048) 0:04:31.582 ********* 2021-05-26T16:37:33.400 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-05-26T16:37:33.401 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.158343", "end": "2021-05-26 16:37:33.381038", "rc": 0, "start": "2021-05-26 16:37:33.222695", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-05-26T16:37:33.422 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:33 +0000 (0:00:00.368) 0:04:31.950 ********* 2021-05-26T16:37:33.449 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-05-26T16:37:33.451 INFO:teuthology.task.ansible.out:skipping: [smithi137.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-05-26T16:37:33.519 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-05-26T16:37:33.520 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-05-26T16:37:33.522 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-05-26T16:37:33.522 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-05-26T16:37:33.536 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-05-26T16:37:33.538 INFO:teuthology.task.ansible.out:Wednesday 26 May 2021 16:37:33 +0000 (0:00:00.114) 0:04:32.065 ********* 2021-05-26T16:37:34.178 INFO:teuthology.task.ansible.out:ok: [smithi137.front.sepia.ceph.com] 2021-05-26T16:37:34.198 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] 2021-05-26T16:37:34.216 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Wednesday 26 May 2021 16:37:34 +0000 (0:00:00.679) 0:04:32.745 ********* 2021-05-26T16:37:34.419 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-05-26T16:37:34.430 INFO:teuthology.task.ansible.out:changed: [smithi137.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-05-26T16:37:34.432 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi003.front.sepia.ceph.com : ok=130 changed=43 unreachable=0 failed=0 skipped=188 rescued=0 ignored=3 2021-05-26T16:37:34.434 INFO:teuthology.task.ansible.out:smithi137.front.sepia.ceph.com : ok=130 changed=43 unreachable=0 failed=0 skipped=188 rescued=0 ignored=3 Wednesday 26 May 2021 16:37:34 +0000 (0:00:00.216) 0:04:32.961 ********* =============================================================================== Create all admin users with sudo access. ------------------------------- 35.64s common : nrpe - Ensure SELinux policy is up to date -------------------- 35.57s users : Update authorized_keys using the keys repo --------------------- 26.72s common : nrpe - Remove SELinux policy package -------------------------- 12.44s common : nrpe - Load SELinux policy package ---------------------------- 11.82s Remove revoked users ---------------------------------------------------- 7.41s testnode : Ensure ceph packages are not present. ------------------------ 3.01s testnode : Ensure ceph dependency packages are not present. ------------- 2.81s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.75s Gathering Facts --------------------------------------------------------- 2.62s container-host : Install registries-conf-ctl ---------------------------- 2.33s testnode : Zap all non-root disks --------------------------------------- 1.95s users : Update authorized_keys for each user with literal keys ---------- 1.69s Gathering Facts --------------------------------------------------------- 1.59s testnode : Make sure rpm dependencies are installed --------------------- 1.52s common : nrpe - Install SELinux dependencies ---------------------------- 1.45s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.45s testnode : Configure local mirrorlists ---------------------------------- 1.44s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.43s common : Install Kerberos Packages (RedHat) ----------------------------- 1.41s 2021-05-26T16:37:34.771 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2021-05-26T16:37:34.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:37:34.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:37:34.848 DEBUG:teuthology.orchestra.run.smithi003:> true 2021-05-26T16:37:34.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T16:37:34.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-05-26T16:37:35.010 DEBUG:teuthology.orchestra.run.smithi137:> true 2021-05-26T16:37:35.104 INFO:teuthology.run_tasks:Running task clock... 2021-05-26T16:37:35.117 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-05-26T16:37:35.118 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-05-26T16:37:35.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-05-26T16:37:35.153 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-05-26T16:37:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-05-26T16:37:35.204 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2021-05-26T16:37:35.214 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2021-05-26T16:37:35.229 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-05-26T16:37:35.243 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-05-26T16:37:35.307 INFO:teuthology.orchestra.run.smithi003.stderr:bash: ntpq: command not found 2021-05-26T16:37:35.309 INFO:teuthology.orchestra.run.smithi003.stdout:210 Number of sources = 4 2021-05-26T16:37:35.394 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-05-26T16:37:35.394 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2021-05-26T16:37:35.395 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.395 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.395 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.395 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.397 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-05-26T16:37:35.397 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-05-26T16:37:35.431 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-05-26T16:37:35.446 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-05-26T16:37:35.482 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2021-05-26T16:37:35.492 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2021-05-26T16:37:35.506 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-05-26T16:37:35.520 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-05-26T16:37:35.583 INFO:teuthology.orchestra.run.smithi137.stderr:bash: ntpq: command not found 2021-05-26T16:37:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:210 Number of sources = 4 2021-05-26T16:37:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-05-26T16:37:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2021-05-26T16:37:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.587 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.587 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.587 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-05-26T16:37:35.588 INFO:teuthology.run_tasks:Running task install... 2021-05-26T16:37:35.599 DEBUG:teuthology.task.install:project ceph 2021-05-26T16:37:35.600 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'ed4edd0b7e1e319db25251072e10833142271766'}} 2021-05-26T16:37:35.600 DEBUG:teuthology.task.install:config {'sha1': 'ed4edd0b7e1e319db25251072e10833142271766'} 2021-05-26T16:37:35.601 INFO:teuthology.task.install:Using flavor: basic 2021-05-26T16:37:35.608 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-05-26T16:37:35.608 INFO:teuthology.task.install:extra packages: [] 2021-05-26T16:37:35.609 DEBUG:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2021-05-26T16:37:35.644 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2021-05-26T16:37:35.645 DEBUG:teuthology.misc:System to be installed: CentOS 2021-05-26T16:37:35.646 DEBUG:teuthology.orchestra.run.smithi137:> sudo lsb_release -is 2021-05-26T16:37:35.647 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ed4edd0b7e1e319db25251072e10833142271766', 'tag': None, 'wait_for_package': False} 2021-05-26T16:37:35.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2021-05-26T16:37:35.681 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS 2021-05-26T16:37:35.682 DEBUG:teuthology.misc:System to be installed: CentOS 2021-05-26T16:37:35.683 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ed4edd0b7e1e319db25251072e10833142271766', 'tag': None, 'wait_for_package': False} 2021-05-26T16:37:35.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo lsb_release -is 2021-05-26T16:37:35.719 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2021-05-26T16:37:35.720 DEBUG:teuthology.misc:System to be installed: CentOS 2021-05-26T16:37:35.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ed4edd0b7e1e319db25251072e10833142271766 2021-05-26T16:37:35.757 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS 2021-05-26T16:37:35.757 DEBUG:teuthology.misc:System to be installed: CentOS 2021-05-26T16:37:35.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ed4edd0b7e1e319db25251072e10833142271766 2021-05-26T16:37:35.879 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/ 2021-05-26T16:37:35.880 INFO:teuthology.task.install.rpm:Package version is 17.0.0-4646.ged4edd0b 2021-05-26T16:37:35.916 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/ 2021-05-26T16:37:35.917 INFO:teuthology.task.install.rpm:Package version is 17.0.0-4646.ged4edd0b 2021-05-26T16:37:36.007 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-05-26T16:37:36.008 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:37:36.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-05-26T16:37:36.034 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-05-26T16:37:36.035 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ed4edd0b7e1e319db25251072e10833142271766/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-05-26T16:37:36.044 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-05-26-1620/ed4edd0b7e1e319db25251072e10833142271766/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-05-26T16:37:36.044 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:37:36.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-05-26T16:37:36.069 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-05-26T16:37:36.069 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ed4edd0b7e1e319db25251072e10833142271766/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-05-26T16:37:36.101 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-05-26T16:37:36.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-05-26T16:37:36.176 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-05-26T16:37:36.207 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-05-26T16:37:36.240 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2021-05-26T16:37:36.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2021-05-26T16:37:36.269 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2021-05-26T16:37:36.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2021-05-26T16:37:36.631 INFO:teuthology.orchestra.run.smithi003.stdout:72 files removed 2021-05-26T16:37:36.651 INFO:teuthology.orchestra.run.smithi137.stdout:72 files removed 2021-05-26T16:37:36.667 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw 2021-05-26T16:37:36.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw 2021-05-26T16:37:37.340 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 311 kB/s | 77 kB 00:00 2021-05-26T16:37:37.343 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 318 kB/s | 77 kB 00:00 2021-05-26T16:37:37.571 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 78 kB/s | 16 kB 00:00 2021-05-26T16:37:37.578 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 77 kB/s | 16 kB 00:00 2021-05-26T16:37:37.793 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 7.2 kB/s | 1.5 kB 00:00 2021-05-26T16:37:37.804 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 7.1 kB/s | 1.5 kB 00:00 2021-05-26T16:37:38.037 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-8 - AppStream 28 MB/s | 6.3 MB 00:00 2021-05-26T16:37:38.105 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - AppStream 22 MB/s | 6.3 MB 00:00 2021-05-26T16:37:39.101 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-8 - Base 26 MB/s | 2.3 MB 00:00 2021-05-26T16:37:39.239 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Base 25 MB/s | 2.3 MB 00:00 2021-05-26T16:37:39.544 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-8 - Extras 153 kB/s | 9.6 kB 00:00 2021-05-26T16:37:39.709 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Extras 149 kB/s | 9.6 kB 00:00 2021-05-26T16:37:40.751 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Linux 8 - AppStream 5.4 MB/s | 6.3 MB 00:01 2021-05-26T16:37:40.925 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - AppStream 5.4 MB/s | 6.3 MB 00:01 2021-05-26T16:37:52.129 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Linux 8 - BaseOS 225 kB/s | 2.3 MB 00:10 2021-05-26T16:37:52.717 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Linux 8 - Extras 47 kB/s | 9.6 kB 00:00 2021-05-26T16:37:53.447 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 14 MB/s | 9.4 MB 00:00 2021-05-26T16:37:55.462 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-05-26T16:37:57.142 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:37:57.158 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:37:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:37:57.159 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:37:57.159 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:37:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 11 M 2021-05-26T16:37:57.159 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2021-05-26T16:37:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.4 M 2021-05-26T16:37:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.8 M 2021-05-26T16:37:57.160 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:37:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 5.4 M 2021-05-26T16:37:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 19 M 2021-05-26T16:37:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 23 k 2021-05-26T16:37:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-05-26T16:37:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-05-26T16:37:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-05-26T16:37:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 756 k 2021-05-26T16:37:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-05-26T16:37:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-05-26T16:37:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 457 k 2021-05-26T16:37:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-05-26T16:37:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.9 M 2021-05-26T16:37:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-05-26T16:37:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-05-26T16:37:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse 2021-05-26T16:37:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 43 k 2021-05-26T16:37:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 77 k 2021-05-26T16:37:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 178 k 2021-05-26T16:37:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-05-26T16:37:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 364 k 2021-05-26T16:37:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 345 k 2021-05-26T16:37:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 109 k 2021-05-26T16:37:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:37:57.166 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:37:57.167 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:37:57.167 INFO:teuthology.orchestra.run.smithi137.stdout:Install 22 Packages 2021-05-26T16:37:57.167 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 2 Packages 2021-05-26T16:37:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:37:57.168 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 50 M 2021-05-26T16:37:57.168 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:37:57.864 INFO:teuthology.orchestra.run.smithi137.stdout:(1/24): ceph-base-17.0.0-4646.ged4edd0b.el8.x86 7.7 MB/s | 5.4 MB 00:00 2021-05-26T16:37:57.922 INFO:teuthology.orchestra.run.smithi137.stdout:(2/24): ceph-selinux-17.0.0-4646.ged4edd0b.el8. 409 kB/s | 23 kB 00:00 2021-05-26T16:37:58.121 INFO:teuthology.orchestra.run.smithi137.stdout:(3/24): libcephfs2-17.0.0-4646.ged4edd0b.el8.x8 3.7 MB/s | 756 kB 00:00 2021-05-26T16:37:58.182 INFO:teuthology.orchestra.run.smithi137.stdout:(4/24): libradosstriper1-17.0.0-4646.ged4edd0b. 7.3 MB/s | 457 kB 00:00 2021-05-26T16:37:58.408 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - BaseOS 142 kB/s | 2.3 MB 00:16 2021-05-26T16:37:58.664 INFO:teuthology.orchestra.run.smithi137.stdout:(5/24): ceph-radosgw-17.0.0-4646.ged4edd0b.el8. 7.1 MB/s | 11 MB 00:01 2021-05-26T16:37:58.679 INFO:teuthology.orchestra.run.smithi137.stdout:(6/24): librgw2-17.0.0-4646.ged4edd0b.el8.x86_6 7.8 MB/s | 3.9 MB 00:00 2021-05-26T16:37:58.699 INFO:teuthology.orchestra.run.smithi137.stdout:(7/24): python3-ceph-argparse-17.0.0-4646.ged4e 1.2 MB/s | 43 kB 00:00 2021-05-26T16:37:58.712 INFO:teuthology.orchestra.run.smithi137.stdout:(8/24): python3-ceph-common-17.0.0-4646.ged4edd 2.3 MB/s | 77 kB 00:00 2021-05-26T16:37:58.842 INFO:teuthology.orchestra.run.smithi137.stdout:(9/24): ceph-common-17.0.0-4646.ged4edd0b.el8.x 11 MB/s | 19 MB 00:01 2021-05-26T16:37:58.843 INFO:teuthology.orchestra.run.smithi137.stdout:(10/24): python3-cephfs-17.0.0-4646.ged4edd0b.e 1.2 MB/s | 178 kB 00:00 2021-05-26T16:37:58.845 INFO:teuthology.orchestra.run.smithi137.stdout:(11/24): python3-rados-17.0.0-4646.ged4edd0b.el 2.7 MB/s | 364 kB 00:00 2021-05-26T16:37:58.886 INFO:teuthology.orchestra.run.smithi137.stdout:(12/24): python3-rbd-17.0.0-4646.ged4edd0b.el8. 7.7 MB/s | 345 kB 00:00 2021-05-26T16:37:58.893 INFO:teuthology.orchestra.run.smithi137.stdout:(13/24): python3-rgw-17.0.0-4646.ged4edd0b.el8. 2.2 MB/s | 109 kB 00:00 2021-05-26T16:37:58.894 INFO:teuthology.orchestra.run.smithi137.stdout:(14/24): librdkafka-0.11.4-1.el8.x86_64.rpm 7.1 MB/s | 353 kB 00:00 2021-05-26T16:37:58.895 INFO:teuthology.orchestra.run.smithi137.stdout:(15/24): python3-prettytable-0.7.2-14.el8.noarc 25 MB/s | 44 kB 00:00 2021-05-26T16:37:58.926 INFO:teuthology.orchestra.run.smithi137.stdout:(16/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.3 MB/s | 259 kB 00:00 2021-05-26T16:37:58.927 INFO:teuthology.orchestra.run.smithi137.stdout:(17/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2021-05-26T16:37:59.001 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - Extras 49 kB/s | 9.6 kB 00:00 2021-05-26T16:37:59.009 INFO:teuthology.orchestra.run.smithi137.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 1.0 MB/s | 116 kB 00:00 2021-05-26T16:37:59.032 INFO:teuthology.orchestra.run.smithi137.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 2.5 MB/s | 59 kB 00:00 2021-05-26T16:37:59.040 INFO:teuthology.orchestra.run.smithi137.stdout:(20/24): leveldb-1.22-1.el8.x86_64.rpm 1.6 MB/s | 181 kB 00:00 2021-05-26T16:37:59.054 INFO:teuthology.orchestra.run.smithi137.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.3 MB/s | 75 kB 00:00 2021-05-26T16:37:59.062 INFO:teuthology.orchestra.run.smithi137.stdout:(22/24): gperftools-libs-2.7-9.el8.x86_64.rpm 2.2 MB/s | 306 kB 00:00 2021-05-26T16:37:59.276 INFO:teuthology.orchestra.run.smithi137.stdout:(23/24): librbd1-17.0.0-4646.ged4edd0b.el8.x86_ 17 MB/s | 3.8 MB 00:00 2021-05-26T16:37:59.332 INFO:teuthology.orchestra.run.smithi137.stdout:(24/24): librados2-17.0.0-4646.ged4edd0b.el8.x8 11 MB/s | 3.4 MB 00:00 2021-05-26T16:37:59.336 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:37:59.336 INFO:teuthology.orchestra.run.smithi137.stdout:Total 23 MB/s | 50 MB 00:02 2021-05-26T16:37:59.340 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:37:59.384 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:37:59.385 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:37:59.671 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 15 MB/s | 9.4 MB 00:00 2021-05-26T16:37:59.816 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:37:59.819 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:38:00.954 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:38:01.132 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-05-26T16:38:01.325 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2021-05-26T16:38:01.526 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-05-26T16:38:01.761 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-05-26T16:38:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-05-26T16:38:02.151 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/26 2021-05-26T16:38:02.246 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/26 2021-05-26T16:38:02.500 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 5/26 2021-05-26T16:38:02.710 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/26 2021-05-26T16:38:03.157 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/26 2021-05-26T16:38:03.309 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/26 2021-05-26T16:38:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/26 2021-05-26T16:38:03.498 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:38:03.546 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:38:03.546 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:38:03.546 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:38:03.547 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:38:03.547 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 11 M 2021-05-26T16:38:03.547 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2021-05-26T16:38:03.547 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.4 M 2021-05-26T16:38:03.548 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.8 M 2021-05-26T16:38:03.548 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:38:03.548 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 5.4 M 2021-05-26T16:38:03.548 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 19 M 2021-05-26T16:38:03.548 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 23 k 2021-05-26T16:38:03.549 INFO:teuthology.orchestra.run.smithi003.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-05-26T16:38:03.549 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-05-26T16:38:03.549 INFO:teuthology.orchestra.run.smithi003.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-05-26T16:38:03.549 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 756 k 2021-05-26T16:38:03.550 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-05-26T16:38:03.550 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-05-26T16:38:03.550 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 457 k 2021-05-26T16:38:03.550 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-05-26T16:38:03.550 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.9 M 2021-05-26T16:38:03.551 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-05-26T16:38:03.551 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-05-26T16:38:03.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse 2021-05-26T16:38:03.551 INFO:teuthology.orchestra.run.smithi003.stdout: x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 43 k 2021-05-26T16:38:03.552 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 77 k 2021-05-26T16:38:03.552 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 178 k 2021-05-26T16:38:03.552 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-05-26T16:38:03.552 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 364 k 2021-05-26T16:38:03.552 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 345 k 2021-05-26T16:38:03.553 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 109 k 2021-05-26T16:38:03.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:03.553 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:38:03.553 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:38:03.553 INFO:teuthology.orchestra.run.smithi003.stdout:Install 22 Packages 2021-05-26T16:38:03.554 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 2 Packages 2021-05-26T16:38:03.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:03.555 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 50 M 2021-05-26T16:38:03.555 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:38:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-05-26T16:38:03.727 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-05-26T16:38:04.154 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-05-26T16:38:04.213 INFO:teuthology.orchestra.run.smithi003.stdout:(1/24): ceph-base-17.0.0-4646.ged4edd0b.el8.x86 8.2 MB/s | 5.4 MB 00:00 2021-05-26T16:38:04.250 INFO:teuthology.orchestra.run.smithi003.stdout:(2/24): ceph-selinux-17.0.0-4646.ged4edd0b.el8. 629 kB/s | 23 kB 00:00 2021-05-26T16:38:04.317 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 10/26 2021-05-26T16:38:04.352 INFO:teuthology.orchestra.run.smithi003.stdout:(3/24): libcephfs2-17.0.0-4646.ged4edd0b.el8.x8 7.3 MB/s | 756 kB 00:00 2021-05-26T16:38:04.408 INFO:teuthology.orchestra.run.smithi003.stdout:(4/24): libradosstriper1-17.0.0-4646.ged4edd0b. 8.1 MB/s | 457 kB 00:00 2021-05-26T16:38:04.433 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 10/26 2021-05-26T16:38:04.598 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-05-26T16:38:04.702 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:17.0.0-4646.ged4edd0b.el8. 12/26 2021-05-26T16:38:04.865 INFO:teuthology.orchestra.run.smithi003.stdout:(5/24): librgw2-17.0.0-4646.ged4edd0b.el8.x86_6 8.5 MB/s | 3.9 MB 00:00 2021-05-26T16:38:04.910 INFO:teuthology.orchestra.run.smithi003.stdout:(6/24): python3-ceph-argparse-17.0.0-4646.ged4e 985 kB/s | 43 kB 00:00 2021-05-26T16:38:04.954 INFO:teuthology.orchestra.run.smithi003.stdout:(7/24): python3-ceph-common-17.0.0-4646.ged4edd 1.7 MB/s | 77 kB 00:00 2021-05-26T16:38:05.002 INFO:teuthology.orchestra.run.smithi003.stdout:(8/24): python3-cephfs-17.0.0-4646.ged4edd0b.el 3.6 MB/s | 178 kB 00:00 2021-05-26T16:38:05.058 INFO:teuthology.orchestra.run.smithi003.stdout:(9/24): python3-rados-17.0.0-4646.ged4edd0b.el8 6.4 MB/s | 364 kB 00:00 2021-05-26T16:38:05.088 INFO:teuthology.orchestra.run.smithi003.stdout:(10/24): ceph-radosgw-17.0.0-4646.ged4edd0b.el8 7.0 MB/s | 11 MB 00:01 2021-05-26T16:38:05.096 INFO:teuthology.orchestra.run.smithi003.stdout:(11/24): python3-rbd-17.0.0-4646.ged4edd0b.el8. 8.8 MB/s | 345 kB 00:00 2021-05-26T16:38:05.131 INFO:teuthology.orchestra.run.smithi003.stdout:(12/24): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2021-05-26T16:38:05.132 INFO:teuthology.orchestra.run.smithi003.stdout:(13/24): python3-rgw-17.0.0-4646.ged4edd0b.el8. 2.5 MB/s | 109 kB 00:00 2021-05-26T16:38:05.139 INFO:teuthology.orchestra.run.smithi003.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 31 MB/s | 259 kB 00:00 2021-05-26T16:38:05.141 INFO:teuthology.orchestra.run.smithi003.stdout:(15/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 32 MB/s | 47 kB 00:00 2021-05-26T16:38:05.288 INFO:teuthology.orchestra.run.smithi003.stdout:(16/24): ceph-common-17.0.0-4646.ged4edd0b.el8. 11 MB/s | 19 MB 00:01 2021-05-26T16:38:05.291 INFO:teuthology.orchestra.run.smithi003.stdout:(17/24): python3-prettytable-0.7.2-14.el8.noarc 274 kB/s | 44 kB 00:00 2021-05-26T16:38:05.296 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 13/26 2021-05-26T16:38:05.395 INFO:teuthology.orchestra.run.smithi003.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 457 kB/s | 116 kB 00:00 2021-05-26T16:38:05.402 INFO:teuthology.orchestra.run.smithi003.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 1.6 MB/s | 181 kB 00:00 2021-05-26T16:38:05.423 INFO:teuthology.orchestra.run.smithi003.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 2.2 MB/s | 306 kB 00:00 2021-05-26T16:38:05.423 INFO:teuthology.orchestra.run.smithi003.stdout:(21/24): liboath-2.6.2-3.el8.x86_64.rpm 2.1 MB/s | 59 kB 00:00 2021-05-26T16:38:05.425 INFO:teuthology.orchestra.run.smithi003.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.2 MB/s | 75 kB 00:00 2021-05-26T16:38:05.485 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 14/26 2021-05-26T16:38:05.673 INFO:teuthology.orchestra.run.smithi003.stdout:(23/24): librbd1-17.0.0-4646.ged4edd0b.el8.x86_ 15 MB/s | 3.8 MB 00:00 2021-05-26T16:38:05.705 INFO:teuthology.orchestra.run.smithi003.stdout:(24/24): librados2-17.0.0-4646.ged4edd0b.el8.x8 12 MB/s | 3.4 MB 00:00 2021-05-26T16:38:05.709 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:38:05.709 INFO:teuthology.orchestra.run.smithi003.stdout:Total 23 MB/s | 50 MB 00:02 2021-05-26T16:38:05.713 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:38:05.728 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 15/26 2021-05-26T16:38:05.763 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:38:05.763 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:38:05.892 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_6 16/26 2021-05-26T16:38:05.980 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_6 16/26 2021-05-26T16:38:06.160 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:38:06.183 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2021-05-26T16:38:06.183 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:38:06.351 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2021-05-26T16:38:06.516 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-05-26T16:38:06.709 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:17.0.0-4646.ged4edd0b.el8.x8 20/26 2021-05-26T16:38:07.324 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:38:07.466 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-05-26T16:38:07.662 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2021-05-26T16:38:07.862 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-05-26T16:38:08.293 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-05-26T16:38:08.520 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/26 2021-05-26T16:38:08.621 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/26 2021-05-26T16:38:08.840 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 5/26 2021-05-26T16:38:09.028 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/26 2021-05-26T16:38:09.503 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/26 2021-05-26T16:38:09.645 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/26 2021-05-26T16:38:09.717 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/26 2021-05-26T16:38:09.913 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-05-26T16:38:10.045 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-05-26T16:38:10.489 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-05-26T16:38:10.738 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 21/26 2021-05-26T16:38:10.958 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 21/26 2021-05-26T16:38:11.186 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 10/26 2021-05-26T16:38:11.283 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 10/26 2021-05-26T16:38:11.402 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-05-26T16:38:11.549 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:17.0.0-4646.ged4edd0b.el8. 12/26 2021-05-26T16:38:11.686 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 21/26 2021-05-26T16:38:11.741 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 13/26 2021-05-26T16:38:11.908 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 22/26 2021-05-26T16:38:11.932 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 14/26 2021-05-26T16:38:12.032 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 22/26 2021-05-26T16:38:12.117 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 15/26 2021-05-26T16:38:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 23/26 2021-05-26T16:38:12.311 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_6 16/26 2021-05-26T16:38:12.386 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_6 16/26 2021-05-26T16:38:12.583 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2021-05-26T16:38:12.730 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2021-05-26T16:38:12.906 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-05-26T16:38:13.070 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:17.0.0-4646.ged4edd0b.el8.x8 20/26 2021-05-26T16:38:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 21/26 2021-05-26T16:38:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 21/26 2021-05-26T16:38:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 21/26 2021-05-26T16:38:18.662 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 22/26 2021-05-26T16:38:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 22/26 2021-05-26T16:38:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 23/26 2021-05-26T16:38:29.103 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 23/26 2021-05-26T16:38:29.103 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2021-05-26T16:38:29.103 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2021-05-26T16:38:29.104 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /dev 2021-05-26T16:38:29.104 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /run 2021-05-26T16:38:29.104 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2021-05-26T16:38:29.104 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2021-05-26T16:38:29.105 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2021-05-26T16:38:29.105 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2021-05-26T16:38:29.105 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /dev 2021-05-26T16:38:29.105 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:30.371 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 24/26 2021-05-26T16:38:30.446 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 24/26 2021-05-26T16:38:30.447 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-05-26T16:38:30.657 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-05-26T16:38:30.657 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-05-26T16:38:31.405 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-05-26T16:38:31.405 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/26 2021-05-26T16:38:31.406 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/26 2021-05-26T16:38:31.406 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 3/26 2021-05-26T16:38:31.406 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/26 2021-05-26T16:38:31.406 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 5/26 2021-05-26T16:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_6 6/26 2021-05-26T16:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/26 2021-05-26T16:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:17.0.0-4646.ged4edd0b.el8. 8/26 2021-05-26T16:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:17.0.0-4646.ged4edd0b.el8.x8 9/26 2021-05-26T16:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 10/26 2021-05-26T16:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 11/26 2021-05-26T16:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 12/26 2021-05-26T16:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 13/26 2021-05-26T16:38:31.409 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2021-05-26T16:38:31.409 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2021-05-26T16:38:31.409 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2021-05-26T16:38:31.409 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 17/26 2021-05-26T16:38:31.410 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2021-05-26T16:38:31.410 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2021-05-26T16:38:31.410 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2021-05-26T16:38:31.411 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2021-05-26T16:38:31.411 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2021-05-26T16:38:31.411 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 23/26 2021-05-26T16:38:31.411 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-05-26T16:38:31.412 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 25/26 2021-05-26T16:38:32.784 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-05-26T16:38:32.784 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:38:33.080 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:33.081 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2021-05-26T16:38:33.081 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.081 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.081 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:33.082 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:38:33.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.083 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.083 INFO:teuthology.orchestra.run.smithi137.stdout: fmt-6.2.1-1.el8.x86_64 2021-05-26T16:38:33.083 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-05-26T16:38:33.083 INFO:teuthology.orchestra.run.smithi137.stdout: leveldb-1.22-1.el8.x86_64 2021-05-26T16:38:33.083 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.084 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.2-3.el8.x86_64 2021-05-26T16:38:33.084 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-05-26T16:38:33.084 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.084 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-05-26T16:38:33.085 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.085 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.3.1-3.el8.x86_64 2021-05-26T16:38:33.085 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-05-26T16:38:33.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-05-26T16:38:33.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.087 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:33.087 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:33.087 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:38:33.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-test 2021-05-26T16:38:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:38 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:38:34.457 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:38:34.458 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:38:34.458 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:38:34.458 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:38:34.459 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:38:34.459 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 43 M 2021-05-26T16:38:34.459 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:38:34.459 INFO:teuthology.orchestra.run.smithi137.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-05-26T16:38:34.460 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 159 k 2021-05-26T16:38:34.460 INFO:teuthology.orchestra.run.smithi137.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-05-26T16:38:34.460 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-05-26T16:38:34.460 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-05-26T16:38:34.460 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-05-26T16:38:34.461 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:34.461 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:38:34.461 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:38:34.461 INFO:teuthology.orchestra.run.smithi137.stdout:Install 7 Packages 2021-05-26T16:38:34.461 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:34.462 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 44 M 2021-05-26T16:38:34.462 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 245 M 2021-05-26T16:38:34.463 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:38:34.502 INFO:teuthology.orchestra.run.smithi137.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 3.8 MB/s | 161 kB 00:00 2021-05-26T16:38:34.506 INFO:teuthology.orchestra.run.smithi137.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 46 MB/s | 187 kB 00:00 2021-05-26T16:38:34.510 INFO:teuthology.orchestra.run.smithi137.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 65 MB/s | 302 kB 00:00 2021-05-26T16:38:34.514 INFO:teuthology.orchestra.run.smithi137.stdout:(4/7): libxslt-1.1.32-5.el8.x86_64.rpm 65 MB/s | 250 kB 00:00 2021-05-26T16:38:34.623 INFO:teuthology.orchestra.run.smithi137.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 641 kB/s | 69 kB 00:00 2021-05-26T16:38:34.634 INFO:teuthology.orchestra.run.smithi137.stdout:(6/7): libcephsqlite-17.0.0-4646.ged4edd0b.el8. 918 kB/s | 159 kB 00:00 2021-05-26T16:38:36.461 INFO:teuthology.orchestra.run.smithi137.stdout:(7/7): ceph-test-17.0.0-4646.ged4edd0b.el8.x86_ 21 MB/s | 43 MB 00:01 2021-05-26T16:38:36.464 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:38:36.465 INFO:teuthology.orchestra.run.smithi137.stdout:Total 22 MB/s | 44 MB 00:02 2021-05-26T16:38:36.468 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:38:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 23/26 2021-05-26T16:38:36.474 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2021-05-26T16:38:36.474 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2021-05-26T16:38:36.475 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /dev 2021-05-26T16:38:36.475 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /run 2021-05-26T16:38:36.475 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2021-05-26T16:38:36.476 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2021-05-26T16:38:36.476 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2021-05-26T16:38:36.476 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2021-05-26T16:38:36.476 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /dev 2021-05-26T16:38:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:36.492 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:38:36.492 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:38:36.734 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:38:36.737 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:38:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:38:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/7 2021-05-26T16:38:37.776 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 24/26 2021-05-26T16:38:37.860 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 24/26 2021-05-26T16:38:37.860 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-05-26T16:38:38.043 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-05-26T16:38:38.044 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-05-26T16:38:38.312 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-05-26T16:38:38.700 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-05-26T16:38:38.746 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-05-26T16:38:38.746 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/26 2021-05-26T16:38:38.746 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/26 2021-05-26T16:38:38.747 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 3/26 2021-05-26T16:38:38.747 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/26 2021-05-26T16:38:38.747 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 5/26 2021-05-26T16:38:38.747 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_6 6/26 2021-05-26T16:38:38.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/26 2021-05-26T16:38:38.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:17.0.0-4646.ged4edd0b.el8. 8/26 2021-05-26T16:38:38.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:17.0.0-4646.ged4edd0b.el8.x8 9/26 2021-05-26T16:38:38.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 10/26 2021-05-26T16:38:38.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 11/26 2021-05-26T16:38:38.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 12/26 2021-05-26T16:38:38.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 13/26 2021-05-26T16:38:38.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2021-05-26T16:38:38.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2021-05-26T16:38:38.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2021-05-26T16:38:38.750 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 17/26 2021-05-26T16:38:38.750 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2021-05-26T16:38:38.750 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2021-05-26T16:38:38.750 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2021-05-26T16:38:38.751 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2021-05-26T16:38:38.751 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2021-05-26T16:38:38.751 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 23/26 2021-05-26T16:38:38.751 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-05-26T16:38:38.751 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 25/26 2021-05-26T16:38:38.853 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-05-26T16:38:38.945 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-05-26T16:38:39.153 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-05-26T16:38:39.278 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/7 2021-05-26T16:38:39.545 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-05-26T16:38:39.545 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:38:39.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:39.818 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2021-05-26T16:38:39.818 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.818 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:39.819 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:38:39.819 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.819 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.820 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.820 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.820 INFO:teuthology.orchestra.run.smithi003.stdout: fmt-6.2.1-1.el8.x86_64 2021-05-26T16:38:39.820 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-05-26T16:38:39.821 INFO:teuthology.orchestra.run.smithi003.stdout: leveldb-1.22-1.el8.x86_64 2021-05-26T16:38:39.821 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.821 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.2-3.el8.x86_64 2021-05-26T16:38:39.821 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-05-26T16:38:39.822 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.822 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-05-26T16:38:39.822 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.822 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.3.1-3.el8.x86_64 2021-05-26T16:38:39.823 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-05-26T16:38:39.823 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.823 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.823 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.823 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-05-26T16:38:39.824 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.824 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.824 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:38:39.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:39.825 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:38:40.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-test 2021-05-26T16:38:40.595 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:39 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:38:41.297 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:38:41.298 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:38:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:38:41.299 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:38:41.299 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:38:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 43 M 2021-05-26T16:38:41.299 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:38:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-05-26T16:38:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 159 k 2021-05-26T16:38:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-05-26T16:38:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-05-26T16:38:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-05-26T16:38:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-05-26T16:38:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:41.301 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:38:41.301 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:38:41.301 INFO:teuthology.orchestra.run.smithi003.stdout:Install 7 Packages 2021-05-26T16:38:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:41.302 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 44 M 2021-05-26T16:38:41.303 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 245 M 2021-05-26T16:38:41.303 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:38:41.341 INFO:teuthology.orchestra.run.smithi003.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 4.0 MB/s | 161 kB 00:00 2021-05-26T16:38:41.344 INFO:teuthology.orchestra.run.smithi003.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 56 MB/s | 187 kB 00:00 2021-05-26T16:38:41.349 INFO:teuthology.orchestra.run.smithi003.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 67 MB/s | 302 kB 00:00 2021-05-26T16:38:41.352 INFO:teuthology.orchestra.run.smithi003.stdout:(4/7): libxslt-1.1.32-5.el8.x86_64.rpm 68 MB/s | 250 kB 00:00 2021-05-26T16:38:41.461 INFO:teuthology.orchestra.run.smithi003.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 639 kB/s | 69 kB 00:00 2021-05-26T16:38:41.474 INFO:teuthology.orchestra.run.smithi003.stdout:(6/7): libcephsqlite-17.0.0-4646.ged4edd0b.el8. 923 kB/s | 159 kB 00:00 2021-05-26T16:38:43.318 INFO:teuthology.orchestra.run.smithi003.stdout:(7/7): ceph-test-17.0.0-4646.ged4edd0b.el8.x86_ 21 MB/s | 43 MB 00:02 2021-05-26T16:38:43.322 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:38:43.322 INFO:teuthology.orchestra.run.smithi003.stdout:Total 22 MB/s | 44 MB 00:02 2021-05-26T16:38:43.326 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:38:43.354 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:38:43.354 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:38:43.611 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:38:43.614 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:38:44.107 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/7 2021-05-26T16:38:44.132 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:38:44.277 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/7 2021-05-26T16:38:44.471 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-05-26T16:38:44.636 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-05-26T16:38:44.789 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-05-26T16:38:44.879 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-05-26T16:38:45.053 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-05-26T16:38:45.189 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/7 2021-05-26T16:38:45.476 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/7 2021-05-26T16:38:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/7 2021-05-26T16:38:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/7 2021-05-26T16:38:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/7 2021-05-26T16:38:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-05-26T16:38:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-05-26T16:38:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-05-26T16:38:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 6/7 2021-05-26T16:38:46.093 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-05-26T16:38:46.093 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:38:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:46.346 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:38:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 jq-1.5-12.el8.x86_64 2021-05-26T16:38:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 libxslt-1.1.32-5.el8.x86_64 2021-05-26T16:38:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-05-26T16:38:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-05-26T16:38:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:46.347 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:38:46.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph 2021-05-26T16:38:47.054 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:52 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:38:47.723 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:38:47.727 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2021-05-26T16:38:47.727 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:38:47.728 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2021-05-26T16:38:47.728 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:38:47.728 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 6.4 k 2021-05-26T16:38:47.728 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:38:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 2.2 M 2021-05-26T16:38:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 1.5 M 2021-05-26T16:38:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 205 k 2021-05-26T16:38:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.8 M 2021-05-26T16:38:47.730 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 16 M 2021-05-26T16:38:47.730 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asn1crypto noarch 0.24.0-3.el8 CentOS-Base 181 k 2021-05-26T16:38:47.730 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-05-26T16:38:47.730 INFO:teuthology.orchestra.run.smithi137.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-05-26T16:38:47.730 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-05-26T16:38:47.731 INFO:teuthology.orchestra.run.smithi137.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-05-26T16:38:47.731 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-05-26T16:38:47.731 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-05-26T16:38:47.731 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 2.3-3.el8 CentOS-Base 510 k 2021-05-26T16:38:47.732 INFO:teuthology.orchestra.run.smithi137.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-05-26T16:38:47.732 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-05-26T16:38:47.732 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-05-26T16:38:47.733 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-05-26T16:38:47.733 INFO:teuthology.orchestra.run.smithi137.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-05-26T16:38:47.733 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-05-26T16:38:47.733 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-05-26T16:38:47.734 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-05-26T16:38:47.734 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-05-26T16:38:47.734 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-05-26T16:38:47.734 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 CentOS-AppStream 103 k 2021-05-26T16:38:47.735 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-05-26T16:38:47.735 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-05-26T16:38:47.735 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-05-26T16:38:47.735 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-05-26T16:38:47.735 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-05-26T16:38:47.736 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-05-26T16:38:47.736 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-05-26T16:38:47.736 INFO:teuthology.orchestra.run.smithi137.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-05-26T16:38:47.736 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-05-26T16:38:47.737 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-05-26T16:38:47.737 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-05-26T16:38:47.737 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-05-26T16:38:47.737 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-05-26T16:38:47.737 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-05-26T16:38:47.738 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-05-26T16:38:47.738 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2021-05-26T16:38:47.738 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-05-26T16:38:47.738 INFO:teuthology.orchestra.run.smithi137.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-05-26T16:38:47.738 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:47.739 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:38:47.739 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2021-05-26T16:38:47.739 INFO:teuthology.orchestra.run.smithi137.stdout:Install 42 Packages 2021-05-26T16:38:47.739 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:38:47.740 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 30 M 2021-05-26T16:38:47.741 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 126 M 2021-05-26T16:38:47.741 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:38:47.833 INFO:teuthology.orchestra.run.smithi137.stdout:(1/42): ceph-17.0.0-4646.ged4edd0b.el8.x86_64.r 65 kB/s | 6.4 kB 00:00 2021-05-26T16:38:48.038 INFO:teuthology.orchestra.run.smithi137.stdout:(2/42): ceph-mgr-17.0.0-4646.ged4edd0b.el8.x86_ 4.8 MB/s | 1.5 MB 00:00 2021-05-26T16:38:48.084 INFO:teuthology.orchestra.run.smithi137.stdout:(3/42): ceph-mds-17.0.0-4646.ged4edd0b.el8.x86_ 6.3 MB/s | 2.2 MB 00:00 2021-05-26T16:38:48.144 INFO:teuthology.orchestra.run.smithi137.stdout:(4/42): ceph-mgr-modules-core-17.0.0-4646.ged4e 3.4 MB/s | 205 kB 00:00 2021-05-26T16:38:48.176 INFO:teuthology.orchestra.run.smithi137.stdout:(5/42): python3-html5lib-0.999999999-6.el8.noar 6.6 MB/s | 214 kB 00:00 2021-05-26T16:38:48.194 INFO:teuthology.orchestra.run.smithi137.stdout:(6/42): python3-lxml-4.2.3-1.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2021-05-26T16:38:48.197 INFO:teuthology.orchestra.run.smithi137.stdout:(7/42): python3-mako-1.0.6-13.el8.noarch.rpm 62 MB/s | 157 kB 00:00 2021-05-26T16:38:48.198 INFO:teuthology.orchestra.run.smithi137.stdout:(8/42): python3-markupsafe-0.23-19.el8.x86_64.r 35 MB/s | 39 kB 00:00 2021-05-26T16:38:48.200 INFO:teuthology.orchestra.run.smithi137.stdout:(9/42): python3-pyOpenSSL-18.0.0-1.el8.noarch.r 54 MB/s | 103 kB 00:00 2021-05-26T16:38:48.202 INFO:teuthology.orchestra.run.smithi137.stdout:(10/42): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2021-05-26T16:38:48.203 INFO:teuthology.orchestra.run.smithi137.stdout:(11/42): python3-webencodings-0.5.1-6.el8.noarc 26 MB/s | 27 kB 00:00 2021-05-26T16:38:48.209 INFO:teuthology.orchestra.run.smithi137.stdout:(12/42): python3-werkzeug-0.12.2-4.el8.noarch.r 76 MB/s | 457 kB 00:00 2021-05-26T16:38:48.212 INFO:teuthology.orchestra.run.smithi137.stdout:(13/42): python3-asn1crypto-0.24.0-3.el8.noarch 66 MB/s | 181 kB 00:00 2021-05-26T16:38:48.215 INFO:teuthology.orchestra.run.smithi137.stdout:(14/42): python3-cffi-1.11.5-5.el8.x86_64.rpm 68 MB/s | 237 kB 00:00 2021-05-26T16:38:48.218 INFO:teuthology.orchestra.run.smithi137.stdout:(15/42): python3-chardet-3.0.4-7.el8.noarch.rpm 65 MB/s | 195 kB 00:00 2021-05-26T16:38:48.226 INFO:teuthology.orchestra.run.smithi137.stdout:(16/42): python3-cryptography-2.3-3.el8.x86_64. 73 MB/s | 510 kB 00:00 2021-05-26T16:38:48.227 INFO:teuthology.orchestra.run.smithi137.stdout:(17/42): python3-idna-2.5-5.el8.noarch.rpm 51 MB/s | 97 kB 00:00 2021-05-26T16:38:48.230 INFO:teuthology.orchestra.run.smithi137.stdout:(18/42): python3-pycparser-2.14-14.el8.noarch.r 53 MB/s | 109 kB 00:00 2021-05-26T16:38:48.231 INFO:teuthology.orchestra.run.smithi137.stdout:(19/42): python3-pysocks-1.6.8-3.el8.noarch.rpm 31 MB/s | 34 kB 00:00 2021-05-26T16:38:48.233 INFO:teuthology.orchestra.run.smithi137.stdout:(20/42): python3-requests-2.20.0-2.1.el8_1.noar 60 MB/s | 123 kB 00:00 2021-05-26T16:38:48.236 INFO:teuthology.orchestra.run.smithi137.stdout:(21/42): python3-urllib3-1.24.2-4.el8.noarch.rp 63 MB/s | 176 kB 00:00 2021-05-26T16:38:48.258 INFO:teuthology.orchestra.run.smithi137.stdout:(22/42): ceph-mon-17.0.0-4646.ged4edd0b.el8.x86 9.0 MB/s | 3.8 MB 00:00 2021-05-26T16:38:48.343 INFO:teuthology.orchestra.run.smithi137.stdout:(23/42): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 409 kB/s | 44 kB 00:00 2021-05-26T16:38:48.369 INFO:teuthology.orchestra.run.smithi137.stdout:(24/42): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.6 MB/s | 185 kB 00:00 2021-05-26T16:38:48.414 INFO:teuthology.orchestra.run.smithi137.stdout:(25/42): python3-cherrypy-18.4.0-1.el8.noarch.r 8.3 MB/s | 384 kB 00:00 2021-05-26T16:38:48.423 INFO:teuthology.orchestra.run.smithi137.stdout:(26/42): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.1 MB/s | 173 kB 00:00 2021-05-26T16:38:48.437 INFO:teuthology.orchestra.run.smithi137.stdout:(27/42): python3-cssselect-0.9.2-10.el8.noarch. 1.7 MB/s | 40 kB 00:00 2021-05-26T16:38:48.451 INFO:teuthology.orchestra.run.smithi137.stdout:(28/42): python3-jaraco-6.2-6.el8.noarch.rpm 412 kB/s | 11 kB 00:00 2021-05-26T16:38:48.459 INFO:teuthology.orchestra.run.smithi137.stdout:(29/42): python3-jaraco-functools-2.0-4.el8.noa 796 kB/s | 18 kB 00:00 2021-05-26T16:38:48.477 INFO:teuthology.orchestra.run.smithi137.stdout:(30/42): python3-logutils-0.3.5-11.el8.noarch.r 1.8 MB/s | 49 kB 00:00 2021-05-26T16:38:48.481 INFO:teuthology.orchestra.run.smithi137.stdout:(31/42): python3-more-itertools-7.2.0-3.el8.noa 2.5 MB/s | 59 kB 00:00 2021-05-26T16:38:48.504 INFO:teuthology.orchestra.run.smithi137.stdout:(32/42): python3-portend-2.6-1.el8.noarch.rpm 706 kB/s | 16 kB 00:00 2021-05-26T16:38:48.526 INFO:teuthology.orchestra.run.smithi137.stdout:(33/42): python3-simplegeneric-0.8.1-17.el8.noa 846 kB/s | 19 kB 00:00 2021-05-26T16:38:48.533 INFO:teuthology.orchestra.run.smithi137.stdout:(34/42): python3-pecan-1.3.2-9.el8.noarch.rpm 5.1 MB/s | 283 kB 00:00 2021-05-26T16:38:48.549 INFO:teuthology.orchestra.run.smithi137.stdout:(35/42): python3-singledispatch-3.4.0.3-18.el8. 1.0 MB/s | 24 kB 00:00 2021-05-26T16:38:48.559 INFO:teuthology.orchestra.run.smithi137.stdout:(36/42): python3-tempora-1.14.1-5.el8.noarch.rp 1.1 MB/s | 29 kB 00:00 2021-05-26T16:38:48.572 INFO:teuthology.orchestra.run.smithi137.stdout:(37/42): python3-trustme-0.6.0-4.el8.noarch.rpm 1.2 MB/s | 27 kB 00:00 2021-05-26T16:38:48.589 INFO:teuthology.orchestra.run.smithi137.stdout:(38/42): python3-waitress-1.2.1-2.el8.1.noarch. 8.0 MB/s | 241 kB 00:00 2021-05-26T16:38:48.595 INFO:teuthology.orchestra.run.smithi137.stdout:(39/42): python3-webob-1.8.5-1.el8.1.noarch.rpm 10 MB/s | 251 kB 00:00 2021-05-26T16:38:48.616 INFO:teuthology.orchestra.run.smithi137.stdout:(40/42): python3-webtest-2.0.33-1.el8.noarch.rp 3.0 MB/s | 85 kB 00:00 2021-05-26T16:38:48.624 INFO:teuthology.orchestra.run.smithi137.stdout:(41/42): python3-zc-lockfile-2.0-2.el8.noarch.r 820 kB/s | 23 kB 00:00 2021-05-26T16:38:48.839 INFO:teuthology.orchestra.run.smithi137.stdout:(42/42): ceph-osd-17.0.0-4646.ged4edd0b.el8.x86 20 MB/s | 16 MB 00:00 2021-05-26T16:38:48.842 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:38:48.843 INFO:teuthology.orchestra.run.smithi137.stdout:Total 27 MB/s | 30 MB 00:01 2021-05-26T16:38:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:38:48.898 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:38:48.899 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:38:49.218 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:38:49.221 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:38:50.035 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 6/7 2021-05-26T16:38:50.271 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/7 2021-05-26T16:38:50.493 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 7/7 2021-05-26T16:38:50.494 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/7 2021-05-26T16:38:50.494 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/7 2021-05-26T16:38:50.494 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-05-26T16:38:50.494 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-05-26T16:38:50.495 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-05-26T16:38:50.495 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 6/7 2021-05-26T16:38:50.717 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:38:50.841 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-05-26T16:38:50.841 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:38:50.887 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/42 2021-05-26T16:38:51.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:51.109 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:38:51.109 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:17.0.0-4646.ged4edd0b.el8.x86_64 jq-1.5-12.el8.x86_64 2021-05-26T16:38:51.110 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:17.0.0-4646.ged4edd0b.el8.x86_64 libxslt-1.1.32-5.el8.x86_64 2021-05-26T16:38:51.110 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-05-26T16:38:51.111 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-05-26T16:38:51.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:51.111 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:38:51.130 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-idna-2.5-5.el8.noarch 2/42 2021-05-26T16:38:51.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph 2021-05-26T16:38:51.326 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 3/42 2021-05-26T16:38:51.582 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/42 2021-05-26T16:38:51.816 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/42 2021-05-26T16:38:51.833 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:50 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:38:51.964 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/42 2021-05-26T16:38:52.171 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/42 2021-05-26T16:38:52.346 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/42 2021-05-26T16:38:52.507 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/42 2021-05-26T16:38:52.533 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:38:52.537 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2021-05-26T16:38:52.538 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:38:52.538 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2021-05-26T16:38:52.538 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:38:52.538 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 6.4 k 2021-05-26T16:38:52.539 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:38:52.539 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 2.2 M 2021-05-26T16:38:52.539 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 1.5 M 2021-05-26T16:38:52.539 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 205 k 2021-05-26T16:38:52.540 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.8 M 2021-05-26T16:38:52.540 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 16 M 2021-05-26T16:38:52.540 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asn1crypto noarch 0.24.0-3.el8 CentOS-Base 181 k 2021-05-26T16:38:52.540 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-05-26T16:38:52.541 INFO:teuthology.orchestra.run.smithi003.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-05-26T16:38:52.541 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-05-26T16:38:52.541 INFO:teuthology.orchestra.run.smithi003.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-05-26T16:38:52.541 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-05-26T16:38:52.542 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-05-26T16:38:52.542 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 2.3-3.el8 CentOS-Base 510 k 2021-05-26T16:38:52.542 INFO:teuthology.orchestra.run.smithi003.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-05-26T16:38:52.542 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-05-26T16:38:52.542 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-05-26T16:38:52.543 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-05-26T16:38:52.543 INFO:teuthology.orchestra.run.smithi003.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-05-26T16:38:52.543 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-05-26T16:38:52.543 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-05-26T16:38:52.544 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-05-26T16:38:52.544 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-05-26T16:38:52.544 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-05-26T16:38:52.544 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 CentOS-AppStream 103 k 2021-05-26T16:38:52.545 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-05-26T16:38:52.545 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-05-26T16:38:52.545 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-05-26T16:38:52.545 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-05-26T16:38:52.545 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-05-26T16:38:52.546 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-05-26T16:38:52.546 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-05-26T16:38:52.546 INFO:teuthology.orchestra.run.smithi003.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-05-26T16:38:52.546 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-05-26T16:38:52.547 INFO:teuthology.orchestra.run.smithi003.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-05-26T16:38:52.547 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-05-26T16:38:52.547 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-05-26T16:38:52.547 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-05-26T16:38:52.547 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-05-26T16:38:52.548 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-05-26T16:38:52.548 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2021-05-26T16:38:52.548 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-05-26T16:38:52.548 INFO:teuthology.orchestra.run.smithi003.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-05-26T16:38:52.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:52.549 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:38:52.549 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2021-05-26T16:38:52.549 INFO:teuthology.orchestra.run.smithi003.stdout:Install 42 Packages 2021-05-26T16:38:52.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:38:52.550 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 30 M 2021-05-26T16:38:52.551 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 126 M 2021-05-26T16:38:52.551 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:38:52.645 INFO:teuthology.orchestra.run.smithi003.stdout:(1/42): ceph-17.0.0-4646.ged4edd0b.el8.x86_64.r 64 kB/s | 6.4 kB 00:00 2021-05-26T16:38:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/42 2021-05-26T16:38:52.848 INFO:teuthology.orchestra.run.smithi003.stdout:(2/42): ceph-mgr-17.0.0-4646.ged4edd0b.el8.x86_ 4.9 MB/s | 1.5 MB 00:00 2021-05-26T16:38:52.868 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/42 2021-05-26T16:38:52.899 INFO:teuthology.orchestra.run.smithi003.stdout:(3/42): ceph-mds-17.0.0-4646.ged4edd0b.el8.x86_ 6.2 MB/s | 2.2 MB 00:00 2021-05-26T16:38:52.962 INFO:teuthology.orchestra.run.smithi003.stdout:(4/42): ceph-mgr-modules-core-17.0.0-4646.ged4e 3.2 MB/s | 205 kB 00:00 2021-05-26T16:38:52.998 INFO:teuthology.orchestra.run.smithi003.stdout:(5/42): python3-html5lib-0.999999999-6.el8.noar 5.8 MB/s | 214 kB 00:00 2021-05-26T16:38:53.017 INFO:teuthology.orchestra.run.smithi003.stdout:(6/42): python3-lxml-4.2.3-1.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2021-05-26T16:38:53.019 INFO:teuthology.orchestra.run.smithi003.stdout:(7/42): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2021-05-26T16:38:53.021 INFO:teuthology.orchestra.run.smithi003.stdout:(8/42): python3-markupsafe-0.23-19.el8.x86_64.r 27 MB/s | 39 kB 00:00 2021-05-26T16:38:53.023 INFO:teuthology.orchestra.run.smithi003.stdout:(9/42): python3-pyOpenSSL-18.0.0-1.el8.noarch.r 48 MB/s | 103 kB 00:00 2021-05-26T16:38:53.025 INFO:teuthology.orchestra.run.smithi003.stdout:(10/42): python3-pytz-2017.2-9.el8.noarch.rpm 36 MB/s | 54 kB 00:00 2021-05-26T16:38:53.027 INFO:teuthology.orchestra.run.smithi003.stdout:(11/42): python3-webencodings-0.5.1-6.el8.noarc 19 MB/s | 27 kB 00:00 2021-05-26T16:38:53.033 INFO:teuthology.orchestra.run.smithi003.stdout:(12/42): python3-werkzeug-0.12.2-4.el8.noarch.r 74 MB/s | 457 kB 00:00 2021-05-26T16:38:53.036 INFO:teuthology.orchestra.run.smithi003.stdout:(13/42): python3-asn1crypto-0.24.0-3.el8.noarch 59 MB/s | 181 kB 00:00 2021-05-26T16:38:53.040 INFO:teuthology.orchestra.run.smithi003.stdout:(14/42): python3-cffi-1.11.5-5.el8.x86_64.rpm 66 MB/s | 237 kB 00:00 2021-05-26T16:38:53.043 INFO:teuthology.orchestra.run.smithi003.stdout:(15/42): python3-chardet-3.0.4-7.el8.noarch.rpm 60 MB/s | 195 kB 00:00 2021-05-26T16:38:53.050 INFO:teuthology.orchestra.run.smithi003.stdout:(16/42): python3-cryptography-2.3-3.el8.x86_64. 74 MB/s | 510 kB 00:00 2021-05-26T16:38:53.052 INFO:teuthology.orchestra.run.smithi003.stdout:(17/42): python3-idna-2.5-5.el8.noarch.rpm 46 MB/s | 97 kB 00:00 2021-05-26T16:38:53.055 INFO:teuthology.orchestra.run.smithi003.stdout:(18/42): python3-pycparser-2.14-14.el8.noarch.r 51 MB/s | 109 kB 00:00 2021-05-26T16:38:53.056 INFO:teuthology.orchestra.run.smithi003.stdout:(19/42): python3-pysocks-1.6.8-3.el8.noarch.rpm 28 MB/s | 34 kB 00:00 2021-05-26T16:38:53.058 INFO:teuthology.orchestra.run.smithi003.stdout:(20/42): python3-requests-2.20.0-2.1.el8_1.noar 54 MB/s | 123 kB 00:00 2021-05-26T16:38:53.061 INFO:teuthology.orchestra.run.smithi003.stdout:(21/42): python3-urllib3-1.24.2-4.el8.noarch.rp 60 MB/s | 176 kB 00:00 2021-05-26T16:38:53.073 INFO:teuthology.orchestra.run.smithi003.stdout:(22/42): ceph-mon-17.0.0-4646.ged4edd0b.el8.x86 8.9 MB/s | 3.8 MB 00:00 2021-05-26T16:38:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/42 2021-05-26T16:38:53.181 INFO:teuthology.orchestra.run.smithi003.stdout:(23/42): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 367 kB/s | 44 kB 00:00 2021-05-26T16:38:53.184 INFO:teuthology.orchestra.run.smithi003.stdout:(24/42): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.6 MB/s | 185 kB 00:00 2021-05-26T16:38:53.230 INFO:teuthology.orchestra.run.smithi003.stdout:(25/42): python3-cherrypy-18.4.0-1.el8.noarch.r 8.3 MB/s | 384 kB 00:00 2021-05-26T16:38:53.252 INFO:teuthology.orchestra.run.smithi003.stdout:(26/42): python3-cssselect-0.9.2-10.el8.noarch. 1.7 MB/s | 40 kB 00:00 2021-05-26T16:38:53.261 INFO:teuthology.orchestra.run.smithi003.stdout:(27/42): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.1 MB/s | 173 kB 00:00 2021-05-26T16:38:53.275 INFO:teuthology.orchestra.run.smithi003.stdout:(28/42): python3-jaraco-6.2-6.el8.noarch.rpm 498 kB/s | 11 kB 00:00 2021-05-26T16:38:53.288 INFO:teuthology.orchestra.run.smithi003.stdout:(29/42): python3-jaraco-functools-2.0-4.el8.noa 651 kB/s | 18 kB 00:00 2021-05-26T16:38:53.297 INFO:teuthology.orchestra.run.smithi003.stdout:(30/42): python3-logutils-0.3.5-11.el8.noarch.r 2.1 MB/s | 49 kB 00:00 2021-05-26T16:38:53.316 INFO:teuthology.orchestra.run.smithi003.stdout:(31/42): python3-more-itertools-7.2.0-3.el8.noa 2.1 MB/s | 59 kB 00:00 2021-05-26T16:38:53.342 INFO:teuthology.orchestra.run.smithi003.stdout:(32/42): python3-pecan-1.3.2-9.el8.noarch.rpm 6.2 MB/s | 283 kB 00:00 2021-05-26T16:38:53.343 INFO:teuthology.orchestra.run.smithi003.stdout:(33/42): python3-portend-2.6-1.el8.noarch.rpm 584 kB/s | 16 kB 00:00 2021-05-26T16:38:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 13/42 2021-05-26T16:38:53.364 INFO:teuthology.orchestra.run.smithi003.stdout:(34/42): python3-simplegeneric-0.8.1-17.el8.noa 837 kB/s | 19 kB 00:00 2021-05-26T16:38:53.370 INFO:teuthology.orchestra.run.smithi003.stdout:(35/42): python3-singledispatch-3.4.0.3-18.el8. 887 kB/s | 24 kB 00:00 2021-05-26T16:38:53.387 INFO:teuthology.orchestra.run.smithi003.stdout:(36/42): python3-tempora-1.14.1-5.el8.noarch.rp 1.3 MB/s | 29 kB 00:00 2021-05-26T16:38:53.397 INFO:teuthology.orchestra.run.smithi003.stdout:(37/42): python3-trustme-0.6.0-4.el8.noarch.rpm 1.0 MB/s | 27 kB 00:00 2021-05-26T16:38:53.411 INFO:teuthology.orchestra.run.smithi003.stdout:(38/42): python3-waitress-1.2.1-2.el8.1.noarch. 9.7 MB/s | 241 kB 00:00 2021-05-26T16:38:53.434 INFO:teuthology.orchestra.run.smithi003.stdout:(39/42): python3-webtest-2.0.33-1.el8.noarch.rp 3.7 MB/s | 85 kB 00:00 2021-05-26T16:38:53.452 INFO:teuthology.orchestra.run.smithi003.stdout:(40/42): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.5 MB/s | 251 kB 00:00 2021-05-26T16:38:53.457 INFO:teuthology.orchestra.run.smithi003.stdout:(41/42): python3-zc-lockfile-2.0-2.el8.noarch.r 1.0 MB/s | 23 kB 00:00 2021-05-26T16:38:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/42 2021-05-26T16:38:53.664 INFO:teuthology.orchestra.run.smithi003.stdout:(42/42): ceph-osd-17.0.0-4646.ged4edd0b.el8.x86 20 MB/s | 16 MB 00:00 2021-05-26T16:38:53.668 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:38:53.668 INFO:teuthology.orchestra.run.smithi003.stdout:Total 27 MB/s | 30 MB 00:01 2021-05-26T16:38:53.683 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:38:53.729 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:38:53.730 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:38:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/42 2021-05-26T16:38:54.042 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:38:54.045 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:38:54.109 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 16/42 2021-05-26T16:38:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 17/42 2021-05-26T16:38:54.641 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 18/42 2021-05-26T16:38:54.959 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 19/42 2021-05-26T16:38:55.229 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 20/42 2021-05-26T16:38:55.417 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 21/42 2021-05-26T16:38:55.586 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:38:55.637 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 22/42 2021-05-26T16:38:55.767 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/42 2021-05-26T16:38:55.921 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 23/42 2021-05-26T16:38:55.960 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-idna-2.5-5.el8.noarch 2/42 2021-05-26T16:38:56.145 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/42 2021-05-26T16:38:56.155 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 3/42 2021-05-26T16:38:56.366 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/42 2021-05-26T16:38:56.421 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 25/42 2021-05-26T16:38:56.570 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/42 2021-05-26T16:38:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 26/42 2021-05-26T16:38:56.726 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/42 2021-05-26T16:38:56.917 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/42 2021-05-26T16:38:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 27/42 2021-05-26T16:38:57.075 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/42 2021-05-26T16:38:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 28/42 2021-05-26T16:38:57.253 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/42 2021-05-26T16:38:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 29/42 2021-05-26T16:38:57.460 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/42 2021-05-26T16:38:57.597 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/42 2021-05-26T16:38:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/42 2021-05-26T16:38:57.839 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 31/42 2021-05-26T16:38:57.868 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/42 2021-05-26T16:38:58.101 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 13/42 2021-05-26T16:38:58.117 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-2.6-1.el8.noarch 32/42 2021-05-26T16:38:58.343 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/42 2021-05-26T16:38:58.388 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 33/42 2021-05-26T16:38:58.550 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/42 2021-05-26T16:38:58.622 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 34/42 2021-05-26T16:38:58.783 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 16/42 2021-05-26T16:38:58.982 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/42 2021-05-26T16:38:59.026 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 17/42 2021-05-26T16:38:59.274 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 18/42 2021-05-26T16:38:59.304 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 36/42 2021-05-26T16:38:59.612 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 19/42 2021-05-26T16:38:59.661 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-4646.ged4edd0b.el8. 37/42 2021-05-26T16:38:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 38/42 2021-05-26T16:38:59.850 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 20/42 2021-05-26T16:39:00.046 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 21/42 2021-05-26T16:39:00.252 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 22/42 2021-05-26T16:39:00.522 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 23/42 2021-05-26T16:39:00.699 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/42 2021-05-26T16:39:00.954 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 25/42 2021-05-26T16:39:01.144 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 26/42 2021-05-26T16:39:01.362 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 38/42 2021-05-26T16:39:01.508 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 27/42 2021-05-26T16:39:01.642 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 39/42 2021-05-26T16:39:01.724 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 28/42 2021-05-26T16:39:01.961 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 29/42 2021-05-26T16:39:02.037 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 39/42 2021-05-26T16:39:02.116 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/42 2021-05-26T16:39:02.233 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 40/42 2021-05-26T16:39:02.310 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 31/42 2021-05-26T16:39:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 40/42 2021-05-26T16:39:02.612 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-2.6-1.el8.noarch 32/42 2021-05-26T16:39:02.641 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 41/42 2021-05-26T16:39:02.662 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 41/42 2021-05-26T16:39:02.807 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 42/42 2021-05-26T16:39:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 33/42 2021-05-26T16:39:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 34/42 2021-05-26T16:39:03.184 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 42/42 2021-05-26T16:39:03.185 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/42 2021-05-26T16:39:03.185 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/42 2021-05-26T16:39:03.185 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 3/42 2021-05-26T16:39:03.186 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/42 2021-05-26T16:39:03.186 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 5/42 2021-05-26T16:39:03.186 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-4646.ged4edd0b.el8. 6/42 2021-05-26T16:39:03.186 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/42 2021-05-26T16:39:03.187 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/42 2021-05-26T16:39:03.187 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/42 2021-05-26T16:39:03.187 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/42 2021-05-26T16:39:03.187 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 11/42 2021-05-26T16:39:03.188 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/42 2021-05-26T16:39:03.188 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/42 2021-05-26T16:39:03.188 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/42 2021-05-26T16:39:03.188 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 15/42 2021-05-26T16:39:03.188 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 16/42 2021-05-26T16:39:03.189 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 17/42 2021-05-26T16:39:03.189 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 18/42 2021-05-26T16:39:03.189 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-idna-2.5-5.el8.noarch 19/42 2021-05-26T16:39:03.189 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 20/42 2021-05-26T16:39:03.190 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 21/42 2021-05-26T16:39:03.190 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 22/42 2021-05-26T16:39:03.190 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 23/42 2021-05-26T16:39:03.190 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 24/42 2021-05-26T16:39:03.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 25/42 2021-05-26T16:39:03.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 26/42 2021-05-26T16:39:03.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 27/42 2021-05-26T16:39:03.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 28/42 2021-05-26T16:39:03.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 29/42 2021-05-26T16:39:03.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 30/42 2021-05-26T16:39:03.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 31/42 2021-05-26T16:39:03.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 32/42 2021-05-26T16:39:03.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 33/42 2021-05-26T16:39:03.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-2.6-1.el8.noarch 34/42 2021-05-26T16:39:03.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 35/42 2021-05-26T16:39:03.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 36/42 2021-05-26T16:39:03.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 37/42 2021-05-26T16:39:03.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 38/42 2021-05-26T16:39:03.194 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 39/42 2021-05-26T16:39:03.194 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 40/42 2021-05-26T16:39:03.194 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 41/42 2021-05-26T16:39:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/42 2021-05-26T16:39:03.764 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 36/42 2021-05-26T16:39:03.991 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 42/42 2021-05-26T16:39:03.992 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:04.151 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-4646.ged4edd0b.el8. 37/42 2021-05-26T16:39:04.226 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:04.226 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:04.227 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:04.227 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:04.227 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:04.227 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:04.227 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:04.228 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:04.228 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2021-05-26T16:39:04.228 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-05-26T16:39:04.228 INFO:teuthology.orchestra.run.smithi137.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-05-26T16:39:04.229 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-05-26T16:39:04.229 INFO:teuthology.orchestra.run.smithi137.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-05-26T16:39:04.229 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-05-26T16:39:04.229 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-05-26T16:39:04.230 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-2.3-3.el8.x86_64 2021-05-26T16:39:04.230 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-05-26T16:39:04.230 INFO:teuthology.orchestra.run.smithi137.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-05-26T16:39:04.230 INFO:teuthology.orchestra.run.smithi137.stdout: python3-idna-2.5-5.el8.noarch 2021-05-26T16:39:04.231 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-6.2-6.el8.noarch 2021-05-26T16:39:04.231 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-05-26T16:39:04.231 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-05-26T16:39:04.231 INFO:teuthology.orchestra.run.smithi137.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-05-26T16:39:04.231 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.0.6-13.el8.noarch 2021-05-26T16:39:04.232 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-05-26T16:39:04.232 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-05-26T16:39:04.232 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-05-26T16:39:04.232 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-2.6-1.el8.noarch 2021-05-26T16:39:04.233 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2021-05-26T16:39:04.233 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.14-14.el8.noarch 2021-05-26T16:39:04.233 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-05-26T16:39:04.233 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2017.2-9.el8.noarch 2021-05-26T16:39:04.233 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-05-26T16:39:04.234 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-05-26T16:39:04.234 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-05-26T16:39:04.234 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-05-26T16:39:04.234 INFO:teuthology.orchestra.run.smithi137.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-05-26T16:39:04.235 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-05-26T16:39:04.235 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-05-26T16:39:04.235 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-05-26T16:39:04.235 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-05-26T16:39:04.236 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-05-26T16:39:04.236 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-05-26T16:39:04.236 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-05-26T16:39:04.236 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:04.236 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:04.338 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 38/42 2021-05-26T16:39:04.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-base 2021-05-26T16:39:04.966 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:09 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:05.464 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:05.631 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:05.632 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:39:05.632 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:05.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install cephadm 2021-05-26T16:39:05.928 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 38/42 2021-05-26T16:39:06.155 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 39/42 2021-05-26T16:39:06.228 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:11 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:06.575 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 39/42 2021-05-26T16:39:06.779 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 40/42 2021-05-26T16:39:06.993 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:06.994 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:06.994 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:39:06.995 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:06.995 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:06.995 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 67 k 2021-05-26T16:39:06.995 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:06.996 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:06.996 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:06.996 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2021-05-26T16:39:06.996 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:06.996 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 67 k 2021-05-26T16:39:06.997 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 296 k 2021-05-26T16:39:06.997 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:07.013 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 40/42 2021-05-26T16:39:07.140 INFO:teuthology.orchestra.run.smithi137.stdout:cephadm-17.0.0-4646.ged4edd0b.el8.noarch.rpm 463 kB/s | 67 kB 00:00 2021-05-26T16:39:07.140 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:07.141 INFO:teuthology.orchestra.run.smithi137.stdout:Total 458 kB/s | 67 kB 00:00 2021-05-26T16:39:07.141 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:07.149 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:07.149 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:07.151 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:07.154 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:07.196 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:07.203 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 41/42 2021-05-26T16:39:07.223 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 41/42 2021-05-26T16:39:07.336 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 42/42 2021-05-26T16:39:07.715 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 42/42 2021-05-26T16:39:07.715 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/42 2021-05-26T16:39:07.716 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/42 2021-05-26T16:39:07.716 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 3/42 2021-05-26T16:39:07.716 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 4/42 2021-05-26T16:39:07.717 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 5/42 2021-05-26T16:39:07.717 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-4646.ged4edd0b.el8. 6/42 2021-05-26T16:39:07.717 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/42 2021-05-26T16:39:07.717 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/42 2021-05-26T16:39:07.718 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/42 2021-05-26T16:39:07.718 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/42 2021-05-26T16:39:07.718 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 11/42 2021-05-26T16:39:07.718 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/42 2021-05-26T16:39:07.719 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/42 2021-05-26T16:39:07.719 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/42 2021-05-26T16:39:07.719 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 15/42 2021-05-26T16:39:07.719 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 16/42 2021-05-26T16:39:07.720 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 17/42 2021-05-26T16:39:07.720 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 18/42 2021-05-26T16:39:07.720 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-idna-2.5-5.el8.noarch 19/42 2021-05-26T16:39:07.720 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 20/42 2021-05-26T16:39:07.720 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 21/42 2021-05-26T16:39:07.721 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 22/42 2021-05-26T16:39:07.721 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 23/42 2021-05-26T16:39:07.721 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 24/42 2021-05-26T16:39:07.721 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 25/42 2021-05-26T16:39:07.723 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 26/42 2021-05-26T16:39:07.724 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 27/42 2021-05-26T16:39:07.724 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 28/42 2021-05-26T16:39:07.724 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 29/42 2021-05-26T16:39:07.724 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 30/42 2021-05-26T16:39:07.725 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 31/42 2021-05-26T16:39:07.725 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 32/42 2021-05-26T16:39:07.725 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 33/42 2021-05-26T16:39:07.725 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-2.6-1.el8.noarch 34/42 2021-05-26T16:39:07.726 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 35/42 2021-05-26T16:39:07.726 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 36/42 2021-05-26T16:39:07.726 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 37/42 2021-05-26T16:39:07.726 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 38/42 2021-05-26T16:39:07.727 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 39/42 2021-05-26T16:39:07.727 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 40/42 2021-05-26T16:39:07.727 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 41/42 2021-05-26T16:39:08.661 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 42/42 2021-05-26T16:39:08.661 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:08.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:08.906 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:08.906 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:08.907 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:08.907 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:08.907 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:08.907 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:08.908 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:08.908 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2021-05-26T16:39:08.908 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-05-26T16:39:08.908 INFO:teuthology.orchestra.run.smithi003.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-05-26T16:39:08.909 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-05-26T16:39:08.909 INFO:teuthology.orchestra.run.smithi003.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-05-26T16:39:08.909 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-05-26T16:39:08.909 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-05-26T16:39:08.909 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-2.3-3.el8.x86_64 2021-05-26T16:39:08.910 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-05-26T16:39:08.910 INFO:teuthology.orchestra.run.smithi003.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-05-26T16:39:08.910 INFO:teuthology.orchestra.run.smithi003.stdout: python3-idna-2.5-5.el8.noarch 2021-05-26T16:39:08.910 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-6.2-6.el8.noarch 2021-05-26T16:39:08.911 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-05-26T16:39:08.911 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-05-26T16:39:08.911 INFO:teuthology.orchestra.run.smithi003.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-05-26T16:39:08.911 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.0.6-13.el8.noarch 2021-05-26T16:39:08.912 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-05-26T16:39:08.912 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-05-26T16:39:08.912 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-05-26T16:39:08.912 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-2.6-1.el8.noarch 2021-05-26T16:39:08.912 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2021-05-26T16:39:08.913 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.14-14.el8.noarch 2021-05-26T16:39:08.913 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-05-26T16:39:08.913 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2017.2-9.el8.noarch 2021-05-26T16:39:08.913 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-05-26T16:39:08.913 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-05-26T16:39:08.914 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-05-26T16:39:08.914 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-05-26T16:39:08.914 INFO:teuthology.orchestra.run.smithi003.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-05-26T16:39:08.914 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-05-26T16:39:08.915 INFO:teuthology.orchestra.run.smithi003.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-05-26T16:39:08.915 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-05-26T16:39:08.915 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-05-26T16:39:08.915 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-05-26T16:39:08.915 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-05-26T16:39:08.916 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-05-26T16:39:08.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:08.917 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:09.290 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:09.528 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:09.700 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:09.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-base 2021-05-26T16:39:09.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:09.917 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:10.134 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:10.316 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:09 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:10.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-immutable-object-cache 2021-05-26T16:39:10.846 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-base-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:10.913 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:15 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:11.021 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:11.022 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:39:11.022 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:11.085 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install cephadm 2021-05-26T16:39:11.580 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:11.582 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:11.582 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2021-05-26T16:39:11.582 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:11.583 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:11.583 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 167 k 2021-05-26T16:39:11.584 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:11.584 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:11.584 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:11.585 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2021-05-26T16:39:11.585 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:11.585 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 167 k 2021-05-26T16:39:11.586 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 633 k 2021-05-26T16:39:11.586 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:11.649 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:10 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:11.751 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-immutable-object-cache-17.0.0-4646.ged4edd 992 kB/s | 167 kB 00:00 2021-05-26T16:39:11.751 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:11.752 INFO:teuthology.orchestra.run.smithi137.stdout:Total 985 kB/s | 167 kB 00:00 2021-05-26T16:39:11.752 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:11.764 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:11.765 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:11.813 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:11.816 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:12.354 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:12.355 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:12.356 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:39:12.356 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:12.356 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:12.356 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 67 k 2021-05-26T16:39:12.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:12.357 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:12.357 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:12.357 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-05-26T16:39:12.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:12.358 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 67 k 2021-05-26T16:39:12.358 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 296 k 2021-05-26T16:39:12.358 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:12.492 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:12.502 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm-17.0.0-4646.ged4edd0b.el8.noarch.rpm 459 kB/s | 67 kB 00:00 2021-05-26T16:39:12.503 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:12.503 INFO:teuthology.orchestra.run.smithi003.stdout:Total 455 kB/s | 67 kB 00:00 2021-05-26T16:39:12.504 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:12.512 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:12.512 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:12.514 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:12.517 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:12.583 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:14.448 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b. 1/1 2021-05-26T16:39:14.798 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b. 1/1 2021-05-26T16:39:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:15.052 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b. 1/1 2021-05-26T16:39:15.052 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:15.285 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:15.285 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:15.286 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:15.286 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:15.286 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:15.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr 2021-05-26T16:39:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:16.005 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:21 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/1 2021-05-26T16:39:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:16.529 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:16.554 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:16.555 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:16.697 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:16.698 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:39:16.699 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:16.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-immutable-object-cache 2021-05-26T16:39:16.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-dashboard 2021-05-26T16:39:17.301 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:22 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:16 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:17.986 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:17.987 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:17.987 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:39:17.987 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:17.987 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:17.988 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 2.3 M 2021-05-26T16:39:17.988 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:39:17.988 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 24 k 2021-05-26T16:39:17.988 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 8.9 k 2021-05-26T16:39:17.988 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-05-26T16:39:17.989 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-05-26T16:39:17.989 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-05-26T16:39:17.989 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:17.989 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:17.990 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:17.990 INFO:teuthology.orchestra.run.smithi137.stdout:Install 6 Packages 2021-05-26T16:39:17.990 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:17.991 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 2.6 M 2021-05-26T16:39:17.991 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 15 M 2021-05-26T16:39:17.991 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:18.034 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:18.035 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-05-26T16:39:18.035 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:18.035 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 167 k 2021-05-26T16:39:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:18.036 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:18.036 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:18.037 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-05-26T16:39:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:18.037 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 167 k 2021-05-26T16:39:18.037 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 633 k 2021-05-26T16:39:18.038 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:18.101 INFO:teuthology.orchestra.run.smithi137.stdout:(1/6): ceph-prometheus-alerts-17.0.0-4646.ged4e 80 kB/s | 8.9 kB 00:00 2021-05-26T16:39:18.114 INFO:teuthology.orchestra.run.smithi137.stdout:(2/6): ceph-grafana-dashboards-17.0.0-4646.ged4 192 kB/s | 24 kB 00:00 2021-05-26T16:39:18.131 INFO:teuthology.orchestra.run.smithi137.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-05-26T16:39:18.196 INFO:teuthology.orchestra.run.smithi137.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 410 kB/s | 34 kB 00:00 2021-05-26T16:39:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-immutable-object-cache-17.0.0-4646.ged4edd 987 kB/s | 167 kB 00:00 2021-05-26T16:39:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:Total 979 kB/s | 167 kB 00:00 2021-05-26T16:39:18.207 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:18.221 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:18.221 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:18.241 INFO:teuthology.orchestra.run.smithi137.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.7 MB/s | 196 kB 00:00 2021-05-26T16:39:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:18.276 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:18.278 INFO:teuthology.orchestra.run.smithi137.stdout:(6/6): ceph-mgr-dashboard-17.0.0-4646.ged4edd0b 7.9 MB/s | 2.3 MB 00:00 2021-05-26T16:39:18.280 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:18.281 INFO:teuthology.orchestra.run.smithi137.stdout:Total 8.8 MB/s | 2.6 MB 00:00 2021-05-26T16:39:18.282 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:18.292 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:18.292 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:18.414 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:18.418 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b. 1/1 2021-05-26T16:39:18.697 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:18.938 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-05-26T16:39:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b. 1/1 2021-05-26T16:39:19.157 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-05-26T16:39:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b. 1/1 2021-05-26T16:39:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:19.398 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-05-26T16:39:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:19.492 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:19.529 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-4646.ged4edd0b.el8.n 4/6 2021-05-26T16:39:19.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr 2021-05-26T16:39:20.257 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:19 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:20.579 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-4646.ged4edd0b.el8. 5/6 2021-05-26T16:39:20.778 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-mgr-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarc 6/6 2021-05-26T16:39:20.955 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:20.956 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:39:20.956 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:21.034 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-dashboard 2021-05-26T16:39:21.104 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarc 6/6 2021-05-26T16:39:21.104 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-4646.ged4edd0b.el8. 1/6 2021-05-26T16:39:21.105 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarc 2/6 2021-05-26T16:39:21.105 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-4646.ged4edd0b.el8.n 3/6 2021-05-26T16:39:21.105 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-05-26T16:39:21.106 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-05-26T16:39:21.365 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-05-26T16:39:21.365 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:21.592 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:21.593 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:21.593 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:21.593 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:21.593 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:21.593 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-05-26T16:39:21.594 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-05-26T16:39:21.594 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.4.1-12.el8.noarch 2021-05-26T16:39:21.594 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:21.594 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:20 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:21.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-diskprediction-local 2021-05-26T16:39:22.221 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:27 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:22.792 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:39:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 2.3 M 2021-05-26T16:39:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:39:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 24 k 2021-05-26T16:39:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 8.9 k 2021-05-26T16:39:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-05-26T16:39:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-05-26T16:39:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-05-26T16:39:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:22.796 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:22.796 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:22.797 INFO:teuthology.orchestra.run.smithi003.stdout:Install 6 Packages 2021-05-26T16:39:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:22.798 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 2.6 M 2021-05-26T16:39:22.798 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 15 M 2021-05-26T16:39:22.798 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:22.884 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:22.885 INFO:teuthology.orchestra.run.smithi137.stdout:===================================================================================================== 2021-05-26T16:39:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:39:22.885 INFO:teuthology.orchestra.run.smithi137.stdout:===================================================================================================== 2021-05-26T16:39:22.885 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 7.4 M 2021-05-26T16:39:22.886 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:39:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-05-26T16:39:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-05-26T16:39:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-05-26T16:39:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-05-26T16:39:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-05-26T16:39:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-05-26T16:39:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-05-26T16:39:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:22.888 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:22.888 INFO:teuthology.orchestra.run.smithi137.stdout:===================================================================================================== 2021-05-26T16:39:22.888 INFO:teuthology.orchestra.run.smithi137.stdout:Install 8 Packages 2021-05-26T16:39:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:22.889 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 35 M 2021-05-26T16:39:22.890 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 194 M 2021-05-26T16:39:22.890 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:22.936 INFO:teuthology.orchestra.run.smithi003.stdout:(1/6): ceph-prometheus-alerts-17.0.0-4646.ged4e 64 kB/s | 8.9 kB 00:00 2021-05-26T16:39:22.937 INFO:teuthology.orchestra.run.smithi003.stdout:(2/6): ceph-grafana-dashboards-17.0.0-4646.ged4 171 kB/s | 24 kB 00:00 2021-05-26T16:39:23.004 INFO:teuthology.orchestra.run.smithi137.stdout:(1/8): openblas-0.3.3-5.el8.x86_64.rpm 37 MB/s | 4.3 MB 00:00 2021-05-26T16:39:23.024 INFO:teuthology.orchestra.run.smithi003.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 484 kB/s | 43 kB 00:00 2021-05-26T16:39:23.026 INFO:teuthology.orchestra.run.smithi137.stdout:(2/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 31 MB/s | 4.3 MB 00:00 2021-05-26T16:39:23.033 INFO:teuthology.orchestra.run.smithi137.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 32 MB/s | 225 kB 00:00 2021-05-26T16:39:23.074 INFO:teuthology.orchestra.run.smithi003.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 245 kB/s | 34 kB 00:00 2021-05-26T16:39:23.080 INFO:teuthology.orchestra.run.smithi137.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 49 MB/s | 3.7 MB 00:00 2021-05-26T16:39:23.093 INFO:teuthology.orchestra.run.smithi137.stdout:(5/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 47 MB/s | 639 kB 00:00 2021-05-26T16:39:23.099 INFO:teuthology.orchestra.run.smithi137.stdout:(6/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 30 MB/s | 169 kB 00:00 2021-05-26T16:39:23.149 INFO:teuthology.orchestra.run.smithi003.stdout:(5/6): ceph-mgr-dashboard-17.0.0-4646.ged4edd0b 6.4 MB/s | 2.3 MB 00:00 2021-05-26T16:39:23.229 INFO:teuthology.orchestra.run.smithi003.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 960 kB/s | 196 kB 00:00 2021-05-26T16:39:23.232 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:23.233 INFO:teuthology.orchestra.run.smithi003.stdout:Total 5.9 MB/s | 2.6 MB 00:00 2021-05-26T16:39:23.234 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:23.246 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:23.246 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:23.319 INFO:teuthology.orchestra.run.smithi137.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.3.0+56 51 MB/s | 15 MB 00:00 2021-05-26T16:39:23.380 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:23.384 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:23.449 INFO:teuthology.orchestra.run.smithi137.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-464 13 MB/s | 7.4 MB 00:00 2021-05-26T16:39:23.452 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:23.453 INFO:teuthology.orchestra.run.smithi137.stdout:Total 62 MB/s | 35 MB 00:00 2021-05-26T16:39:23.461 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:23.481 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:23.481 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:23.775 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:23.800 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:23.803 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:23.971 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-05-26T16:39:24.198 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-05-26T16:39:24.355 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:24.411 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-05-26T16:39:24.521 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-05-26T16:39:24.526 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-4646.ged4edd0b.el8.n 4/6 2021-05-26T16:39:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-05-26T16:39:24.937 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-05-26T16:39:25.446 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-05-26T16:39:25.655 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-4646.ged4edd0b.el8. 5/6 2021-05-26T16:39:25.662 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.3-5.el8.x86_64 3/8 2021-05-26T16:39:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarc 6/6 2021-05-26T16:39:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 3/8 2021-05-26T16:39:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarc 6/6 2021-05-26T16:39:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-4646.ged4edd0b.el8. 1/6 2021-05-26T16:39:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarc 2/6 2021-05-26T16:39:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-4646.ged4edd0b.el8.n 3/6 2021-05-26T16:39:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-05-26T16:39:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-05-26T16:39:26.337 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-05-26T16:39:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-05-26T16:39:26.616 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:26.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:26.824 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:26.824 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:26.824 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:26.824 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-05-26T16:39:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-05-26T16:39:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.4.1-12.el8.noarch 2021-05-26T16:39:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:26.825 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:26.913 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-diskprediction-local 2021-05-26T16:39:27.060 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-05-26T16:39:27.461 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-05-26T16:39:27.476 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:26 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:27.728 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-05-26T16:39:28.178 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:28.179 INFO:teuthology.orchestra.run.smithi003.stdout:===================================================================================================== 2021-05-26T16:39:28.180 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:39:28.180 INFO:teuthology.orchestra.run.smithi003.stdout:===================================================================================================== 2021-05-26T16:39:28.180 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:28.180 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 7.4 M 2021-05-26T16:39:28.180 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:39:28.181 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-05-26T16:39:28.181 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-05-26T16:39:28.181 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-05-26T16:39:28.182 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-05-26T16:39:28.182 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-05-26T16:39:28.182 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-05-26T16:39:28.182 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-05-26T16:39:28.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:28.183 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:28.183 INFO:teuthology.orchestra.run.smithi003.stdout:===================================================================================================== 2021-05-26T16:39:28.183 INFO:teuthology.orchestra.run.smithi003.stdout:Install 8 Packages 2021-05-26T16:39:28.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:28.185 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 35 M 2021-05-26T16:39:28.185 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 194 M 2021-05-26T16:39:28.185 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:28.300 INFO:teuthology.orchestra.run.smithi003.stdout:(1/8): openblas-0.3.3-5.el8.x86_64.rpm 36 MB/s | 4.3 MB 00:00 2021-05-26T16:39:28.350 INFO:teuthology.orchestra.run.smithi003.stdout:(2/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 26 MB/s | 4.3 MB 00:00 2021-05-26T16:39:28.360 INFO:teuthology.orchestra.run.smithi003.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 23 MB/s | 225 kB 00:00 2021-05-26T16:39:28.408 INFO:teuthology.orchestra.run.smithi003.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 35 MB/s | 3.7 MB 00:00 2021-05-26T16:39:28.422 INFO:teuthology.orchestra.run.smithi003.stdout:(5/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 46 MB/s | 639 kB 00:00 2021-05-26T16:39:28.428 INFO:teuthology.orchestra.run.smithi003.stdout:(6/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 29 MB/s | 169 kB 00:00 2021-05-26T16:39:28.634 INFO:teuthology.orchestra.run.smithi003.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.3.0+56 53 MB/s | 15 MB 00:00 2021-05-26T16:39:28.723 INFO:teuthology.orchestra.run.smithi003.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-464 14 MB/s | 7.4 MB 00:00 2021-05-26T16:39:28.726 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:28.727 INFO:teuthology.orchestra.run.smithi003.stdout:Total 65 MB/s | 35 MB 00:00 2021-05-26T16:39:28.736 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:28.758 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:28.758 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:29.111 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:29.115 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:29.704 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-05-26T16:39:29.832 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-05-26T16:39:29.961 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-05-26T16:39:30.149 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-05-26T16:39:30.682 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-05-26T16:39:30.866 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.3-5.el8.x86_64 3/8 2021-05-26T16:39:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 3/8 2021-05-26T16:39:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 7/8 2021-05-26T16:39:31.549 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-05-26T16:39:31.678 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0 8/8 2021-05-26T16:39:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0 8/8 2021-05-26T16:39:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0 1/8 2021-05-26T16:39:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 2/8 2021-05-26T16:39:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-05-26T16:39:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-05-26T16:39:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-05-26T16:39:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 6/8 2021-05-26T16:39:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 7/8 2021-05-26T16:39:32.231 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 8/8 2021-05-26T16:39:32.231 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:32.315 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-05-26T16:39:32.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:32.466 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:32.466 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:32.467 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-05-26T16:39:32.467 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-05-26T16:39:32.467 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.3-5.el8.x86_64 2021-05-26T16:39:32.467 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-05-26T16:39:32.468 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-05-26T16:39:32.468 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-05-26T16:39:32.468 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-05-26T16:39:32.468 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:32.468 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:32.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-rook 2021-05-26T16:39:32.636 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-05-26T16:39:32.882 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-05-26T16:39:33.086 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:38 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:33.758 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================== 2021-05-26T16:39:33.759 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:39:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================== 2021-05-26T16:39:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:33.759 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 26 k 2021-05-26T16:39:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:39:33.760 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-05-26T16:39:33.760 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-05-26T16:39:33.760 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-05-26T16:39:33.760 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-05-26T16:39:33.761 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-05-26T16:39:33.761 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-05-26T16:39:33.761 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-05-26T16:39:33.761 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-05-26T16:39:33.761 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-05-26T16:39:33.762 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-05-26T16:39:33.762 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-05-26T16:39:33.763 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-05-26T16:39:33.763 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================== 2021-05-26T16:39:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:Install 13 Packages 2021-05-26T16:39:33.764 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 1.9 M 2021-05-26T16:39:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 24 M 2021-05-26T16:39:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 852 kB/s | 27 kB 00:00 2021-05-26T16:39:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 516 kB/s | 20 kB 00:00 2021-05-26T16:39:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 37 MB/s | 126 kB 00:00 2021-05-26T16:39:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 38 MB/s | 110 kB 00:00 2021-05-26T16:39:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 47 MB/s | 155 kB 00:00 2021-05-26T16:39:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 29 MB/s | 43 kB 00:00 2021-05-26T16:39:33.872 INFO:teuthology.orchestra.run.smithi137.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 246 kB/s | 16 kB 00:00 2021-05-26T16:39:33.885 INFO:teuthology.orchestra.run.smithi137.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 407 kB/s | 33 kB 00:00 2021-05-26T16:39:33.890 INFO:teuthology.orchestra.run.smithi137.stdout:(9/13): ceph-mgr-rook-17.0.0-4646.ged4edd0b.el8 202 kB/s | 26 kB 00:00 2021-05-26T16:39:33.938 INFO:teuthology.orchestra.run.smithi137.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.2 MB/s | 81 kB 00:00 2021-05-26T16:39:33.960 INFO:teuthology.orchestra.run.smithi137.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.7 MB/s | 61 kB 00:00 2021-05-26T16:39:33.979 INFO:teuthology.orchestra.run.smithi137.stdout:(12/13): python3-rsa-3.4.2-16.el8.noarch.rpm 832 kB/s | 73 kB 00:00 2021-05-26T16:39:34.074 INFO:teuthology.orchestra.run.smithi137.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 6.2 MB/s | 1.2 MB 00:00 2021-05-26T16:39:34.075 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:34.076 INFO:teuthology.orchestra.run.smithi137.stdout:Total 6.1 MB/s | 1.9 MB 00:00 2021-05-26T16:39:34.081 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:34.096 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:34.096 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:34.168 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:34.171 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:34.673 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:34.932 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-05-26T16:39:34.993 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-05-26T16:39:35.227 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-05-26T16:39:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-05-26T16:39:35.684 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-05-26T16:39:36.146 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-05-26T16:39:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 7/8 2021-05-26T16:39:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0 8/8 2021-05-26T16:39:36.599 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-05-26T16:39:36.747 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0 8/8 2021-05-26T16:39:36.747 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0 1/8 2021-05-26T16:39:36.747 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 2/8 2021-05-26T16:39:36.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-05-26T16:39:36.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-05-26T16:39:36.748 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-05-26T16:39:36.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 6/8 2021-05-26T16:39:36.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 7/8 2021-05-26T16:39:36.886 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-05-26T16:39:37.039 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 8/8 2021-05-26T16:39:37.040 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:37.128 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-05-26T16:39:37.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:37.256 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:37.256 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:37.256 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-05-26T16:39:37.256 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-05-26T16:39:37.257 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.3-5.el8.x86_64 2021-05-26T16:39:37.257 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-05-26T16:39:37.257 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-05-26T16:39:37.257 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-05-26T16:39:37.258 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-05-26T16:39:37.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:37.258 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:37.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-rook 2021-05-26T16:39:37.940 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:36 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-05-26T16:39:38.542 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-05-26T16:39:38.653 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:38.654 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-05-26T16:39:38.655 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:39:38.655 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-05-26T16:39:38.655 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:38.655 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 26 k 2021-05-26T16:39:38.656 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:39:38.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-05-26T16:39:38.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-05-26T16:39:38.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-05-26T16:39:38.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-05-26T16:39:38.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-05-26T16:39:38.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-05-26T16:39:38.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-05-26T16:39:38.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-05-26T16:39:38.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-05-26T16:39:38.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-05-26T16:39:38.659 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-05-26T16:39:38.659 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-05-26T16:39:38.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:38.659 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:38.660 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-05-26T16:39:38.660 INFO:teuthology.orchestra.run.smithi003.stdout:Install 13 Packages 2021-05-26T16:39:38.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:38.661 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 1.9 M 2021-05-26T16:39:38.661 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 24 M 2021-05-26T16:39:38.661 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:38.722 INFO:teuthology.orchestra.run.smithi003.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 415 kB/s | 27 kB 00:00 2021-05-26T16:39:38.759 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-05-26T16:39:38.795 INFO:teuthology.orchestra.run.smithi003.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 146 kB/s | 20 kB 00:00 2021-05-26T16:39:38.855 INFO:teuthology.orchestra.run.smithi003.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 954 kB/s | 126 kB 00:00 2021-05-26T16:39:38.856 INFO:teuthology.orchestra.run.smithi003.stdout:(4/13): ceph-mgr-rook-17.0.0-4646.ged4edd0b.el8 132 kB/s | 26 kB 00:00 2021-05-26T16:39:38.919 INFO:teuthology.orchestra.run.smithi003.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 885 kB/s | 110 kB 00:00 2021-05-26T16:39:38.943 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-05-26T16:39:38.980 INFO:teuthology.orchestra.run.smithi003.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.2 MB/s | 155 kB 00:00 2021-05-26T16:39:39.038 INFO:teuthology.orchestra.run.smithi003.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 235 kB/s | 43 kB 00:00 2021-05-26T16:39:39.039 INFO:teuthology.orchestra.run.smithi003.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 289 kB/s | 33 kB 00:00 2021-05-26T16:39:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 13/13 2021-05-26T16:39:39.146 INFO:teuthology.orchestra.run.smithi003.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 98 kB/s | 16 kB 00:00 2021-05-26T16:39:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 477 kB/s | 81 kB 00:00 2021-05-26T16:39:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:(11/13): python3-rsa-3.4.2-16.el8.noarch.rpm 1.1 MB/s | 73 kB 00:00 2021-05-26T16:39:39.232 INFO:teuthology.orchestra.run.smithi003.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 2.6 MB/s | 61 kB 00:00 2021-05-26T16:39:39.316 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 13/13 2021-05-26T16:39:39.316 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 1/13 2021-05-26T16:39:39.316 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-05-26T16:39:39.316 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-05-26T16:39:39.317 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-05-26T16:39:39.317 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-05-26T16:39:39.317 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-05-26T16:39:39.317 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-05-26T16:39:39.318 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-05-26T16:39:39.318 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-05-26T16:39:39.318 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-05-26T16:39:39.318 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-05-26T16:39:39.319 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-05-26T16:39:39.319 INFO:teuthology.orchestra.run.smithi003.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.2 MB/s | 1.2 MB 00:00 2021-05-26T16:39:39.322 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:39.323 INFO:teuthology.orchestra.run.smithi003.stdout:Total 2.9 MB/s | 1.9 MB 00:00 2021-05-26T16:39:39.330 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:39.348 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:39.348 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:39.435 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:39.438 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:39.645 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-05-26T16:39:39.645 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:39.856 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:39.857 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:39.857 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:39.857 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-05-26T16:39:39.857 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-05-26T16:39:39.857 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-05-26T16:39:39.858 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-05-26T16:39:39.858 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-05-26T16:39:39.858 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-05-26T16:39:39.858 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-05-26T16:39:39.859 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-05-26T16:39:39.859 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-05-26T16:39:39.859 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-05-26T16:39:39.859 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-05-26T16:39:39.860 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-05-26T16:39:39.860 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:39.860 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:39.960 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-cephadm 2021-05-26T16:39:39.970 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:40.223 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-05-26T16:39:40.501 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:45 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:40.508 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-05-26T16:39:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-05-26T16:39:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-05-26T16:39:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-05-26T16:39:41.168 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:41.169 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:41.170 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:39:41.170 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:41.170 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:41.171 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 88 k 2021-05-26T16:39:41.171 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:39:41.171 INFO:teuthology.orchestra.run.smithi137.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-05-26T16:39:41.171 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-05-26T16:39:41.171 INFO:teuthology.orchestra.run.smithi137.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-05-26T16:39:41.172 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-05-26T16:39:41.172 INFO:teuthology.orchestra.run.smithi137.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-05-26T16:39:41.172 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:41.172 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:41.173 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:41.173 INFO:teuthology.orchestra.run.smithi137.stdout:Install 6 Packages 2021-05-26T16:39:41.173 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:41.174 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 5.8 M 2021-05-26T16:39:41.174 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 24 M 2021-05-26T16:39:41.174 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:41.231 INFO:teuthology.orchestra.run.smithi137.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 9.0 MB/s | 538 kB 00:00 2021-05-26T16:39:41.269 INFO:teuthology.orchestra.run.smithi137.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 49 MB/s | 4.8 MB 00:00 2021-05-26T16:39:41.322 INFO:teuthology.orchestra.run.smithi137.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 232 kB/s | 21 kB 00:00 2021-05-26T16:39:41.338 INFO:teuthology.orchestra.run.smithi137.stdout:(4/6): ceph-mgr-cephadm-17.0.0-4646.ged4edd0b.e 529 kB/s | 88 kB 00:00 2021-05-26T16:39:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-05-26T16:39:41.375 INFO:teuthology.orchestra.run.smithi137.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 899 kB/s | 48 kB 00:00 2021-05-26T16:39:41.404 INFO:teuthology.orchestra.run.smithi137.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.6 MB/s | 355 kB 00:00 2021-05-26T16:39:41.406 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:41.406 INFO:teuthology.orchestra.run.smithi137.stdout:Total 25 MB/s | 5.8 MB 00:00 2021-05-26T16:39:41.409 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:41.418 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:41.419 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:41.526 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:41.542 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-05-26T16:39:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-05-26T16:39:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:42.360 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-05-26T16:39:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-05-26T16:39:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-05-26T16:39:43.297 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-05-26T16:39:43.497 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-05-26T16:39:43.610 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-05-26T16:39:43.706 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-05-26T16:39:43.839 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 13/13 2021-05-26T16:39:44.004 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-05-26T16:39:44.092 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 13/13 2021-05-26T16:39:44.093 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 1/13 2021-05-26T16:39:44.093 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-05-26T16:39:44.093 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-05-26T16:39:44.093 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-05-26T16:39:44.094 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-05-26T16:39:44.094 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-05-26T16:39:44.094 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-05-26T16:39:44.094 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-05-26T16:39:44.095 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-05-26T16:39:44.095 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-05-26T16:39:44.095 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-05-26T16:39:44.095 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-05-26T16:39:44.275 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-05-26T16:39:44.433 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-05-26T16:39:44.434 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:44.467 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 6/6 2021-05-26T16:39:44.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:44.664 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:44.664 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:44.664 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-05-26T16:39:44.664 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-05-26T16:39:44.665 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-05-26T16:39:44.665 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-05-26T16:39:44.665 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-05-26T16:39:44.665 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-05-26T16:39:44.665 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-05-26T16:39:44.666 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-05-26T16:39:44.666 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-05-26T16:39:44.666 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-05-26T16:39:44.666 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-05-26T16:39:44.667 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-05-26T16:39:44.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:44.667 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:44.729 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 6/6 2021-05-26T16:39:44.729 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/6 2021-05-26T16:39:44.729 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-05-26T16:39:44.730 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-05-26T16:39:44.730 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-05-26T16:39:44.730 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-05-26T16:39:44.863 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-cephadm 2021-05-26T16:39:45.002 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-05-26T16:39:45.002 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:45.227 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: python3-apipkg-1.5-6.el8.noarch 2021-05-26T16:39:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.5.1-5.el8.noarch 2021-05-26T16:39:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-05-26T16:39:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-05-26T16:39:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-05-26T16:39:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:45.229 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:45.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-fuse 2021-05-26T16:39:45.439 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:44 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:45.893 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:50 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:46.145 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:46.146 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:46.146 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:39:46.147 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:46.147 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:46.147 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:17.0.0-4646.ged4edd0b.el8 ceph-noarch 88 k 2021-05-26T16:39:46.147 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:39:46.148 INFO:teuthology.orchestra.run.smithi003.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-05-26T16:39:46.148 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-05-26T16:39:46.148 INFO:teuthology.orchestra.run.smithi003.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-05-26T16:39:46.148 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-05-26T16:39:46.149 INFO:teuthology.orchestra.run.smithi003.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-05-26T16:39:46.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:46.149 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:46.149 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:46.149 INFO:teuthology.orchestra.run.smithi003.stdout:Install 6 Packages 2021-05-26T16:39:46.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:46.151 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 5.8 M 2021-05-26T16:39:46.151 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 24 M 2021-05-26T16:39:46.151 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:46.196 INFO:teuthology.orchestra.run.smithi003.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2021-05-26T16:39:46.244 INFO:teuthology.orchestra.run.smithi003.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 50 MB/s | 4.8 MB 00:00 2021-05-26T16:39:46.277 INFO:teuthology.orchestra.run.smithi003.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 264 kB/s | 21 kB 00:00 2021-05-26T16:39:46.292 INFO:teuthology.orchestra.run.smithi003.stdout:(4/6): ceph-mgr-cephadm-17.0.0-4646.ged4edd0b.e 610 kB/s | 88 kB 00:00 2021-05-26T16:39:46.330 INFO:teuthology.orchestra.run.smithi003.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 898 kB/s | 48 kB 00:00 2021-05-26T16:39:46.406 INFO:teuthology.orchestra.run.smithi003.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.1 MB/s | 355 kB 00:00 2021-05-26T16:39:46.408 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:46.408 INFO:teuthology.orchestra.run.smithi003.stdout:Total 22 MB/s | 5.8 MB 00:00 2021-05-26T16:39:46.411 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:46.422 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:46.422 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:46.507 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:46.510 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:46.557 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:46.558 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:46.558 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2021-05-26T16:39:46.559 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:46.559 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:46.559 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 837 k 2021-05-26T16:39:46.559 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2021-05-26T16:39:46.560 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-05-26T16:39:46.560 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:46.560 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:46.560 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:46.561 INFO:teuthology.orchestra.run.smithi137.stdout:Install 2 Packages 2021-05-26T16:39:46.561 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:46.561 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 920 k 2021-05-26T16:39:46.561 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 3.3 M 2021-05-26T16:39:46.561 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:46.592 INFO:teuthology.orchestra.run.smithi137.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 82 kB 00:00 2021-05-26T16:39:46.796 INFO:teuthology.orchestra.run.smithi137.stdout:(2/2): ceph-fuse-17.0.0-4646.ged4edd0b.el8.x86_ 3.5 MB/s | 837 kB 00:00 2021-05-26T16:39:46.798 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:46.798 INFO:teuthology.orchestra.run.smithi137.stdout:Total 3.8 MB/s | 920 kB 00:00 2021-05-26T16:39:46.798 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:46.803 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:46.820 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:46.821 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:46.896 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:46.899 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:47.077 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:47.078 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-05-26T16:39:47.304 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-05-26T16:39:47.735 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-05-26T16:39:47.950 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/2 2021-05-26T16:39:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-05-26T16:39:48.319 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/2 2021-05-26T16:39:48.319 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/2 2021-05-26T16:39:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-05-26T16:39:48.553 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-05-26T16:39:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:48.803 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-05-26T16:39:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:48.804 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:48.906 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-05-26T16:39:48.978 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados-devel 2021-05-26T16:39:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 6/6 2021-05-26T16:39:49.371 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 6/6 2021-05-26T16:39:49.371 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 1/6 2021-05-26T16:39:49.372 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-05-26T16:39:49.372 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-05-26T16:39:49.372 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-05-26T16:39:49.372 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-05-26T16:39:49.527 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:54 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:49.654 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-05-26T16:39:49.654 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:50.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:50.175 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:50.176 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:17.0.0-4646.ged4edd0b.el8.noarch 2021-05-26T16:39:50.176 INFO:teuthology.orchestra.run.smithi003.stdout: python3-apipkg-1.5-6.el8.noarch 2021-05-26T16:39:50.176 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.5.1-5.el8.noarch 2021-05-26T16:39:50.176 INFO:teuthology.orchestra.run.smithi003.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-05-26T16:39:50.176 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-05-26T16:39:50.177 INFO:teuthology.orchestra.run.smithi003.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-05-26T16:39:50.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:50.177 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:50.197 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:50.198 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:50.198 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2021-05-26T16:39:50.198 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:50.198 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:50.199 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 125 k 2021-05-26T16:39:50.199 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:50.199 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:50.199 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:50.199 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2021-05-26T16:39:50.200 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:50.200 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 125 k 2021-05-26T16:39:50.200 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 439 k 2021-05-26T16:39:50.200 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:50.373 INFO:teuthology.orchestra.run.smithi137.stdout:librados-devel-17.0.0-4646.ged4edd0b.el8.x86_64 716 kB/s | 125 kB 00:00 2021-05-26T16:39:50.374 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:50.374 INFO:teuthology.orchestra.run.smithi137.stdout:Total 711 kB/s | 125 kB 00:00 2021-05-26T16:39:50.374 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:50.381 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:50.381 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:50.432 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:50.436 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:50.549 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:50.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-fuse 2021-05-26T16:39:50.798 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:51.034 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:51.165 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:50 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:51.267 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:51.267 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:51.528 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:51.529 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:51.529 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:51.530 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:51.530 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:51.703 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs2 2021-05-26T16:39:51.868 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:51.869 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:51.869 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-05-26T16:39:51.870 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:51.871 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:51.871 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 837 k 2021-05-26T16:39:51.872 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-05-26T16:39:51.872 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-05-26T16:39:51.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:51.872 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:51.873 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:51.873 INFO:teuthology.orchestra.run.smithi003.stdout:Install 2 Packages 2021-05-26T16:39:51.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:51.873 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 920 k 2021-05-26T16:39:51.874 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 3.3 M 2021-05-26T16:39:51.874 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:51.904 INFO:teuthology.orchestra.run.smithi003.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 82 kB 00:00 2021-05-26T16:39:52.111 INFO:teuthology.orchestra.run.smithi003.stdout:(2/2): ceph-fuse-17.0.0-4646.ged4edd0b.el8.x86_ 3.4 MB/s | 837 kB 00:00 2021-05-26T16:39:52.112 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:52.112 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.7 MB/s | 920 kB 00:00 2021-05-26T16:39:52.113 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:52.137 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:52.138 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:52.219 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:52.223 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:52.254 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:57 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:52.386 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:52.651 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-05-26T16:39:52.749 INFO:teuthology.orchestra.run.smithi137.stdout:Package libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:52.862 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/2 2021-05-26T16:39:52.916 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:52.917 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:39:52.917 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:53.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs-devel 2021-05-26T16:39:53.212 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2/2 2021-05-26T16:39:53.213 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/2 2021-05-26T16:39:53.474 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-05-26T16:39:53.474 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:53.562 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:58 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:53.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:53.699 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:53.699 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-05-26T16:39:53.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:53.700 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:53.900 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados-devel 2021-05-26T16:39:54.227 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:54.228 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:54.229 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2021-05-26T16:39:54.229 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:54.229 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:39:54.229 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 24 k 2021-05-26T16:39:54.229 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:54.230 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:39:54.230 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:39:54.231 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2021-05-26T16:39:54.231 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:54.231 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 24 k 2021-05-26T16:39:54.231 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 101 k 2021-05-26T16:39:54.232 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:39:54.356 INFO:teuthology.orchestra.run.smithi137.stdout:libcephfs-devel-17.0.0-4646.ged4edd0b.el8.x86_6 187 kB/s | 24 kB 00:00 2021-05-26T16:39:54.357 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:54.357 INFO:teuthology.orchestra.run.smithi137.stdout:Total 186 kB/s | 24 kB 00:00 2021-05-26T16:39:54.357 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:39:54.361 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:39:54.361 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:39:54.363 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:39:54.366 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:39:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:39:54.485 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:53 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:54.623 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:54.833 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:39:55.191 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:55.192 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:55.192 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-05-26T16:39:55.192 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:55.193 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:55.193 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 125 k 2021-05-26T16:39:55.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:55.193 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:55.193 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:55.194 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-05-26T16:39:55.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:55.195 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 125 k 2021-05-26T16:39:55.195 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 439 k 2021-05-26T16:39:55.196 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:55.295 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:55.295 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:39:55.295 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:55.296 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:39:55.296 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:55.374 INFO:teuthology.orchestra.run.smithi003.stdout:librados-devel-17.0.0-4646.ged4edd0b.el8.x86_64 690 kB/s | 125 kB 00:00 2021-05-26T16:39:55.375 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:55.375 INFO:teuthology.orchestra.run.smithi003.stdout:Total 685 kB/s | 125 kB 00:00 2021-05-26T16:39:55.375 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:55.383 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:55.383 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:55.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados2 2021-05-26T16:39:55.439 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:55.442 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:55.878 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:55.930 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:00 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:56.110 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:56.388 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:39:56.388 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:39:56.423 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:56.593 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:56.593 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:39:56.593 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:56.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:56.628 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:39:56.628 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:39:56.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:56.629 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:56.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librbd1 2021-05-26T16:39:56.816 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs2 2021-05-26T16:39:57.223 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:02 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:57.395 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:56 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:57.723 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:57.891 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:57.892 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:39:57.892 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:57.924 INFO:teuthology.orchestra.run.smithi003.stdout:Package libcephfs2-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:58.100 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:58.102 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:39:58.102 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:39:58.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs-devel 2021-05-26T16:39:58.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rados 2021-05-26T16:39:58.722 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:03 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:39:58.749 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:57 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:39:59.231 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:39:59.398 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:39:59.399 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:39:59.399 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:39:59.465 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:39:59.466 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:59.466 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-05-26T16:39:59.466 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:59.467 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:39:59.467 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 24 k 2021-05-26T16:39:59.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:59.467 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:39:59.467 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:39:59.468 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-05-26T16:39:59.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:39:59.468 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 24 k 2021-05-26T16:39:59.468 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 101 k 2021-05-26T16:39:59.469 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:39:59.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rgw 2021-05-26T16:39:59.589 INFO:teuthology.orchestra.run.smithi003.stdout:libcephfs-devel-17.0.0-4646.ged4edd0b.el8.x86_6 194 kB/s | 24 kB 00:00 2021-05-26T16:39:59.590 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:39:59.590 INFO:teuthology.orchestra.run.smithi003.stdout:Total 192 kB/s | 24 kB 00:00 2021-05-26T16:39:59.591 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:39:59.595 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:39:59.595 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:39:59.597 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:39:59.601 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:39:59.650 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:39:59.844 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:00.027 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:05 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:40:00.048 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:00.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:00.291 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:40:00.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:40:00.519 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:40:00.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:00.539 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:00.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados2 2021-05-26T16:40:00.706 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:40:00.707 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:40:00.707 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:40:00.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-cephfs 2021-05-26T16:40:01.176 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:00 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:01.333 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:06 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:40:01.729 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:01.830 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:01.916 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:01.917 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:40:01.917 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:01.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librbd1 2021-05-26T16:40:02.003 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:40:02.004 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:40:02.004 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:40:02.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rbd 2021-05-26T16:40:02.565 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:01 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:02.653 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:07 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:40:03.105 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:03.163 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:03.282 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:03.283 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:40:03.283 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:03.333 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:40:03.334 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2021-05-26T16:40:03.334 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:40:03.349 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rados 2021-05-26T16:40:03.410 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-fuse 2021-05-26T16:40:03.928 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:02 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:03.952 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:08 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:40:04.479 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rados-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:40:04.662 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:04.748 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rgw 2021-05-26T16:40:05.154 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:40:05.155 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:05.156 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2021-05-26T16:40:05.156 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:05.156 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:40:05.156 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 90 k 2021-05-26T16:40:05.157 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:05.157 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:40:05.157 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:05.157 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2021-05-26T16:40:05.157 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:05.158 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 90 k 2021-05-26T16:40:05.158 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 320 k 2021-05-26T16:40:05.158 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:40:05.301 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-fuse-17.0.0-4646.ged4edd0b.el8.x86_64.rpm 622 kB/s | 90 kB 00:00 2021-05-26T16:40:05.302 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:40:05.303 INFO:teuthology.orchestra.run.smithi137.stdout:Total 616 kB/s | 90 kB 00:00 2021-05-26T16:40:05.303 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:40:05.315 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:40:05.315 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:40:05.325 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:04 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:05.365 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:40:05.370 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:40:05.473 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:40:05.704 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:05.854 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rgw-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:05.942 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:06.036 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:06.037 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:40:06.038 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:06.111 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-cephfs 2021-05-26T16:40:06.177 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:06.177 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:40:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:06.410 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:40:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:40:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:06.411 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:40:06.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-mirror 2021-05-26T16:40:06.688 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:05 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:07.143 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:12 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:40:07.646 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-cephfs-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:07.826 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:07.827 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:40:07.827 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:07.843 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:40:07.844 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:07.845 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2021-05-26T16:40:07.845 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:07.846 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:40:07.846 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.7 M 2021-05-26T16:40:07.846 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:07.846 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:40:07.847 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:07.847 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2021-05-26T16:40:07.847 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:07.847 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 3.7 M 2021-05-26T16:40:07.848 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 21 M 2021-05-26T16:40:07.848 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:40:07.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rbd 2021-05-26T16:40:08.181 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-mirror-17.0.0-4646.ged4edd0b.el8.x86_64.rpm 11 MB/s | 3.7 MB 00:00 2021-05-26T16:40:08.182 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:40:08.182 INFO:teuthology.orchestra.run.smithi137.stdout:Total 11 MB/s | 3.7 MB 00:00 2021-05-26T16:40:08.183 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:40:08.197 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:40:08.197 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:40:08.262 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:40:08.265 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:40:08.469 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:07 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:08.776 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:40:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:09.004 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 is already installed. 2021-05-26T16:40:09.184 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:09.185 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-05-26T16:40:09.186 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:09.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-fuse 2021-05-26T16:40:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:09.631 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:40:09.832 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:08 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:09.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:09.877 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:40:09.877 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:40:09.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:09.878 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:40:10.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-nbd 2021-05-26T16:40:10.537 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:10.538 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:10.538 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2021-05-26T16:40:10.538 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:10.538 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:40:10.539 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 90 k 2021-05-26T16:40:10.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:10.539 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:40:10.539 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:10.539 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-05-26T16:40:10.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:10.540 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 90 k 2021-05-26T16:40:10.540 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 320 k 2021-05-26T16:40:10.540 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:40:10.623 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:15 ago on Wed 26 May 2021 04:37:55 PM UTC. 2021-05-26T16:40:10.683 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-fuse-17.0.0-4646.ged4edd0b.el8.x86_64.rpm 623 kB/s | 90 kB 00:00 2021-05-26T16:40:10.684 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:40:10.684 INFO:teuthology.orchestra.run.smithi003.stdout:Total 618 kB/s | 90 kB 00:00 2021-05-26T16:40:10.684 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:40:10.697 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:40:10.698 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:40:10.864 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:40:11.092 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:11.298 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2021-05-26T16:40:11.299 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:11.300 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2021-05-26T16:40:11.300 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:11.300 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2021-05-26T16:40:11.300 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 171 k 2021-05-26T16:40:11.301 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:11.301 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2021-05-26T16:40:11.301 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2021-05-26T16:40:11.301 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2021-05-26T16:40:11.302 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:11.302 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 171 k 2021-05-26T16:40:11.302 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 671 k 2021-05-26T16:40:11.302 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2021-05-26T16:40:11.337 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:11.469 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-nbd-17.0.0-4646.ged4edd0b.el8.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2021-05-26T16:40:11.470 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:40:11.470 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.0 MB/s | 171 kB 00:00 2021-05-26T16:40:11.471 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2021-05-26T16:40:11.483 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2021-05-26T16:40:11.483 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2021-05-26T16:40:11.533 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2021-05-26T16:40:11.536 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2021-05-26T16:40:11.601 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:11.601 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:40:11.656 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2021-05-26T16:40:11.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:11.858 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:40:11.858 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:40:11.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:11.859 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:11.869 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:12.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-mirror 2021-05-26T16:40:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:12.362 INFO:teuthology.orchestra.run.smithi137.stdout:Installed products updated. 2021-05-26T16:40:12.608 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:11 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:12.611 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2021-05-26T16:40:12.611 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:40:12.611 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:12.611 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2021-05-26T16:40:12.795 DEBUG:teuthology.parallel:result is None 2021-05-26T16:40:13.313 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:13.314 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:13.314 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-05-26T16:40:13.314 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:13.314 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:40:13.314 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 3.7 M 2021-05-26T16:40:13.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:13.315 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:40:13.315 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:13.315 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-05-26T16:40:13.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:13.316 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 3.7 M 2021-05-26T16:40:13.316 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 21 M 2021-05-26T16:40:13.316 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:40:13.651 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-mirror-17.0.0-4646.ged4edd0b.el8.x86_64.rpm 11 MB/s | 3.7 MB 00:00 2021-05-26T16:40:13.652 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:40:13.653 INFO:teuthology.orchestra.run.smithi003.stdout:Total 11 MB/s | 3.7 MB 00:00 2021-05-26T16:40:13.653 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:40:13.668 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:40:13.668 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:40:13.737 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:40:13.740 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:40:14.254 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:40:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:15.135 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:40:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:15.381 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:40:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:40:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:15.381 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:15.574 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-nbd 2021-05-26T16:40:16.155 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:15 ago on Wed 26 May 2021 04:38:01 PM UTC. 2021-05-26T16:40:16.857 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-05-26T16:40:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2021-05-26T16:40:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:16.859 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-05-26T16:40:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:17.0.0-4646.ged4edd0b.el8 ceph 171 k 2021-05-26T16:40:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:16.859 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-05-26T16:40:16.860 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-05-26T16:40:16.860 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-05-26T16:40:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:16.860 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 171 k 2021-05-26T16:40:16.860 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 671 k 2021-05-26T16:40:16.861 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-05-26T16:40:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-nbd-17.0.0-4646.ged4edd0b.el8.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2021-05-26T16:40:17.028 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-05-26T16:40:17.028 INFO:teuthology.orchestra.run.smithi003.stdout:Total 1.0 MB/s | 171 kB 00:00 2021-05-26T16:40:17.029 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-05-26T16:40:17.042 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-05-26T16:40:17.043 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-05-26T16:40:17.097 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-05-26T16:40:17.100 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-05-26T16:40:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-05-26T16:40:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 1/1 2021-05-26T16:40:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-05-26T16:40:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:18.235 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-05-26T16:40:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:17.0.0-4646.ged4edd0b.el8.x86_64 2021-05-26T16:40:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:18.235 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-05-26T16:40:18.793 DEBUG:teuthology.parallel:result is None 2021-05-26T16:40:18.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2021-05-26T16:40:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2021-05-26T16:40:18.832 DEBUG:teuthology.misc:System to be installed: CentOS 2021-05-26T16:40:18.833 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ed4edd0b7e1e319db25251072e10833142271766 2021-05-26T16:40:18.984 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-05-26T16:40:19.009 INFO:teuthology.orchestra.run.smithi003.stdout:17.0.0-4646.ged4edd0b.el8 2021-05-26T16:40:19.010 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-4646.ged4edd0b.el8 2021-05-26T16:40:19.010 INFO:teuthology.task.install:The correct ceph version 17.0.0-4646.ged4edd0b is installed. 2021-05-26T16:40:19.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo lsb_release -is 2021-05-26T16:40:19.052 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS 2021-05-26T16:40:19.053 DEBUG:teuthology.misc:System to be installed: CentOS 2021-05-26T16:40:19.054 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ed4edd0b7e1e319db25251072e10833142271766 2021-05-26T16:40:19.206 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-05-26T16:40:19.261 INFO:teuthology.orchestra.run.smithi137.stdout:17.0.0-4646.ged4edd0b.el8 2021-05-26T16:40:19.261 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-4646.ged4edd0b.el8 2021-05-26T16:40:19.262 INFO:teuthology.task.install:The correct ceph version 17.0.0-4646.ged4edd0b is installed. 2021-05-26T16:40:19.262 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-05-26T16:40:19.263 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:19.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-05-26T16:40:19.292 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:19.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-05-26T16:40:19.329 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-05-26T16:40:19.330 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:19.330 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2021-05-26T16:40:19.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-05-26T16:40:19.431 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:19.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2021-05-26T16:40:19.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-05-26T16:40:19.527 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-05-26T16:40:19.528 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:19.528 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2021-05-26T16:40:19.557 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-05-26T16:40:19.624 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:19.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2021-05-26T16:40:19.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-05-26T16:40:19.718 INFO:teuthology.run_tasks:Running task ceph... 2021-05-26T16:40:19.784 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-05-26T16:40:19.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2021-05-26T16:40:19.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2021-05-26T16:40:19.814 INFO:tasks.ceph:Disabling ceph logrotate... 2021-05-26T16:40:19.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2021-05-26T16:40:19.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2021-05-26T16:40:19.882 INFO:tasks.ceph:Creating extra log directories... 2021-05-26T16:40:19.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-05-26T16:40:19.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-05-26T16:40:19.963 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-05-26T16:40:19.963 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2021-05-26T16:40:19.964 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136786', 'branch': 'wip-kefu-testing-2021-05-26-1620', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete}', 'email': 'tchaikov@gmail.com', 'first_in_suite': False, 'job_id': '6136786', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-05-26-1620'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': 'ed4edd0b7e1e319db25251072e10833142271766'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'ed4edd0b7e1e319db25251072e10833142271766'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-kefu-testing-2021-05-26-1620', 'sha1': 'ed4edd0b7e1e319db25251072e10833142271766'}}, 'owner': 'scheduled_kchai@teuthology', 'priority': 70, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'sha1': 'ed4edd0b7e1e319db25251072e10833142271766', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-kefu-testing-2021-05-26-1620', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ed4edd0b7e1e319db25251072e10833142271766', 'targets': {'smithi003.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWos8WqAmXBIjL+4kynrVOl+K/H5cPGRZE9whXNA4AiViWdLvNDWVkzjjAx8mOqJTbKEgwe4oi+Lvw7wvFpI7jmhCvaPPHVagmDXnYzuYS3ILeljwDLyjlT1vQIqPjjj+v2QxFbEgvM1stRcg0Ge0Q0ha5uO4psnTbjK8ouVFEfBxMjoFP1RibLqoG3FI3wZpWbydQQw0G6g26dDrkvJk6FT4m+b9HRV+f9Uy6n8FSGD9oaUS9JDflmfAzs1FyOjVsWES5J7NCS4mHLEXyAVYNx8MclbBtiguLtxYleLoHXWG/zqGNUJcI1ZqlKXUdwuUXB3wqGBad1Y5wWAkCG5fvvrGFEYgkjM2r25JkdJzcKx4/X2A2kksNDbFKvn4QSFsKdfRyrG41VzS5DOQVDPoaEYUi0QAi0R4sYsv1637GwkXO28Ih8F+3+ciC0Lwl+h+noLwRlpOtiTVIheQa0iUhTr5r4rOj7H6AFNXilDoWtWGfS7HKxAgJe1TtY1zASNk=', 'smithi137.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+i9AsGsRbxUs3rMA4+AfXppvvkfnsem2139hBMb8+fIISlbs87JNrLEukEXVAHnkUEItyYeJUgwwwYiwEiAzr8kTf5IEYbKbYv+TOGPYcH5Z7+nhFyvNUGsNdMSSMeQxEFORtKCpkIOy4BNbCWaWyfJwrwDsfw6Rjs1b/gjIqHKUm3xRicErjsqWKwS/UTER09uA65b18xma/kk0aN8G0tE82s9aJOOsRBdhb5rC8KrfAx+1fks0fGhiT6YaqKbHBiQJ9Ntx04v4ksPAfMA4Vs/QenCTbfSLGp9rNipIh5waHdXX8vgnQ3APUKIzo+L09OnC/igRqAzrgCdzcbe7n6ngv2ZhnKIJDvjsPTLH3e0w5vm02r2cGsnv8kGp7ooa6CWBFpdEZBaLj4IFi1tg7QgSb10GHeCn/Gaj9kk9Yf5d39ram4DnFAIbempTrht89fnoh4r62eZO/vOo6DCnOmHRWq8LeIfGi9Vi0NpruR7tUEAK87a0b4KlwW6HVsSs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'store_thrash': True, 'thrash_delay': 1, 'thrash_many': True}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology_branch': 'master', 'teuthology_sha1': '0c70841acf4fb31ca05cdbebbd295620aac53ce4', 'timestamp': '2021-05-26_11:04:40', 'tube': 'smithi', 'user': 'kchai', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.8274'} 2021-05-26T16:40:19.964 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-05-26T16:40:19.992 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-05-26T16:40:20.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2021-05-26T16:40:20.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2021-05-26T16:40:20.073 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:20.074 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2021-05-26T16:40:20.128 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-05-26T16:40:20.129 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-05-26T16:40:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-05-26T16:40:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.185 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 105063 Links: 1 2021-05-26T16:40:20.185 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.186 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.186 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-05-26 16:40:14.647639668 +0000 2021-05-26T16:40:20.186 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-05-26 16:37:14.324352302 +0000 2021-05-26T16:40:20.187 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-05-26 16:37:14.324352302 +0000 2021-05-26T16:40:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-05-26T16:40:20.195 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-05-26T16:40:20.195 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-05-26T16:40:20.196 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000239216 s, 2.1 MB/s 2021-05-26T16:40:20.199 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-05-26T16:40:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-05-26T16:40:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 102038 Links: 1 2021-05-26T16:40:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-05-26 16:40:14.647639668 +0000 2021-05-26T16:40:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-05-26 16:37:14.661347565 +0000 2021-05-26T16:40:20.257 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-05-26 16:37:14.661347565 +0000 2021-05-26T16:40:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-05-26T16:40:20.265 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-05-26T16:40:20.265 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-05-26T16:40:20.265 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000193064 s, 2.7 MB/s 2021-05-26T16:40:20.268 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-05-26T16:40:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-05-26T16:40:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 106157 Links: 1 2021-05-26T16:40:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-05-26 16:40:14.647639668 +0000 2021-05-26T16:40:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-05-26 16:37:14.998342828 +0000 2021-05-26T16:40:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-05-26 16:37:14.998342828 +0000 2021-05-26T16:40:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-05-26T16:40:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-05-26T16:40:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-05-26T16:40:20.334 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000307202 s, 1.7 MB/s 2021-05-26T16:40:20.336 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-05-26T16:40:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-05-26T16:40:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.391 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 109602 Links: 1 2021-05-26T16:40:20.391 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-05-26 16:40:14.647639668 +0000 2021-05-26T16:40:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-05-26 16:37:15.335338091 +0000 2021-05-26T16:40:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-05-26 16:37:15.335338091 +0000 2021-05-26T16:40:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-05-26T16:40:20.401 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-05-26T16:40:20.401 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-05-26T16:40:20.401 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000189432 s, 2.7 MB/s 2021-05-26T16:40:20.404 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:20.404 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:20.404 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2021-05-26T16:40:20.419 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-05-26T16:40:20.420 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-05-26T16:40:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-05-26T16:40:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.476 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 103791 Links: 1 2021-05-26T16:40:20.476 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.477 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.477 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2021-05-26 16:40:09.158102493 +0000 2021-05-26T16:40:20.477 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2021-05-26 16:37:08.763914640 +0000 2021-05-26T16:40:20.478 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2021-05-26 16:37:08.763914640 +0000 2021-05-26T16:40:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2021-05-26T16:40:20.485 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2021-05-26T16:40:20.485 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2021-05-26T16:40:20.486 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000261373 s, 2.0 MB/s 2021-05-26T16:40:20.488 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-05-26T16:40:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-05-26T16:40:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.544 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 106987 Links: 1 2021-05-26T16:40:20.544 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.545 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.545 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2021-05-26 16:40:09.158102493 +0000 2021-05-26T16:40:20.545 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2021-05-26 16:37:09.088908560 +0000 2021-05-26T16:40:20.545 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2021-05-26 16:37:09.088908560 +0000 2021-05-26T16:40:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2021-05-26T16:40:20.553 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2021-05-26T16:40:20.553 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2021-05-26T16:40:20.554 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000193114 s, 2.7 MB/s 2021-05-26T16:40:20.556 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-05-26T16:40:20.611 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-05-26T16:40:20.611 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.612 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 103288 Links: 1 2021-05-26T16:40:20.612 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.612 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.612 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2021-05-26 16:40:09.158102493 +0000 2021-05-26T16:40:20.613 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2021-05-26 16:37:09.413902481 +0000 2021-05-26T16:40:20.613 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2021-05-26 16:37:09.413902481 +0000 2021-05-26T16:40:20.613 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2021-05-26T16:40:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2021-05-26T16:40:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2021-05-26T16:40:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000235777 s, 2.2 MB/s 2021-05-26T16:40:20.624 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-05-26T16:40:20.678 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-05-26T16:40:20.679 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-05-26T16:40:20.679 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 109734 Links: 1 2021-05-26T16:40:20.679 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-05-26T16:40:20.679 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2021-05-26T16:40:20.679 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2021-05-26 16:40:09.158102493 +0000 2021-05-26T16:40:20.680 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2021-05-26 16:37:09.764895916 +0000 2021-05-26T16:40:20.680 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2021-05-26 16:37:09.764895916 +0000 2021-05-26T16:40:20.680 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2021-05-26T16:40:20.688 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2021-05-26T16:40:20.688 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2021-05-26T16:40:20.688 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000217973 s, 2.3 MB/s 2021-05-26T16:40:20.691 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:20.691 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2021-05-26T16:40:20.691 INFO:tasks.ceph:Generating config... 2021-05-26T16:40:20.693 INFO:tasks.ceph:[client] debug monc = 20 2021-05-26T16:40:20.693 INFO:tasks.ceph:[client] debug ms = 1 2021-05-26T16:40:20.693 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-05-26T16:40:20.694 INFO:tasks.ceph:[global] mon election default strategy = 1 2021-05-26T16:40:20.694 INFO:tasks.ceph:[global] ms bind msgr2 = False 2021-05-26T16:40:20.694 INFO:tasks.ceph:[global] ms inject delay max = 1 2021-05-26T16:40:20.695 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2021-05-26T16:40:20.695 INFO:tasks.ceph:[global] ms inject delay type = mon 2021-05-26T16:40:20.695 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2021-05-26T16:40:20.696 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2021-05-26T16:40:20.696 INFO:tasks.ceph:[global] ms type = async 2021-05-26T16:40:20.696 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-05-26T16:40:20.696 INFO:tasks.ceph:[mgr] debug monc = 10 2021-05-26T16:40:20.697 INFO:tasks.ceph:[mgr] debug ms = 1 2021-05-26T16:40:20.697 INFO:tasks.ceph:[mon] debug mon = 20 2021-05-26T16:40:20.698 INFO:tasks.ceph:[mon] debug ms = 1 2021-05-26T16:40:20.698 INFO:tasks.ceph:[mon] debug paxos = 20 2021-05-26T16:40:20.698 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2021-05-26T16:40:20.699 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2021-05-26T16:40:20.699 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2021-05-26T16:40:20.699 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2021-05-26T16:40:20.699 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2021-05-26T16:40:20.700 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2021-05-26T16:40:20.700 INFO:tasks.ceph:[mon] mon scrub interval = 300 2021-05-26T16:40:20.700 INFO:tasks.ceph:[mon] paxos service trim min = 5 2021-05-26T16:40:20.701 INFO:tasks.ceph:[osd] bdev async discard = True 2021-05-26T16:40:20.701 INFO:tasks.ceph:[osd] bdev enable discard = True 2021-05-26T16:40:20.701 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-05-26T16:40:20.702 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-05-26T16:40:20.702 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-05-26T16:40:20.702 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-05-26T16:40:20.703 INFO:tasks.ceph:[osd] debug ms = 1 2021-05-26T16:40:20.703 INFO:tasks.ceph:[osd] debug osd = 20 2021-05-26T16:40:20.703 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-05-26T16:40:20.703 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-05-26T16:40:20.704 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-05-26T16:40:20.704 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-05-26T16:40:20.704 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2021-05-26T16:40:20.705 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2021-05-26T16:40:20.705 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-05-26T16:40:20.705 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2021-05-26T16:40:20.705 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-05-26T16:40:20.706 INFO:tasks.ceph:[osd] osd op queue = debug_random 2021-05-26T16:40:20.706 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2021-05-26T16:40:20.706 INFO:tasks.ceph:Setting up mon.a... 2021-05-26T16:40:20.707 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2021-05-26T16:40:20.768 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-05-26T16:40:20.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-05-26T16:40:20.874 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.3:6789]'), ('mon.b', '[v1:172.21.15.3:6790]'), ('mon.c', '[v1:172.21.15.3:6791]'), ('mon.d', '[v1:172.21.15.3:6792]'), ('mon.e', '[v1:172.21.15.3:6793]'), ('mon.f', '[v1:172.21.15.137:6789]'), ('mon.g', '[v1:172.21.15.137:6790]'), ('mon.h', '[v1:172.21.15.137:6791]'), ('mon.i', '[v1:172.21.15.137:6792]')] 2021-05-26T16:40:20.875 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.3:6789],[v1:172.21.15.3:6790],[v1:172.21.15.3:6791],[v1:172.21.15.3:6792],[v1:172.21.15.3:6793],[v1:172.21.15.137:6789],[v1:172.21.15.137:6790],[v1:172.21.15.137:6791],[v1:172.21.15.137:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2021-05-26T16:40:20.876 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:20.876 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-05-26T16:40:20.929 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.3:6789]' --addv b '[v1:172.21.15.3:6790]' --addv c '[v1:172.21.15.3:6791]' --addv d '[v1:172.21.15.3:6792]' --addv e '[v1:172.21.15.3:6793]' --addv f '[v1:172.21.15.137:6789]' --addv g '[v1:172.21.15.137:6790]' --addv h '[v1:172.21.15.137:6791]' --addv i '[v1:172.21.15.137:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:21.027 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:21.028 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:21.028 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = octopus 2021-05-26T16:40:21.029 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2021-05-26T16:40:21.029 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:21.029 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 15 (octopus) 2021-05-26T16:40:21.031 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2021-05-26T16:40:21.031 INFO:teuthology.orchestra.run.smithi003.stdout:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:21.031 INFO:teuthology.orchestra.run.smithi003.stdout:1: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:21.032 INFO:teuthology.orchestra.run.smithi003.stdout:2: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:21.032 INFO:teuthology.orchestra.run.smithi003.stdout:3: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:4: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:5: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:6: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:7: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:8: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:21.035 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2021-05-26T16:40:21.037 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-05-26T16:40:21.052 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1c28cdc4-a665-4986-9729-a987ae3508f4... 2021-05-26T16:40:21.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-05-26T16:40:21.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-05-26T16:40:21.137 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2021-05-26T16:40:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2021-05-26T16:40:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-05-26T16:40:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2021-05-26T16:40:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2021-05-26T16:40:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2021-05-26T16:40:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2021-05-26T16:40:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2021-05-26T16:40:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2021-05-26T16:40:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2021-05-26T16:40:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2021-05-26T16:40:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2021-05-26T16:40:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2021-05-26T16:40:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2021-05-26T16:40:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2021-05-26T16:40:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2021-05-26T16:40:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2021-05-26T16:40:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2021-05-26T16:40:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2021-05-26T16:40:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2021-05-26T16:40:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2021-05-26T16:40:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2021-05-26T16:40:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-05-26T16:40:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2021-05-26T16:40:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2021-05-26T16:40:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-05-26T16:40:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2021-05-26T16:40:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2021-05-26T16:40:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2021-05-26T16:40:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2021-05-26T16:40:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2021-05-26T16:40:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = "[v1:172.21.15.3:6789],[v1:172.21.15.3:6790],[v1:172.21.15.3:6791],[v1:172.21.15.3:6792],[v1:172.21.15.3:6793],[v1:172.21.15.137:6789],[v1:172.21.15.137:6790],[v1:172.21.15.137:6791],[v1:172.21.15.137:6792]" 2021-05-26T16:40:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: mon client directed command retry = 5 2021-05-26T16:40:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: mon election default strategy = 1 2021-05-26T16:40:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: ms bind msgr2 = False 2021-05-26T16:40:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: ms inject delay max = 1 2021-05-26T16:40:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: ms inject delay probability = 0.005 2021-05-26T16:40:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: ms inject delay type = mon 2021-05-26T16:40:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: ms inject internal delays = 0.002 2021-05-26T16:40:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: ms inject socket failures = 2500 2021-05-26T16:40:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: ms type = async 2021-05-26T16:40:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.149 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2021-05-26T16:40:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2021-05-26T16:40:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2021-05-26T16:40:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2021-05-26T16:40:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2021-05-26T16:40:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2021-05-26T16:40:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2021-05-26T16:40:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2021-05-26T16:40:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2021-05-26T16:40:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2021-05-26T16:40:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2021-05-26T16:40:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2021-05-26T16:40:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2021-05-26T16:40:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2021-05-26T16:40:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2021-05-26T16:40:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2021-05-26T16:40:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2021-05-26T16:40:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2021-05-26T16:40:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: bdev async discard = True 2021-05-26T16:40:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: bdev enable discard = True 2021-05-26T16:40:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2021-05-26T16:40:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2021-05-26T16:40:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 20 2021-05-26T16:40:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 20 2021-05-26T16:40:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2021-05-26T16:40:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2021-05-26T16:40:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 10 2021-05-26T16:40:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2021-05-26T16:40:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2021-05-26T16:40:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2021-05-26T16:40:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify cached snaps = True 2021-05-26T16:40:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify missing on start = True 2021-05-26T16:40:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2021-05-26T16:40:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: osd memory target = 1610612736 2021-05-26T16:40:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2021-05-26T16:40:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: osd op queue = debug_random 2021-05-26T16:40:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: osd op queue cut off = debug_random 2021-05-26T16:40:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2021-05-26T16:40:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2021-05-26T16:40:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2021-05-26T16:40:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2021-05-26T16:40:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2021-05-26T16:40:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2021-05-26T16:40:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2021-05-26T16:40:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2021-05-26T16:40:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: debug monc = 10 2021-05-26T16:40:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.161 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2021-05-26T16:40:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2021-05-26T16:40:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2021-05-26T16:40:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2021-05-26T16:40:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2021-05-26T16:40:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2021-05-26T16:40:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2021-05-26T16:40:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2021-05-26T16:40:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2021-05-26T16:40:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2021-05-26T16:40:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2021-05-26T16:40:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-05-26T16:40:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2021-05-26T16:40:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2021-05-26T16:40:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2021-05-26T16:40:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-05-26T16:40:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-05-26T16:40:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: mon min osdmap epochs = 25 2021-05-26T16:40:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune interval = 2 2021-05-26T16:40:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune min = 15 2021-05-26T16:40:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune txsize = 2 2021-05-26T16:40:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: mon scrub inject crc mismatch = 0.01 2021-05-26T16:40:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: mon scrub inject missing keys = 0.05 2021-05-26T16:40:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: mon scrub interval = 300 2021-05-26T16:40:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: paxos service trim min = 5 2021-05-26T16:40:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:40:21.167 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2021-05-26T16:40:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2021-05-26T16:40:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2021-05-26T16:40:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2021-05-26T16:40:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-05-26T16:40:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-05-26T16:40:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: debug monc = 20 2021-05-26T16:40:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2021-05-26T16:40:21.168 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2021-05-26T16:40:21.168 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.b] 2021-05-26T16:40:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.c] 2021-05-26T16:40:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.d] 2021-05-26T16:40:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.e] 2021-05-26T16:40:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.f] 2021-05-26T16:40:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.g] 2021-05-26T16:40:21.170 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.h] 2021-05-26T16:40:21.170 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.i] 2021-05-26T16:40:21.172 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2021-05-26T16:40:21.172 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2021-05-26T16:40:21.172 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-05-26T16:40:21.172 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2021-05-26T16:40:21.172 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.173 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2021-05-26T16:40:21.173 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.173 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2021-05-26T16:40:21.173 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.174 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2021-05-26T16:40:21.174 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2021-05-26T16:40:21.174 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.174 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2021-05-26T16:40:21.174 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2021-05-26T16:40:21.175 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.175 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2021-05-26T16:40:21.175 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2021-05-26T16:40:21.175 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.175 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2021-05-26T16:40:21.176 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2021-05-26T16:40:21.176 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.176 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2021-05-26T16:40:21.176 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.176 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2021-05-26T16:40:21.177 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2021-05-26T16:40:21.177 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2021-05-26T16:40:21.177 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2021-05-26T16:40:21.177 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2021-05-26T16:40:21.177 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2021-05-26T16:40:21.178 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2021-05-26T16:40:21.178 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-05-26T16:40:21.178 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2021-05-26T16:40:21.178 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2021-05-26T16:40:21.179 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.179 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-05-26T16:40:21.179 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.179 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2021-05-26T16:40:21.179 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.180 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2021-05-26T16:40:21.180 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.180 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2021-05-26T16:40:21.180 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2021-05-26T16:40:21.180 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2021-05-26T16:40:21.181 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "[v1:172.21.15.3:6789],[v1:172.21.15.3:6790],[v1:172.21.15.3:6791],[v1:172.21.15.3:6792],[v1:172.21.15.3:6793],[v1:172.21.15.137:6789],[v1:172.21.15.137:6790],[v1:172.21.15.137:6791],[v1:172.21.15.137:6792]" 2021-05-26T16:40:21.181 INFO:teuthology.orchestra.run.smithi137.stdout: mon client directed command retry = 5 2021-05-26T16:40:21.181 INFO:teuthology.orchestra.run.smithi137.stdout: mon election default strategy = 1 2021-05-26T16:40:21.181 INFO:teuthology.orchestra.run.smithi137.stdout: ms bind msgr2 = False 2021-05-26T16:40:21.181 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay max = 1 2021-05-26T16:40:21.182 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay probability = 0.005 2021-05-26T16:40:21.182 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay type = mon 2021-05-26T16:40:21.182 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject internal delays = 0.002 2021-05-26T16:40:21.182 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject socket failures = 2500 2021-05-26T16:40:21.183 INFO:teuthology.orchestra.run.smithi137.stdout: ms type = async 2021-05-26T16:40:21.183 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:21.183 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.183 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2021-05-26T16:40:21.183 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2021-05-26T16:40:21.184 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.184 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2021-05-26T16:40:21.184 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2021-05-26T16:40:21.184 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.184 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2021-05-26T16:40:21.185 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2021-05-26T16:40:21.185 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.185 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2021-05-26T16:40:21.185 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2021-05-26T16:40:21.185 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2021-05-26T16:40:21.186 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.186 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2021-05-26T16:40:21.186 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2021-05-26T16:40:21.186 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.187 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2021-05-26T16:40:21.187 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.187 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2021-05-26T16:40:21.187 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.187 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2021-05-26T16:40:21.188 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.188 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2021-05-26T16:40:21.188 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2021-05-26T16:40:21.188 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.188 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2021-05-26T16:40:21.189 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2021-05-26T16:40:21.189 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2021-05-26T16:40:21.189 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2021-05-26T16:40:21.189 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2021-05-26T16:40:21.189 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2021-05-26T16:40:21.190 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 20 2021-05-26T16:40:21.190 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 20 2021-05-26T16:40:21.190 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2021-05-26T16:40:21.190 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2021-05-26T16:40:21.191 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 10 2021-05-26T16:40:21.191 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2021-05-26T16:40:21.191 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2021-05-26T16:40:21.191 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2021-05-26T16:40:21.191 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify cached snaps = True 2021-05-26T16:40:21.192 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify missing on start = True 2021-05-26T16:40:21.192 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2021-05-26T16:40:21.192 INFO:teuthology.orchestra.run.smithi137.stdout: osd memory target = 1610612736 2021-05-26T16:40:21.192 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2021-05-26T16:40:21.192 INFO:teuthology.orchestra.run.smithi137.stdout: osd op queue = debug_random 2021-05-26T16:40:21.193 INFO:teuthology.orchestra.run.smithi137.stdout: osd op queue cut off = debug_random 2021-05-26T16:40:21.193 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.193 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2021-05-26T16:40:21.193 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2021-05-26T16:40:21.193 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2021-05-26T16:40:21.194 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2021-05-26T16:40:21.194 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2021-05-26T16:40:21.194 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2021-05-26T16:40:21.194 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2021-05-26T16:40:21.194 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2021-05-26T16:40:21.195 INFO:teuthology.orchestra.run.smithi137.stdout: debug monc = 10 2021-05-26T16:40:21.195 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.195 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2021-05-26T16:40:21.195 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2021-05-26T16:40:21.195 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2021-05-26T16:40:21.196 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2021-05-26T16:40:21.196 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2021-05-26T16:40:21.196 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2021-05-26T16:40:21.196 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2021-05-26T16:40:21.197 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2021-05-26T16:40:21.197 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2021-05-26T16:40:21.197 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2021-05-26T16:40:21.197 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2021-05-26T16:40:21.197 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.198 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-05-26T16:40:21.198 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2021-05-26T16:40:21.198 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2021-05-26T16:40:21.198 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.198 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2021-05-26T16:40:21.199 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-05-26T16:40:21.199 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-05-26T16:40:21.199 INFO:teuthology.orchestra.run.smithi137.stdout: mon min osdmap epochs = 25 2021-05-26T16:40:21.199 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune interval = 2 2021-05-26T16:40:21.199 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune min = 15 2021-05-26T16:40:21.200 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune txsize = 2 2021-05-26T16:40:21.200 INFO:teuthology.orchestra.run.smithi137.stdout: mon scrub inject crc mismatch = 0.01 2021-05-26T16:40:21.200 INFO:teuthology.orchestra.run.smithi137.stdout: mon scrub inject missing keys = 0.05 2021-05-26T16:40:21.200 INFO:teuthology.orchestra.run.smithi137.stdout: mon scrub interval = 300 2021-05-26T16:40:21.200 INFO:teuthology.orchestra.run.smithi137.stdout: paxos service trim min = 5 2021-05-26T16:40:21.201 INFO:teuthology.orchestra.run.smithi137.stdout: 2021-05-26T16:40:21.201 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2021-05-26T16:40:21.201 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2021-05-26T16:40:21.201 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2021-05-26T16:40:21.201 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2021-05-26T16:40:21.202 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-05-26T16:40:21.202 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-05-26T16:40:21.202 INFO:teuthology.orchestra.run.smithi137.stdout: debug monc = 20 2021-05-26T16:40:21.202 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2021-05-26T16:40:21.202 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2021-05-26T16:40:21.203 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2021-05-26T16:40:21.203 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2021-05-26T16:40:21.203 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.d] 2021-05-26T16:40:21.203 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.e] 2021-05-26T16:40:21.204 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.f] 2021-05-26T16:40:21.204 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.g] 2021-05-26T16:40:21.204 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.h] 2021-05-26T16:40:21.204 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.i] 2021-05-26T16:40:21.204 INFO:tasks.ceph:Creating admin key on mon.a... 2021-05-26T16:40:21.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-05-26T16:40:21.262 INFO:tasks.ceph:Copying monmap to all nodes... 2021-05-26T16:40:21.263 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:21.263 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-05-26T16:40:21.278 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:21.278 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-05-26T16:40:21.332 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2021-05-26T16:40:21.333 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:21.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2021-05-26T16:40:21.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-05-26T16:40:21.407 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:21.407 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:21.462 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:40:21.462 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:21.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2021-05-26T16:40:21.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-05-26T16:40:21.499 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:21.500 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:21.555 INFO:tasks.ceph:Setting up mon nodes... 2021-05-26T16:40:21.556 INFO:tasks.ceph:Setting up mgr nodes... 2021-05-26T16:40:21.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-05-26T16:40:21.748 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-05-26T16:40:21.751 INFO:tasks.ceph:Setting up mds nodes... 2021-05-26T16:40:21.751 INFO:tasks.ceph_client:Setting up client nodes... 2021-05-26T16:40:21.752 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-05-26T16:40:21.789 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-05-26T16:40:21.802 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-05-26T16:40:21.802 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2021-05-26T16:40:21.803 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-05-26T16:40:21.829 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:21.829 INFO:tasks.ceph:role: osd.0 2021-05-26T16:40:21.830 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2021-05-26T16:40:21.830 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-05-26T16:40:21.902 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-05-26T16:40:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2021-05-26T16:40:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-05-26T16:40:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2021-05-26T16:40:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-05-26T16:40:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2021-05-26T16:40:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-05-26T16:40:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-05-26T16:40:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-05-26T16:40:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-05-26T16:40:22.268 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2021-05-26T16:40:22.269 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2021-05-26T16:40:22.270 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-05-26T16:40:22.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-05-26T16:40:22.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-05-26T16:40:22.500 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:22.501 INFO:tasks.ceph:role: osd.1 2021-05-26T16:40:22.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2021-05-26T16:40:22.501 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-05-26T16:40:22.575 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-05-26T16:40:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2021-05-26T16:40:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-05-26T16:40:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2021-05-26T16:40:22.576 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-05-26T16:40:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2021-05-26T16:40:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-05-26T16:40:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-05-26T16:40:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-05-26T16:40:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-05-26T16:40:22.929 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2021-05-26T16:40:22.932 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2021-05-26T16:40:22.932 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-05-26T16:40:23.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-05-26T16:40:23.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-05-26T16:40:23.120 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:23.121 INFO:tasks.ceph:role: osd.2 2021-05-26T16:40:23.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2021-05-26T16:40:23.121 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-05-26T16:40:23.194 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-05-26T16:40:23.195 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2021-05-26T16:40:23.195 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-05-26T16:40:23.195 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2021-05-26T16:40:23.196 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-05-26T16:40:23.196 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2021-05-26T16:40:23.196 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-05-26T16:40:23.196 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-05-26T16:40:23.197 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-05-26T16:40:23.197 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-05-26T16:40:23.560 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2021-05-26T16:40:23.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2021-05-26T16:40:23.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-05-26T16:40:23.675 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-05-26T16:40:23.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:23.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:23.792+0000 7fdfbbccf0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-05-26T16:40:23.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:23.795+0000 7fdfbbccf0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-05-26T16:40:23.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:23.795+0000 7fdfbbccf0c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-05-26T16:40:23.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:23.795+0000 7fdfbbccf0c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-05-26T16:40:23.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:23.795+0000 7fdfbbccf0c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-05-26T16:40:23.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:23.796+0000 7fdfbbccf0c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-05-26T16:40:26.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-05-26T16:40:26.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:26.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:26.762+0000 7fe81b47d0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-05-26T16:40:26.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:26.762+0000 7fe81b47d0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-05-26T16:40:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:26.762+0000 7fe81b47d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-05-26T16:40:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:26.762+0000 7fe81b47d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-05-26T16:40:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:26.762+0000 7fe81b47d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-05-26T16:40:26.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:26.763+0000 7fe81b47d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-05-26T16:40:29.610 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-05-26T16:40:29.640 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:29.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:29.726+0000 7f1ede58e0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-05-26T16:40:29.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:29.727+0000 7f1ede58e0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-05-26T16:40:29.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:29.727+0000 7f1ede58e0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-05-26T16:40:29.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:29.727+0000 7f1ede58e0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-05-26T16:40:29.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:29.727+0000 7f1ede58e0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-05-26T16:40:29.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:29.727+0000 7f1ede58e0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-05-26T16:40:32.578 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-05-26T16:40:32.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-05-26T16:40:32.638 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:32.638 INFO:tasks.ceph:role: osd.3 2021-05-26T16:40:32.638 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:40:32.639 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-05-26T16:40:32.712 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-05-26T16:40:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2021-05-26T16:40:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-05-26T16:40:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2021-05-26T16:40:32.714 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-05-26T16:40:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2021-05-26T16:40:32.714 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-05-26T16:40:32.714 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-05-26T16:40:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-05-26T16:40:32.715 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-05-26T16:40:33.074 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2021-05-26T16:40:33.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2021-05-26T16:40:33.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2021-05-26T16:40:33.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-05-26T16:40:33.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-05-26T16:40:33.298 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:33.299 INFO:tasks.ceph:role: osd.4 2021-05-26T16:40:33.299 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:40:33.299 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-05-26T16:40:33.371 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-05-26T16:40:33.371 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2021-05-26T16:40:33.372 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-05-26T16:40:33.372 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2021-05-26T16:40:33.372 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-05-26T16:40:33.372 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2021-05-26T16:40:33.373 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-05-26T16:40:33.373 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-05-26T16:40:33.373 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-05-26T16:40:33.373 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-05-26T16:40:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2021-05-26T16:40:33.736 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2021-05-26T16:40:33.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2021-05-26T16:40:33.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-05-26T16:40:33.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-05-26T16:40:33.922 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-05-26T16:40:33.923 INFO:tasks.ceph:role: osd.5 2021-05-26T16:40:33.923 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:40:33.923 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-05-26T16:40:33.995 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-05-26T16:40:33.995 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2021-05-26T16:40:33.995 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-05-26T16:40:33.996 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2021-05-26T16:40:33.996 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-05-26T16:40:33.996 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2021-05-26T16:40:33.996 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-05-26T16:40:33.997 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-05-26T16:40:33.997 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-05-26T16:40:33.997 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-05-26T16:40:34.361 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2021-05-26T16:40:34.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2021-05-26T16:40:34.363 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2021-05-26T16:40:34.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-05-26T16:40:34.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:34.595 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:34.592+0000 7f7c279230c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-05-26T16:40:34.597 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:34.593+0000 7f7c279230c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-05-26T16:40:34.597 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:34.593+0000 7f7c279230c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-05-26T16:40:34.598 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:34.593+0000 7f7c279230c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-05-26T16:40:34.598 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:34.593+0000 7f7c279230c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-05-26T16:40:34.601 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:34.598+0000 7f7c279230c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-05-26T16:40:37.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-05-26T16:40:37.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:37.564 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:37.561+0000 7f13c940c0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-05-26T16:40:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:37.561+0000 7f13c940c0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-05-26T16:40:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:37.561+0000 7f13c940c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-05-26T16:40:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:37.561+0000 7f13c940c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-05-26T16:40:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:37.561+0000 7f13c940c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-05-26T16:40:37.566 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:37.562+0000 7f13c940c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-05-26T16:40:40.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-05-26T16:40:40.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:40.528 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:40.525+0000 7fa2fa0940c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-05-26T16:40:40.528 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:40.525+0000 7fa2fa0940c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-05-26T16:40:40.529 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:40.525+0000 7fa2fa0940c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-05-26T16:40:40.529 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:40.525+0000 7fa2fa0940c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-05-26T16:40:40.529 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:40.525+0000 7fa2fa0940c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-05-26T16:40:40.529 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:40.525+0000 7fa2fa0940c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-05-26T16:40:43.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-05-26T16:40:43.410 INFO:tasks.ceph:Reading keys from all nodes... 2021-05-26T16:40:43.410 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:43.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-05-26T16:40:43.442 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:43.442 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-05-26T16:40:43.511 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:43.512 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-05-26T16:40:43.580 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:43.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-05-26T16:40:43.611 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:43.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-05-26T16:40:43.679 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:43.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-05-26T16:40:43.746 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:43.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-05-26T16:40:43.811 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:43.812 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-05-26T16:40:43.866 INFO:tasks.ceph:Adding keys to all mons... 2021-05-26T16:40:43.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2021-05-26T16:40:43.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2021-05-26T16:40:43.910 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2021-05-26T16:40:43.910 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD3ea5greJJLxAA5+f7+R/Q1CodP9uUatHN/w== 2021-05-26T16:40:43.911 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2021-05-26T16:40:43.911 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD6ea5geE16LRAAyD+d/6SX5q0hCJholdCdjQ== 2021-05-26T16:40:43.911 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2021-05-26T16:40:43.911 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD9ea5gqlxdKxAAiq5pxyO0/c6IEiGXKp/NYQ== 2021-05-26T16:40:43.911 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2021-05-26T16:40:43.912 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD1ea5g9tWILBAAOo9yV7KM9tKJFGokaDVX3Q== 2021-05-26T16:40:43.912 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2021-05-26T16:40:43.912 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQACeq5gSA9bIxAAHEp2qQ/mAjCv3hdCSGusbQ== 2021-05-26T16:40:43.913 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2021-05-26T16:40:43.913 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAFeq5gvaOGIRAAiEmj6Db7bnoy39+AxQ6VyA== 2021-05-26T16:40:43.914 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2021-05-26T16:40:43.914 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAIeq5gSg9cHxAAuyInFbOFEYU9CNPvBBnAgQ== 2021-05-26T16:40:43.914 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2021-05-26T16:40:43.914 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD1ea5gl8n3LhAAblx33sPwEXPqDagxmOXEZA== 2021-05-26T16:40:43.930 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2021-05-26T16:40:43.931 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD3ea5greJJLxAA5+f7+R/Q1CodP9uUatHN/w== 2021-05-26T16:40:43.931 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2021-05-26T16:40:43.931 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD6ea5geE16LRAAyD+d/6SX5q0hCJholdCdjQ== 2021-05-26T16:40:43.931 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2021-05-26T16:40:43.931 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD9ea5gqlxdKxAAiq5pxyO0/c6IEiGXKp/NYQ== 2021-05-26T16:40:43.932 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2021-05-26T16:40:43.932 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD1ea5g9tWILBAAOo9yV7KM9tKJFGokaDVX3Q== 2021-05-26T16:40:43.932 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2021-05-26T16:40:43.932 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQACeq5gSA9bIxAAHEp2qQ/mAjCv3hdCSGusbQ== 2021-05-26T16:40:43.932 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2021-05-26T16:40:43.933 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAFeq5gvaOGIRAAiEmj6Db7bnoy39+AxQ6VyA== 2021-05-26T16:40:43.933 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2021-05-26T16:40:43.933 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAIeq5gSg9cHxAAuyInFbOFEYU9CNPvBBnAgQ== 2021-05-26T16:40:43.933 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2021-05-26T16:40:43.934 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD1ea5gl8n3LhAAblx33sPwEXPqDagxmOXEZA== 2021-05-26T16:40:43.935 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:43.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.021 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.024 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-05-26T16:40:44.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-05-26T16:40:44.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.304 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-05-26T16:40:44.350 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-05-26T16:40:44.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-05-26T16:40:44.400 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-05-26T16:40:44.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-05-26T16:40:44.426 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:44.521 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-05-26T16:40:44.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-05-26T16:40:44.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:44.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-05-26T16:40:44.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-05-26T16:40:44.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:44.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-05-26T16:40:44.916 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2021-05-26T16:40:44.981 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:45.073 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2021-05-26T16:40:45.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2021-05-26T16:40:45.164 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:45.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2021-05-26T16:40:45.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2021-05-26T16:40:45.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:45.403 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2021-05-26T16:40:45.429 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2021-05-26T16:40:45.493 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:45.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2021-05-26T16:40:45.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2021-05-26T16:40:45.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:45.765 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2021-05-26T16:40:45.790 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2021-05-26T16:40:45.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-05-26T16:40:45.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2021-05-26T16:40:45.970 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:45.973 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-05-26T16:40:46.023 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-05-26T16:40:46.024 INFO:tasks.ceph.mon.a:Restarting daemon 2021-05-26T16:40:46.025 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-05-26T16:40:46.029 INFO:tasks.ceph.mon.a:Started 2021-05-26T16:40:46.030 INFO:tasks.ceph.mon.b:Restarting daemon 2021-05-26T16:40:46.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-05-26T16:40:46.032 INFO:tasks.ceph.mon.b:Started 2021-05-26T16:40:46.033 INFO:tasks.ceph.mon.c:Restarting daemon 2021-05-26T16:40:46.033 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-05-26T16:40:46.036 INFO:tasks.ceph.mon.c:Started 2021-05-26T16:40:46.037 INFO:tasks.ceph.mon.d:Restarting daemon 2021-05-26T16:40:46.037 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2021-05-26T16:40:46.039 INFO:tasks.ceph.mon.d:Started 2021-05-26T16:40:46.041 INFO:tasks.ceph.mon.e:Restarting daemon 2021-05-26T16:40:46.041 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2021-05-26T16:40:46.043 INFO:tasks.ceph.mon.e:Started 2021-05-26T16:40:46.044 INFO:tasks.ceph.mon.f:Restarting daemon 2021-05-26T16:40:46.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2021-05-26T16:40:46.066 INFO:tasks.ceph.mon.f:Started 2021-05-26T16:40:46.066 INFO:tasks.ceph.mon.g:Restarting daemon 2021-05-26T16:40:46.067 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2021-05-26T16:40:46.069 INFO:tasks.ceph.mon.g:Started 2021-05-26T16:40:46.069 INFO:tasks.ceph.mon.h:Restarting daemon 2021-05-26T16:40:46.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2021-05-26T16:40:46.071 INFO:tasks.ceph.mon.h:Started 2021-05-26T16:40:46.072 INFO:tasks.ceph.mon.i:Restarting daemon 2021-05-26T16:40:46.072 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2021-05-26T16:40:46.075 INFO:tasks.ceph.mon.i:Started 2021-05-26T16:40:46.075 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-05-26T16:40:46.075 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-05-26T16:40:46.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-05-26T16:40:46.078 INFO:tasks.ceph.mgr.x:Started 2021-05-26T16:40:46.079 INFO:tasks.ceph:Setting crush tunables to default 2021-05-26T16:40:46.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2021-05-26T16:40:46.179 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:40:46.180 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.180 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.180 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.180 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.184 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:40:46.184 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.184 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.185 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.185 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.186 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:40:46.186 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.186 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.186 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.187 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.187 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:40:46.187 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.188 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.188 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.188 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.221 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.219+0000 7fd7ed7a7700 10 monclient: get_monmap_and_config 2021-05-26T16:40:46.222 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.219+0000 7fd7ed7a7700 10 monclient: build_initial_monmap 2021-05-26T16:40:46.222 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.219+0000 7fd7ed7a7700 10 monclient: monmap: 2021-05-26T16:40:46.222 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:40:46.222 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:46.223 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:46.220042+0000 2021-05-26T16:40:46.223 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:46.220042+0000 2021-05-26T16:40:46.223 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:46.223 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:46.224 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:46.224 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:46.224 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:46.224 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:46.225 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:46.225 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:46.225 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:46.226 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:46.226 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:46.227 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:40:46.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 1 Processor -- start 2021-05-26T16:40:46.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 1 -- start start 2021-05-26T16:40:46.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient: init 2021-05-26T16:40:46.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:46.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient: _add_conns ranks=[4,5,8,3,7,0,6,1,2] 2021-05-26T16:40:46.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient(hunting): picked mon.noname-c con 0x7fd7e812cbd0 addr v1:172.21.15.3:6791/0 2021-05-26T16:40:46.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient(hunting): picked mon.noname-h con 0x7fd7e8099a30 addr v1:172.21.15.137:6791/0 2021-05-26T16:40:46.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient(hunting): picked mon.noname-e con 0x7fd7e8099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:40:46.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8046600 con 0x7fd7e812cbd0 2021-05-26T16:40:46.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e809b5e0 con 0x7fd7e8099a30 2021-05-26T16:40:46.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e812d8f0 con 0x7fd7e8099eb0 2021-05-26T16:40:46.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:46.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ed7a7700 10 monclient(hunting): authenticate will time out at 803.851695s 2021-05-26T16:40:46.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ecfa6700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fd7e8099eb0 0x7fd7e8135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:51602/0 (socket says 172.21.15.3:51602) 2021-05-26T16:40:46.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7e7fff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fd7e812cbd0 0x7fd7e812d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36034/0 (socket says 172.21.15.3:36034) 2021-05-26T16:40:46.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.220+0000 7fd7ecfa6700 1 -- 172.21.15.3:0/2944383343 learned_addr learned my addr 172.21.15.3:0/2944383343 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:40:46.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.223+0000 7fd7e7fff700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.3:6791/0 conn(0x7fd7e812cbd0 legacy=0x7fd7e812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:46.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.223+0000 7fd7ecfa6700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.3:6793/0 conn(0x7fd7e8099eb0 legacy=0x7fd7e8135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:46.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:46.223+0000 7fd7e77fe700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.137:6791/0 conn(0x7fd7e8099a30 legacy=0x7fd7e8131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:46.357 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:40:46.357 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.357 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.358 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.358 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.358 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:46.359 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.359 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.359 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.359 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.362 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:40:46.363 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.363 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.363 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.363 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.364 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:40:46.364 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.364 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.364 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.365 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.365 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:40:46.365 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.365 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.366 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.366 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.366 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:40:46.366 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.367 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.367 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.367 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.367 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:40:46.368 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.368 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.368 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.368 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.370 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:46.370 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.371 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.371 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.371 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.375 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:46.375 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.375 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.376 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.376 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.377 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:46.377 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.377 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.377 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.378 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.378 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:40:46.378 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.378 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.379 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.379 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.379 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:40:46.379 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.379 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:46.380 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:46.380 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:46.380 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:46.381 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.381 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.381 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.381 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.388 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:46.388 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.388 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.388 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.389 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:46.389 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:46.389 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:46.389 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:46.390 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:46.390 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 10 monclient(hunting): tick 2021-05-26T16:40:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 1 monclient(hunting): continuing hunt 2021-05-26T16:40:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:40:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.3:6793/0 conn(0x7fd7e8099eb0 legacy=0x7fd7e8135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.137:6791/0 conn(0x7fd7e8099a30 legacy=0x7fd7e8131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.3:6791/0 conn(0x7fd7e812cbd0 legacy=0x7fd7e812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 10 monclient: _add_conns ranks=[1,3,2,6,7,0] 2021-05-26T16:40:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 10 monclient(hunting): picked mon.noname-f con 0x7fd7d0003680 addr v1:172.21.15.137:6789/0 2021-05-26T16:40:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 10 monclient(hunting): picked mon.noname-g con 0x7fd7d0007310 addr v1:172.21.15.137:6790/0 2021-05-26T16:40:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 10 monclient(hunting): picked mon.noname-b con 0x7fd7d000b0a0 addr v1:172.21.15.3:6790/0 2021-05-26T16:40:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.220+0000 7fd7e5ffb700 1 -- 172.21.15.3:0/2944383343 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e809c2b0 con 0x7fd7d0003680 2021-05-26T16:40:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.221+0000 7fd7e5ffb700 1 -- 172.21.15.3:0/2944383343 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d000fe90 con 0x7fd7d000b0a0 2021-05-26T16:40:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.221+0000 7fd7e5ffb700 1 -- 172.21.15.3:0/2944383343 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d00110c0 con 0x7fd7d0007310 2021-05-26T16:40:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.221+0000 7fd7e5ffb700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.223+0000 7fd7ecfa6700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.3:6790/0 conn(0x7fd7d000b0a0 legacy=0x7fd7d000d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.223+0000 7fd7e7fff700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.137:6789/0 conn(0x7fd7d0003680 legacy=0x7fd7d0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:49.223+0000 7fd7e77fe700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.137:6790/0 conn(0x7fd7d0007310 legacy=0x7fd7d00097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:51.186 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:40:51.187 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.187 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.187 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.187 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.188 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:40:51.188 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.188 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.189 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.189 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.190 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:40:51.190 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.190 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.191 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.191 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.191 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:40:51.191 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.192 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.192 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.192 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.193 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:40:51.193 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.193 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.193 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.193 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.197 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:40:51.197 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.198 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.198 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.198 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.199 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:40:51.199 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.199 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.200 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.200 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.200 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:51.201 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.201 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.201 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.201 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.202 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:51.202 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.202 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.202 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.203 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.223 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:40:51.223 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.224 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.224 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.224 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.225 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:51.225 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.225 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.226 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.226 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.226 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:51.227 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.227 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.227 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.228 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.228 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:51.229 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.229 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.229 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.229 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.230 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:51.230 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.230 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.231 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.231 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.231 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:40:51.232 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.232 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.232 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.232 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.233 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:51.233 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.233 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.233 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.234 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.234 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:40:51.235 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.235 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.235 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.235 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.235 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:40:51.236 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.236 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.236 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.236 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.237 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:40:51.237 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.237 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.238 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.238 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.238 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:40:51.239 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.239 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.239 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.239 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.240 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:40:51.240 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.240 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:40:51.240 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:40:51.241 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:40:51.241 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:40:51.242 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.242 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.242 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.242 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.243 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:40:51.243 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.244 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:40:51.244 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.244 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.244 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.244 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.245 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.245 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.245 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.246 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:40:51.246 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.246 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.247 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.247 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.247 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:40:51.248 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.248 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.248 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.248 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.249 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:40:51.249 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.249 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.249 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.250 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.250 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:40:51.250 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.250 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.251 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.251 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.252 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:40:51.252 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.252 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.253 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.253 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:51.253 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:40:51.253 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:40:51.253 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:40:51.254 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:40:51.254 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:40:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586119977 0 0) 0x7fd7d000fe90 con 0x7fd7d000b0a0 2021-05-26T16:40:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): my global_id is 4106 2021-05-26T16:40:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7cc003270 con 0x7fd7d000b0a0 2021-05-26T16:40:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340007019 0 0) 0x7fd7d00110c0 con 0x7fd7d0007310 2021-05-26T16:40:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): my global_id is 4116 2021-05-26T16:40:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d000fe90 con 0x7fd7d0007310 2021-05-26T16:40:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564672351 0 0) 0x7fd7e809c2b0 con 0x7fd7d0003680 2021-05-26T16:40:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient(hunting): my global_id is 4114 2021-05-26T16:40:52.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d00110c0 con 0x7fd7d0003680 2021-05-26T16:40:52.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3849220578 0 0) 0x7fd7cc003270 con 0x7fd7d000b0a0 2021-05-26T16:40:52.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.137:6790/0 conn(0x7fd7d0007310 legacy=0x7fd7d00097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:52.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.137:6789/0 conn(0x7fd7d0003680 legacy=0x7fd7d0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:40:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 monclient: found mon.noname-b 2021-05-26T16:40:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7ecfa6700 1 -- 172.21.15.3:0/2944383343 reap_dead start 2021-05-26T16:40:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:40:52.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0012370 con 0x7fd7d000b0a0 2021-05-26T16:40:52.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: _finish_auth 0 2021-05-26T16:40:52.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:52.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7ed7a7700 5 monclient: authenticate success, global_id 4106 2021-05-26T16:40:52.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd7dc001e60 con 0x7fd7d000b0a0 2021-05-26T16:40:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7ed7a7700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:40:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: dump: 2021-05-26T16:40:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:40:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.037 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:52.037 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:52.037 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:52.038 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:52.038 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:52.038 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:52.040 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:40:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7ed7a7700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd7dc0020c0 con 0x7fd7d000b0a0 2021-05-26T16:40:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7ed7a7700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7ed7a7700 4 set_mon_vals no callback set 2021-05-26T16:40:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 1 -- 172.21.15.3:0/2944383343 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd7dc004cb0 con 0x7fd7d000b0a0 2021-05-26T16:40:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:52.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:40:52.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.020+0000 7fd7e6ffd700 10 monclient: dump: 2021-05-26T16:40:52.042 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:40:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:52.045 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:52.045 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:52.045 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:52.046 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:40:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.021+0000 7fd7ed7a7700 10 monclient: shutdown 2021-05-26T16:40:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.021+0000 7fd7ed7a7700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.021+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/2944383343 >> v1:172.21.15.3:6790/0 conn(0x7fd7d000b0a0 legacy=0x7fd7d000d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.021+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/2944383343 shutdown_connections 2021-05-26T16:40:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.021+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/2944383343 >> 172.21.15.3:0/2944383343 conn(0x7fd7e80a00c0 msgr2=0x7fd7e80a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.021+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/2944383343 shutdown_connections 2021-05-26T16:40:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.021+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/2944383343 wait complete. 2021-05-26T16:40:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.022+0000 7fd7ed7a7700 10 monclient: build_initial_monmap 2021-05-26T16:40:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.022+0000 7fd7ed7a7700 10 monclient: monmap: 2021-05-26T16:40:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:40:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:40:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:40:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:52.051 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:52.051 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:52.051 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:52.051 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:40:52.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.023+0000 7fd7ed7a7700 1 Processor -- start 2021-05-26T16:40:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.023+0000 7fd7ed7a7700 1 -- start start 2021-05-26T16:40:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.023+0000 7fd7ed7a7700 10 monclient: init 2021-05-26T16:40:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 10 monclient: _add_conns ranks=[2,1,0,3,6,8,4,5,7] 2021-05-26T16:40:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 10 monclient(hunting): picked mon.noname-b con 0x7fd7d000b0a0 addr v1:172.21.15.3:6790/0 2021-05-26T16:40:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 10 monclient(hunting): picked mon.noname-f con 0x7fd7e813c020 addr v1:172.21.15.137:6789/0 2021-05-26T16:40:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 10 monclient(hunting): picked mon.noname-a con 0x7fd7e813cbe0 addr v1:172.21.15.3:6789/0 2021-05-26T16:40:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e809b850 con 0x7fd7e813cbe0 2021-05-26T16:40:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8116b00 con 0x7fd7e813c020 2021-05-26T16:40:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8116da0 con 0x7fd7d000b0a0 2021-05-26T16:40:52.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:52.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ed7a7700 10 monclient(hunting): authenticate will time out at 809.655373s 2021-05-26T16:40:52.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ecfa6700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd7e813cbe0 0x7fd7e8144280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50600/0 (socket says 172.21.15.3:50600) 2021-05-26T16:40:52.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7ecfa6700 1 -- 172.21.15.3:0/470565638 learned_addr learned my addr 172.21.15.3:0/470565638 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:40:52.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.024+0000 7fd7e7fff700 1 --1- 172.21.15.3:0/470565638 >> v1:172.21.15.3:6790/0 conn(0x7fd7d000b0a0 0x7fd7e8117160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52640/0 (socket says 172.21.15.3:52640) 2021-05-26T16:40:52.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.026+0000 7fd7e7fff700 1 -- 172.21.15.3:0/470565638 >> v1:172.21.15.3:6790/0 conn(0x7fd7d000b0a0 legacy=0x7fd7e8117160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:52.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.026+0000 7fd7ecfa6700 1 -- 172.21.15.3:0/470565638 >> v1:172.21.15.3:6789/0 conn(0x7fd7e813cbe0 legacy=0x7fd7e8144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.026+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908678582 0 0) 0x7fd7e809b850 con 0x7fd7e813cbe0 2021-05-26T16:40:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.026+0000 7fd7cbfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.026+0000 7fd7cbfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.026+0000 7fd7cbfff700 10 monclient(hunting): my global_id is 4113 2021-05-26T16:40:52.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.026+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d0006040 con 0x7fd7e813cbe0 2021-05-26T16:40:52.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1519217482 0 0) 0x7fd7d0012370 con 0x7fd7e813cbe0 2021-05-26T16:40:52.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd7e809b850 con 0x7fd7e813cbe0 2021-05-26T16:40:52.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd7dc001dd0 con 0x7fd7e813cbe0 2021-05-26T16:40:52.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:52.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:40:52.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient(hunting): dump: 2021-05-26T16:40:52.061 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:40:52.061 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:52.064 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:52.064 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:52.064 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:52.064 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:40:52.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 781718845 0 0) 0x7fd7e809b850 con 0x7fd7e813cbe0 2021-05-26T16:40:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 >> v1:172.21.15.3:6790/0 conn(0x7fd7d000b0a0 legacy=0x7fd7e8117160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 >> v1:172.21.15.137:6789/0 conn(0x7fd7e813c020 legacy=0x7fd7e813c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient: _finish_hunting 0 2021-05-26T16:40:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 monclient: found mon.a 2021-05-26T16:40:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:40:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80951e0 con 0x7fd7e813cbe0 2021-05-26T16:40:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient: _finish_auth 0 2021-05-26T16:40:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7ed7a7700 5 monclient: authenticate success, global_id 4113 2021-05-26T16:40:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7ed7a7700 10 monclient: _renew_subs 2021-05-26T16:40:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7ed7a7700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:40:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e8095e40 con 0x7fd7e813cbe0 2021-05-26T16:40:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7ed7a7700 10 monclient: _renew_subs 2021-05-26T16:40:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7ed7a7700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:40:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e8145b60 con 0x7fd7e813cbe0 2021-05-26T16:40:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd7dc0018a0 con 0x7fd7e813cbe0 2021-05-26T16:40:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd7dc0051e0 con 0x7fd7e813cbe0 2021-05-26T16:40:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7e67fc700 4 set_mon_vals no callback set 2021-05-26T16:40:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:40:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 10 monclient: dump: 2021-05-26T16:40:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:40:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.071 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:52.071 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:52.071 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:52.071 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:52.071 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:52.072 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:52.072 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:52.072 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:52.072 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:52.073 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:52.073 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:52.073 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:52.073 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:40:52.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7fd7dc005620 con 0x7fd7e813cbe0 2021-05-26T16:40:52.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.027+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (unknown 744056857 0 0) 0x7fd7dc0067f0 con 0x7fd7e813cbe0 2021-05-26T16:40:52.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.028+0000 7fd7ed7a7700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:52.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.028+0000 7fd7ed7a7700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:52.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.028+0000 7fd7ed7a7700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:40:52.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.028+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4004db0 con 0x7fd7e813cbe0 2021-05-26T16:40:52.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.031+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7fd7d0006040 con 0x7fd7e813cbe0 2021-05-26T16:40:52.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.031+0000 7fd7cbfff700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:52.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.031+0000 7fd7cbfff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:52.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.104+0000 7fd7ed7a7700 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2021-05-26T16:40:52.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.104+0000 7fd7ed7a7700 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2021-05-26T16:40:52.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.105+0000 7fd7ed7a7700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:40:52.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.105+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd7c4005060 con 0x7fd7e813cbe0 2021-05-26T16:40:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.866+0000 7fd7cbfff700 1 -- 172.21.15.3:0/470565638 <== mon.0 v1:172.21.15.3:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (unknown 2277712955 0 0) 0x7fd7dc005b90 con 0x7fd7e813cbe0 2021-05-26T16:40:52.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.866+0000 7fd7cbfff700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2021-05-26T16:40:52.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.866+0000 7fd7cbfff700 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2021-05-26T16:40:52.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.867+0000 7fd7ed7a7700 10 monclient: shutdown 2021-05-26T16:40:52.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.867+0000 7fd7ed7a7700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.867+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 >> v1:172.21.15.3:6789/0 conn(0x7fd7e813cbe0 legacy=0x7fd7e8144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.867+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 shutdown_connections 2021-05-26T16:40:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.867+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 >> 172.21.15.3:0/470565638 conn(0x7fd7e80a00c0 msgr2=0x7fd7e812b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.868+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 shutdown_connections 2021-05-26T16:40:52.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:40:52.869+0000 7fd7ed7a7700 1 -- 172.21.15.3:0/470565638 wait complete. 2021-05-26T16:40:52.872 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2021-05-26T16:40:52.887 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-05-26T16:40:52.888 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:52.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-05-26T16:40:52.921 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:52.921 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-05-26T16:40:52.988 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-05-26T16:40:52.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-05-26T16:40:53.055 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:53.055 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-05-26T16:40:53.080 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:53.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-05-26T16:40:53.144 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2021-05-26T16:40:53.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-05-26T16:40:53.208 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 15008bbc-879f-43a6-bfbc-f16853c84582 0 2021-05-26T16:40:53.360 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.357+0000 7f31ea1b8700 10 monclient: get_monmap_and_config 2021-05-26T16:40:53.360 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.357+0000 7f31ea1b8700 10 monclient: build_initial_monmap 2021-05-26T16:40:53.360 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.357+0000 7f31ea1b8700 10 monclient: monmap: 2021-05-26T16:40:53.360 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:53.361 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:53.361 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:53.358273+0000 2021-05-26T16:40:53.361 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:53.358273+0000 2021-05-26T16:40:53.361 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:53.362 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:53.362 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:53.362 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:53.362 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:53.362 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:53.363 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:53.363 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:53.363 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:53.363 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:53.364 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:53.364 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:53.374 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.357+0000 7f31ea1b8700 1 Processor -- start 2021-05-26T16:40:53.374 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.357+0000 7f31ea1b8700 1 -- start start 2021-05-26T16:40:53.374 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.357+0000 7f31ea1b8700 10 monclient: init 2021-05-26T16:40:53.375 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:53.375 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 10 monclient: _add_conns ranks=[0,4,8,3,5,7,1,2,6] 2021-05-26T16:40:53.375 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 10 monclient(hunting): picked mon.noname-a con 0x7f31e412cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:40:53.375 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 10 monclient(hunting): picked mon.noname-c con 0x7f31e4099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:40:53.375 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 10 monclient(hunting): picked mon.noname-e con 0x7f31e4099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:40:53.376 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e4046600 con 0x7f31e412cbd0 2021-05-26T16:40:53.376 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e409b5e0 con 0x7f31e4099a30 2021-05-26T16:40:53.376 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e412d8f0 con 0x7f31e4099eb0 2021-05-26T16:40:53.376 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:53.377 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31ea1b8700 10 monclient(hunting): authenticate will time out at 797.837377s 2021-05-26T16:40:53.377 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31e89b5700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f31e4099a30 0x7f31e4131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.137:50220/0 (socket says 172.21.15.137:50220) 2021-05-26T16:40:53.377 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.358+0000 7f31e89b5700 1 -- 172.21.15.137:0/100822678 learned_addr learned my addr 172.21.15.137:0/100822678 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:53.377 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31e99b7700 1 -- 172.21.15.137:0/100822678 >> v1:172.21.15.3:6793/0 conn(0x7f31e4099eb0 legacy=0x7f31e4135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:53.378 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31e89b5700 1 -- 172.21.15.137:0/100822678 >> v1:172.21.15.3:6791/0 conn(0x7f31e4099a30 legacy=0x7f31e4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:53.378 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31e91b6700 1 -- 172.21.15.137:0/100822678 >> v1:172.21.15.3:6789/0 conn(0x7f31e412cbd0 legacy=0x7f31e412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:53.378 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255627774 0 0) 0x7f31e4046600 con 0x7f31e412cbd0 2021-05-26T16:40:53.378 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:53.379 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:53.379 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient(hunting): my global_id is 4122 2021-05-26T16:40:53.379 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31cc003270 con 0x7f31e412cbd0 2021-05-26T16:40:53.379 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2181207522 0 0) 0x7f31cc003270 con 0x7f31e412cbd0 2021-05-26T16:40:53.379 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 >> v1:172.21.15.3:6793/0 conn(0x7f31e4099eb0 legacy=0x7f31e4135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:53.380 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 >> v1:172.21.15.3:6791/0 conn(0x7f31e4099a30 legacy=0x7f31e4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:53.380 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: _finish_hunting 0 2021-05-26T16:40:53.380 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 monclient: found mon.noname-a 2021-05-26T16:40:53.380 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:53.381 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:40:53.381 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e409c2b0 con 0x7f31e412cbd0 2021-05-26T16:40:53.381 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: _finish_auth 0 2021-05-26T16:40:53.381 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:53.382 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f31d8001b70 con 0x7f31e412cbd0 2021-05-26T16:40:53.382 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31ea1b8700 5 monclient: authenticate success, global_id 4122 2021-05-26T16:40:53.382 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:53.382 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:40:53.383 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: dump: 2021-05-26T16:40:53.383 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:53.383 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:53.383 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.383 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.384 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:53.384 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:53.384 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:53.384 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:53.385 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:53.385 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:53.385 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:53.385 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:53.386 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:53.386 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:53.386 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:53.386 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:53.387 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31ea1b8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:53.387 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f31d8001f00 con 0x7f31e412cbd0 2021-05-26T16:40:53.387 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:53.387 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31ea1b8700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:53.387 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31ea1b8700 4 set_mon_vals no callback set 2021-05-26T16:40:53.388 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 1 -- 172.21.15.137:0/100822678 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f31d80023f0 con 0x7f31e412cbd0 2021-05-26T16:40:53.388 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:53.388 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:40:53.388 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.361+0000 7f31d3fff700 10 monclient: dump: 2021-05-26T16:40:53.388 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:53.389 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:53.389 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.389 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.389 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:53.390 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:53.390 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:53.391 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:53.391 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:53.391 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:53.391 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:53.391 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:53.392 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:53.392 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:53.392 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:53.392 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:53.392 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 10 monclient: shutdown 2021-05-26T16:40:53.393 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:53.393 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 1 -- 172.21.15.137:0/100822678 >> v1:172.21.15.3:6789/0 conn(0x7f31e412cbd0 legacy=0x7f31e412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:53.393 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 1 -- 172.21.15.137:0/100822678 shutdown_connections 2021-05-26T16:40:53.393 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 1 -- 172.21.15.137:0/100822678 >> 172.21.15.137:0/100822678 conn(0x7f31e40a00c0 msgr2=0x7f31e40a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:53.394 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 1 -- 172.21.15.137:0/100822678 shutdown_connections 2021-05-26T16:40:53.394 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 1 -- 172.21.15.137:0/100822678 wait complete. 2021-05-26T16:40:53.394 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 10 monclient: build_initial_monmap 2021-05-26T16:40:53.394 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.362+0000 7f31ea1b8700 10 monclient: monmap: 2021-05-26T16:40:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 0.000000 2021-05-26T16:40:53.396 INFO:teuthology.orchestra.run.smithi137.stderr:created 0.000000 2021-05-26T16:40:53.396 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:53.396 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:53.396 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:53.397 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:53.397 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:53.397 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:53.397 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:53.397 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:53.398 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:53.398 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:53.398 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:53.398 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:53.399 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 1 Processor -- start 2021-05-26T16:40:53.399 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 1 -- start start 2021-05-26T16:40:53.399 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient: init 2021-05-26T16:40:53.399 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:53.399 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient: _add_conns ranks=[6,3,7,5,1,8,4,2,0] 2021-05-26T16:40:53.400 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient(hunting): picked mon.noname-d con 0x7f31e4099a30 addr v1:172.21.15.3:6792/0 2021-05-26T16:40:53.400 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient(hunting): picked mon.noname-g con 0x7f31e4099eb0 addr v1:172.21.15.137:6790/0 2021-05-26T16:40:53.400 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient(hunting): picked mon.noname-i con 0x7f31e412cbd0 addr v1:172.21.15.137:6792/0 2021-05-26T16:40:53.400 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e409bd30 con 0x7f31e4099eb0 2021-05-26T16:40:53.401 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e409b850 con 0x7f31e4099a30 2021-05-26T16:40:53.401 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e413ccc0 con 0x7f31e412cbd0 2021-05-26T16:40:53.401 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:53.402 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31ea1b8700 10 monclient(hunting): authenticate will time out at 797.842792s 2021-05-26T16:40:53.402 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31e89b5700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f31e4099eb0 0x7f31e41410c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.137:56890/0 (socket says 172.21.15.137:56890) 2021-05-26T16:40:53.402 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.363+0000 7f31e89b5700 1 -- 172.21.15.137:0/2731356328 learned_addr learned my addr 172.21.15.137:0/2731356328 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:53.402 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31e89b5700 1 -- 172.21.15.137:0/2731356328 >> v1:172.21.15.137:6790/0 conn(0x7f31e4099eb0 legacy=0x7f31e41410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:53.402 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31e99b7700 1 -- 172.21.15.137:0/2731356328 >> v1:172.21.15.137:6792/0 conn(0x7f31e412cbd0 legacy=0x7f31e41447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:53.403 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31e91b6700 1 -- 172.21.15.137:0/2731356328 >> v1:172.21.15.3:6792/0 conn(0x7f31e4099a30 legacy=0x7f31e413c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:53.403 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984362507 0 0) 0x7f31e409b850 con 0x7f31e4099a30 2021-05-26T16:40:53.403 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:53.403 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:53.404 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient(hunting): my global_id is 4110 2021-05-26T16:40:53.404 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c4003270 con 0x7f31e4099a30 2021-05-26T16:40:53.404 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4083986209 0 0) 0x7f31c4003270 con 0x7f31e4099a30 2021-05-26T16:40:53.404 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31e409b850 con 0x7f31e4099a30 2021-05-26T16:40:53.404 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f31d8001b30 con 0x7f31e4099a30 2021-05-26T16:40:53.405 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:53.405 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:40:53.405 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient(hunting): dump: 2021-05-26T16:40:53.405 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:53.405 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:53.406 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.406 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.406 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:53.406 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:53.407 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:53.407 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:53.407 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:53.407 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:53.407 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:53.408 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:53.408 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:53.408 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:53.408 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:53.408 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:53.409 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:53.409 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1801301863 0 0) 0x7f31e409b850 con 0x7f31e4099a30 2021-05-26T16:40:53.409 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 >> v1:172.21.15.137:6792/0 conn(0x7f31e412cbd0 legacy=0x7f31e41447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:53.409 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 >> v1:172.21.15.137:6790/0 conn(0x7f31e4099eb0 legacy=0x7f31e41410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:53.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient: _finish_hunting 0 2021-05-26T16:40:53.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 monclient: found mon.d 2021-05-26T16:40:53.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:53.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:40:53.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4117000 con 0x7f31e4099a30 2021-05-26T16:40:53.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 10 monclient: _finish_auth 0 2021-05-26T16:40:53.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31d17fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:53.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31ea1b8700 5 monclient: authenticate success, global_id 4110 2021-05-26T16:40:53.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31ea1b8700 10 monclient: _renew_subs 2021-05-26T16:40:53.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31ea1b8700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:40:53.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e4131290 con 0x7f31e4099a30 2021-05-26T16:40:53.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31ea1b8700 10 monclient: _renew_subs 2021-05-26T16:40:53.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31ea1b8700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:40:53.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.366+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e41165c0 con 0x7f31e4099a30 2021-05-26T16:40:53.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f31d8002890 con 0x7f31e4099a30 2021-05-26T16:40:53.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:53.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d37fe700 4 set_mon_vals no callback set 2021-05-26T16:40:53.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f31d8002dc0 con 0x7f31e4099a30 2021-05-26T16:40:53.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:53.414 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:40:53.414 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 10 monclient: dump: 2021-05-26T16:40:53.414 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:53.414 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:53.414 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.415 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:53.415 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:53.415 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:53.415 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:53.416 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:53.416 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:53.416 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:53.416 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:53.416 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:53.417 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:53.417 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:53.417 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:53.417 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:53.417 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7f31d80057f0 con 0x7f31e4099a30 2021-05-26T16:40:53.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (unknown 1790634221 0 0) 0x7f31d8006a90 con 0x7f31e4099a30 2021-05-26T16:40:53.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31ea1b8700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:53.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31ea1b8700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:53.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31ea1b8700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:40:53.419 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.367+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc004db0 con 0x7f31e4099a30 2021-05-26T16:40:53.419 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.370+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7f31d8005d10 con 0x7f31e4099a30 2021-05-26T16:40:53.419 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.370+0000 7f31d17fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:53.419 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.370+0000 7f31d17fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:53.452 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.449+0000 7f31ea1b8700 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "15008bbc-879f-43a6-bfbc-f16853c84582", "id": 0}] 2021-05-26T16:40:53.453 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.449+0000 7f31ea1b8700 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "15008bbc-879f-43a6-bfbc-f16853c84582", "id": 0}] 2021-05-26T16:40:53.453 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.449+0000 7f31ea1b8700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:40:53.453 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:53.449+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "osd new", "uuid": "15008bbc-879f-43a6-bfbc-f16853c84582", "id": 0} v 0) v1 -- 0x7f31bc005060 con 0x7f31e4099a30 2021-05-26T16:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.043+0000 7f31d17fa700 1 -- 172.21.15.137:0/2731356328 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15008bbc-879f-43a6-bfbc-f16853c84582", "id": 0}]=0 v3) v1 ==== 112+0+2 (unknown 3528209182 0 732707515) 0x7f31d8005f90 con 0x7f31e4099a30 2021-05-26T16:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.043+0000 7f31d17fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "15008bbc-879f-43a6-bfbc-f16853c84582", "id": 0}] 2021-05-26T16:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.043+0000 7f31d17fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:40:54.047 INFO:teuthology.orchestra.run.smithi137.stdout:0 2021-05-26T16:40:54.048 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.044+0000 7f31ea1b8700 10 monclient: shutdown 2021-05-26T16:40:54.048 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.044+0000 7f31ea1b8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.048 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.044+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 >> v1:172.21.15.3:6792/0 conn(0x7f31e4099a30 legacy=0x7f31e413c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.049 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.044+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 shutdown_connections 2021-05-26T16:40:54.049 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.044+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 >> 172.21.15.137:0/2731356328 conn(0x7f31e40a00c0 msgr2=0x7f31e412b650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.049 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.044+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 shutdown_connections 2021-05-26T16:40:54.049 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.044+0000 7f31ea1b8700 1 -- 172.21.15.137:0/2731356328 wait complete. 2021-05-26T16:40:54.058 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 13c28fda-7809-4964-9b17-4c6fb9fff0ed 1 2021-05-26T16:40:54.169 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.166+0000 7fc67f947700 10 monclient: get_monmap_and_config 2021-05-26T16:40:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.166+0000 7fc67f947700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.166+0000 7fc67f947700 10 monclient: monmap: 2021-05-26T16:40:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:54.167829+0000 2021-05-26T16:40:54.171 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:54.167829+0000 2021-05-26T16:40:54.171 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.171 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.171 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.172 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.172 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.172 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.172 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.172 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.173 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.183 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 1 Processor -- start 2021-05-26T16:40:54.183 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 1 -- start start 2021-05-26T16:40:54.183 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient: init 2021-05-26T16:40:54.184 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.184 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient: _add_conns ranks=[5,0,7,1,8,3,2,4,6] 2021-05-26T16:40:54.184 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient(hunting): picked mon.noname-h con 0x7fc678064aa0 addr v1:172.21.15.137:6791/0 2021-05-26T16:40:54.184 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient(hunting): picked mon.noname-a con 0x7fc678099c40 addr v1:172.21.15.3:6789/0 2021-05-26T16:40:54.185 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient(hunting): picked mon.noname-i con 0x7fc67809a0c0 addr v1:172.21.15.137:6792/0 2021-05-26T16:40:54.185 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc678059750 con 0x7fc678099c40 2021-05-26T16:40:54.185 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67809a530 con 0x7fc678064aa0 2021-05-26T16:40:54.185 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67809c4e0 con 0x7fc67809a0c0 2021-05-26T16:40:54.186 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.186 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.167+0000 7fc67f947700 10 monclient(hunting): authenticate will time out at 798.646982s 2021-05-26T16:40:54.186 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.168+0000 7fc67dee4700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7fc67809a0c0 0x7fc6781357a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.137:46940/0 (socket says 172.21.15.137:46940) 2021-05-26T16:40:54.186 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.168+0000 7fc67d6e3700 1 --1- >> v1:172.21.15.137:6791/0 conn(0x7fc678064aa0 0x7fc678063f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6791/0 says I am v1:172.21.15.137:48458/0 (socket says 172.21.15.137:48458) 2021-05-26T16:40:54.186 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.168+0000 7fc67dee4700 1 -- 172.21.15.137:0/1371305787 learned_addr learned my addr 172.21.15.137:0/1371305787 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67d6e3700 1 -- 172.21.15.137:0/1371305787 >> v1:172.21.15.137:6791/0 conn(0x7fc678064aa0 legacy=0x7fc678063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67dee4700 1 -- 172.21.15.137:0/1371305787 >> v1:172.21.15.137:6792/0 conn(0x7fc67809a0c0 legacy=0x7fc6781357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333517878 0 0) 0x7fc668001450 con 0x7fc678064aa0 2021-05-26T16:40:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient(hunting): my global_id is 4109 2021-05-26T16:40:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc660003270 con 0x7fc678064aa0 2021-05-26T16:40:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729336636 0 0) 0x7fc67809c4e0 con 0x7fc67809a0c0 2021-05-26T16:40:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.189 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.189 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient(hunting): my global_id is 4111 2021-05-26T16:40:54.189 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc668001450 con 0x7fc67809a0c0 2021-05-26T16:40:54.189 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67cee2700 1 -- 172.21.15.137:0/1371305787 >> v1:172.21.15.3:6789/0 conn(0x7fc678099c40 legacy=0x7fc678132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.190 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939746614 0 0) 0x7fc660003270 con 0x7fc678064aa0 2021-05-26T16:40:54.190 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 >> v1:172.21.15.137:6792/0 conn(0x7fc67809a0c0 legacy=0x7fc6781357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.190 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 >> v1:172.21.15.3:6789/0 conn(0x7fc678099c40 legacy=0x7fc678132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.190 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.191 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 monclient: found mon.noname-h 2021-05-26T16:40:54.191 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.191 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.137:6791/0 2021-05-26T16:40:54.191 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67809c780 con 0x7fc678064aa0 2021-05-26T16:40:54.191 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.193 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.193 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67f947700 5 monclient: authenticate success, global_id 4109 2021-05-26T16:40:54.193 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc668001bf0 con 0x7fc678064aa0 2021-05-26T16:40:54.193 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.194 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2021-05-26T16:40:54.194 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient: dump: 2021-05-26T16:40:54.194 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.195 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.195 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.195 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.196 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.196 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.196 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.196 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.197 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.197 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.197 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.198 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.198 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.198 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.198 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.198 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.199 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67f947700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:54.199 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67d6e3700 1 --1- 172.21.15.137:0/1371305787 >> v1:172.21.15.137:6791/0 conn(0x7fc678064aa0 0x7fc678063f50 :-1 s=OPENED pgs=28 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7fc668004a20 mon_map magic: 0 v1 2021-05-26T16:40:54.199 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 <== mon.5 v1:172.21.15.137:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc668004570 con 0x7fc678064aa0 2021-05-26T16:40:54.199 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc667fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.200 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67f947700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:54.200 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.170+0000 7fc67f947700 4 set_mon_vals no callback set 2021-05-26T16:40:54.200 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc67f947700 10 monclient: shutdown 2021-05-26T16:40:54.200 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc67f947700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.200 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc67f947700 1 -- 172.21.15.137:0/1371305787 >> v1:172.21.15.137:6791/0 conn(0x7fc678064aa0 legacy=0x7fc678063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc667fff700 1 -- 172.21.15.137:0/1371305787 <== mon.5 v1:172.21.15.137:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc668004a20 con 0x7fc678064aa0 2021-05-26T16:40:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc667fff700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:40:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc67f947700 1 -- 172.21.15.137:0/1371305787 shutdown_connections 2021-05-26T16:40:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc67f947700 1 -- 172.21.15.137:0/1371305787 >> 172.21.15.137:0/1371305787 conn(0x7fc67805e1e0 msgr2=0x7fc67809cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc67f947700 1 -- 172.21.15.137:0/1371305787 shutdown_connections 2021-05-26T16:40:54.202 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.171+0000 7fc67f947700 1 -- 172.21.15.137:0/1371305787 wait complete. 2021-05-26T16:40:54.202 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.172+0000 7fc67f947700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.202 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.172+0000 7fc67f947700 10 monclient: monmap: 2021-05-26T16:40:54.202 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.203 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:54.203 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 0.000000 2021-05-26T16:40:54.203 INFO:teuthology.orchestra.run.smithi137.stderr:created 0.000000 2021-05-26T16:40:54.203 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.203 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.204 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.204 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.204 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.205 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.205 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.205 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.205 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.206 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.206 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.206 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.206 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.172+0000 7fc67f947700 1 Processor -- start 2021-05-26T16:40:54.206 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.172+0000 7fc67f947700 1 -- start start 2021-05-26T16:40:54.207 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.172+0000 7fc67f947700 10 monclient: init 2021-05-26T16:40:54.207 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.207 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 10 monclient: _add_conns ranks=[1,8,6,4,5,2,0,7,3] 2021-05-26T16:40:54.208 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 10 monclient(hunting): picked mon.noname-f con 0x7fc678099c40 addr v1:172.21.15.137:6789/0 2021-05-26T16:40:54.208 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 10 monclient(hunting): picked mon.noname-e con 0x7fc67809a0c0 addr v1:172.21.15.3:6793/0 2021-05-26T16:40:54.208 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 10 monclient(hunting): picked mon.noname-d con 0x7fc678130210 addr v1:172.21.15.3:6792/0 2021-05-26T16:40:54.208 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67813cd10 con 0x7fc678099c40 2021-05-26T16:40:54.208 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67811cd60 con 0x7fc678130210 2021-05-26T16:40:54.209 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67811d000 con 0x7fc67809a0c0 2021-05-26T16:40:54.209 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.209 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67f947700 10 monclient(hunting): authenticate will time out at 798.652148s 2021-05-26T16:40:54.209 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67d6e3700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc678099c40 0x7fc67812fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57850/0 (socket says 172.21.15.137:57850) 2021-05-26T16:40:54.209 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.173+0000 7fc67d6e3700 1 -- 172.21.15.137:0/983537613 learned_addr learned my addr 172.21.15.137:0/983537613 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.210 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc67d6e3700 1 -- 172.21.15.137:0/983537613 >> v1:172.21.15.137:6789/0 conn(0x7fc678099c40 legacy=0x7fc67812fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.210 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc67dee4700 1 -- 172.21.15.137:0/983537613 >> v1:172.21.15.3:6792/0 conn(0x7fc678130210 legacy=0x7fc678144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.210 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335407677 0 0) 0x7fc67813cd10 con 0x7fc678099c40 2021-05-26T16:40:54.210 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.211 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.211 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): my global_id is 4123 2021-05-26T16:40:54.211 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc658003270 con 0x7fc678099c40 2021-05-26T16:40:54.211 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc67cee2700 1 -- 172.21.15.137:0/983537613 >> v1:172.21.15.3:6793/0 conn(0x7fc67809a0c0 legacy=0x7fc678141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.211 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 422648086 0 0) 0x7fc658003270 con 0x7fc678099c40 2021-05-26T16:40:54.212 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc67813cd10 con 0x7fc678099c40 2021-05-26T16:40:54.212 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc668001bb0 con 0x7fc678099c40 2021-05-26T16:40:54.212 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.212 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2021-05-26T16:40:54.212 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): dump: 2021-05-26T16:40:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.215 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.215 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.215 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.215 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.215 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.216 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.216 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:54.216 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918008595 0 0) 0x7fc67811d000 con 0x7fc67809a0c0 2021-05-26T16:40:54.216 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.216 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.217 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): my global_id is 4112 2021-05-26T16:40:54.217 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc658003270 con 0x7fc67809a0c0 2021-05-26T16:40:54.217 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160127812 0 0) 0x7fc67811cd60 con 0x7fc678130210 2021-05-26T16:40:54.217 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.217 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.218 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 10 monclient(hunting): my global_id is 4119 2021-05-26T16:40:54.218 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.175+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc67811d000 con 0x7fc678130210 2021-05-26T16:40:54.218 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1667359934 0 0) 0x7fc67813cd10 con 0x7fc678099c40 2021-05-26T16:40:54.218 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 >> v1:172.21.15.3:6793/0 conn(0x7fc67809a0c0 legacy=0x7fc678141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.218 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 >> v1:172.21.15.3:6792/0 conn(0x7fc678130210 legacy=0x7fc678144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.219 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.219 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 monclient: found mon.f 2021-05-26T16:40:54.219 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.219 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.220 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67811d2a0 con 0x7fc678099c40 2021-05-26T16:40:54.220 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.220 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.220 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc67f947700 5 monclient: authenticate success, global_id 4123 2021-05-26T16:40:54.220 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc67f947700 10 monclient: _renew_subs 2021-05-26T16:40:54.221 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc67f947700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.221 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.137:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67811b3d0 con 0x7fc678099c40 2021-05-26T16:40:54.221 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc67f947700 10 monclient: _renew_subs 2021-05-26T16:40:54.221 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc67f947700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.221 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.137:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6781314b0 con 0x7fc678099c40 2021-05-26T16:40:54.222 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc6680013a0 con 0x7fc678099c40 2021-05-26T16:40:54.222 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.222 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc668005360 con 0x7fc678099c40 2021-05-26T16:40:54.222 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.222 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6677fe700 4 set_mon_vals no callback set 2021-05-26T16:40:54.223 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:40:54.223 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 10 monclient: dump: 2021-05-26T16:40:54.223 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.223 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.223 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.225 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.225 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.225 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.225 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.225 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.226 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.226 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.226 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.226 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7fc6680057a0 con 0x7fc678099c40 2021-05-26T16:40:54.227 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.176+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (unknown 355881075 0 0) 0x7fc668006860 con 0x7fc678099c40 2021-05-26T16:40:54.228 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.177+0000 7fc67f947700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.228 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.177+0000 7fc67f947700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.228 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.177+0000 7fc67f947700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.228 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.177+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.137:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc650004db0 con 0x7fc678099c40 2021-05-26T16:40:54.229 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.179+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7fc67809a530 con 0x7fc678099c40 2021-05-26T16:40:54.229 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.179+0000 7fc6657fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.229 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.179+0000 7fc6657fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:54.263 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.260+0000 7fc67f947700 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "13c28fda-7809-4964-9b17-4c6fb9fff0ed", "id": 1}] 2021-05-26T16:40:54.263 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.260+0000 7fc67f947700 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "13c28fda-7809-4964-9b17-4c6fb9fff0ed", "id": 1}] 2021-05-26T16:40:54.263 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.260+0000 7fc67f947700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.264 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.260+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 --> v1:172.21.15.137:6789/0 -- mon_command({"prefix": "osd new", "uuid": "13c28fda-7809-4964-9b17-4c6fb9fff0ed", "id": 1} v 0) v1 -- 0x7fc6500055e0 con 0x7fc678099c40 2021-05-26T16:40:54.269 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.266+0000 7fc6657fa700 1 -- 172.21.15.137:0/983537613 <== mon.1 v1:172.21.15.137:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13c28fda-7809-4964-9b17-4c6fb9fff0ed", "id": 1}]=0 v4) v1 ==== 112+0+2 (unknown 363299954 0 940483276) 0x7fc668005c60 con 0x7fc678099c40 2021-05-26T16:40:54.269 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.266+0000 7fc6657fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "13c28fda-7809-4964-9b17-4c6fb9fff0ed", "id": 1}] 2021-05-26T16:40:54.270 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.266+0000 7fc6657fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:40:54.270 INFO:teuthology.orchestra.run.smithi137.stdout:1 2021-05-26T16:40:54.271 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.267+0000 7fc67f947700 10 monclient: shutdown 2021-05-26T16:40:54.271 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.267+0000 7fc67f947700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.272 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.267+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 >> v1:172.21.15.137:6789/0 conn(0x7fc678099c40 legacy=0x7fc67812fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.272 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.267+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 shutdown_connections 2021-05-26T16:40:54.272 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.267+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 >> 172.21.15.137:0/983537613 conn(0x7fc678064aa0 msgr2=0x7fc678097be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.272 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.268+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 shutdown_connections 2021-05-26T16:40:54.272 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.268+0000 7fc67f947700 1 -- 172.21.15.137:0/983537613 wait complete. 2021-05-26T16:40:54.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new ca01de00-a5fb-4b03-9412-bca079506190 2 2021-05-26T16:40:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.391+0000 7fca0e19e700 10 monclient: get_monmap_and_config 2021-05-26T16:40:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.391+0000 7fca0e19e700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.391+0000 7fca0e19e700 10 monclient: monmap: 2021-05-26T16:40:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.396 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:54.392575+0000 2021-05-26T16:40:54.396 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:54.392575+0000 2021-05-26T16:40:54.396 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.396 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.397 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.397 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.397 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.397 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.397 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.398 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.398 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.399 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.391+0000 7fca0e19e700 1 Processor -- start 2021-05-26T16:40:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 1 -- start start 2021-05-26T16:40:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient: init 2021-05-26T16:40:54.409 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.409 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient: _add_conns ranks=[6,1,2,3,5,4,8,0,7] 2021-05-26T16:40:54.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient(hunting): picked mon.noname-d con 0x7fca08129770 addr v1:172.21.15.3:6792/0 2021-05-26T16:40:54.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient(hunting): picked mon.noname-f con 0x7fca08096d10 addr v1:172.21.15.137:6789/0 2021-05-26T16:40:54.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient(hunting): picked mon.noname-b con 0x7fca0812a050 addr v1:172.21.15.3:6790/0 2021-05-26T16:40:54.410 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08046600 con 0x7fca08096d10 2021-05-26T16:40:54.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0809c5d0 con 0x7fca0812a050 2021-05-26T16:40:54.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0812a4c0 con 0x7fca08129770 2021-05-26T16:40:54.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0e19e700 10 monclient(hunting): authenticate will time out at 798.871663s 2021-05-26T16:40:54.411 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0c99b700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fca08096d10 0x7fca08132020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57860/0 (socket says 172.21.15.137:57860) 2021-05-26T16:40:54.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.392+0000 7fca0c99b700 1 -- 172.21.15.137:0/2473385745 learned_addr learned my addr 172.21.15.137:0/2473385745 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.394+0000 7fca0c99b700 1 -- 172.21.15.137:0/2473385745 >> v1:172.21.15.137:6789/0 conn(0x7fca08096d10 legacy=0x7fca08132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fca0d99d700 1 -- 172.21.15.137:0/2473385745 >> v1:172.21.15.3:6790/0 conn(0x7fca0812a050 legacy=0x7fca08135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.412 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fca0d19c700 1 -- 172.21.15.137:0/2473385745 >> v1:172.21.15.3:6792/0 conn(0x7fca08129770 legacy=0x7fca08099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555767790 0 0) 0x7fca08046600 con 0x7fca08096d10 2021-05-26T16:40:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): my global_id is 4132 2021-05-26T16:40:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f0003270 con 0x7fca08096d10 2021-05-26T16:40:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935456525 0 0) 0x7fca0812a4c0 con 0x7fca08129770 2021-05-26T16:40:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): my global_id is 4128 2021-05-26T16:40:54.415 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca08046600 con 0x7fca08129770 2021-05-26T16:40:54.415 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753287302 0 0) 0x7fca0809c5d0 con 0x7fca0812a050 2021-05-26T16:40:54.415 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.415 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.415 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient(hunting): my global_id is 4115 2021-05-26T16:40:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca0812a4c0 con 0x7fca0812a050 2021-05-26T16:40:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982708371 0 0) 0x7fc9f0003270 con 0x7fca08096d10 2021-05-26T16:40:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 >> v1:172.21.15.3:6792/0 conn(0x7fca08129770 legacy=0x7fca08099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 >> v1:172.21.15.3:6790/0 conn(0x7fca0812a050 legacy=0x7fca08135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 monclient: found mon.noname-f 2021-05-26T16:40:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08097580 con 0x7fca08096d10 2021-05-26T16:40:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fca0e19e700 5 monclient: authenticate success, global_id 4132 2021-05-26T16:40:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc9fc001b20 con 0x7fca08096d10 2021-05-26T16:40:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fca0e19e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2021-05-26T16:40:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: dump: 2021-05-26T16:40:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.420 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.420 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.420 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.420 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.421 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.421 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.421 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.421 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.421 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.422 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.422 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.422 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.422 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.423 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.423 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fca0e19e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:54.423 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 <== mon.1 v1:172.21.15.137:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc9fc0045f0 con 0x7fca08096d10 2021-05-26T16:40:54.423 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.424 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fca0e19e700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:54.424 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 1 -- 172.21.15.137:0/2473385745 <== mon.1 v1:172.21.15.137:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc9fc004aa0 con 0x7fca08096d10 2021-05-26T16:40:54.424 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.424 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fca0e19e700 4 set_mon_vals no callback set 2021-05-26T16:40:54.424 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:40:54.425 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.395+0000 7fc9f7fff700 10 monclient: dump: 2021-05-26T16:40:54.425 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.425 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.425 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.425 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.426 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.426 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.426 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.426 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.427 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.427 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.427 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.427 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.427 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.428 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.428 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.428 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.428 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 10 monclient: shutdown 2021-05-26T16:40:54.429 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.429 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 1 -- 172.21.15.137:0/2473385745 >> v1:172.21.15.137:6789/0 conn(0x7fca08096d10 legacy=0x7fca08132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.429 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 1 -- 172.21.15.137:0/2473385745 shutdown_connections 2021-05-26T16:40:54.429 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 1 -- 172.21.15.137:0/2473385745 >> 172.21.15.137:0/2473385745 conn(0x7fca0809ff30 msgr2=0x7fca080a0340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.429 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 1 -- 172.21.15.137:0/2473385745 shutdown_connections 2021-05-26T16:40:54.430 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 1 -- 172.21.15.137:0/2473385745 wait complete. 2021-05-26T16:40:54.430 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.430 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 10 monclient: monmap: 2021-05-26T16:40:54.430 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.430 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:54.431 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 0.000000 2021-05-26T16:40:54.431 INFO:teuthology.orchestra.run.smithi137.stderr:created 0.000000 2021-05-26T16:40:54.431 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.431 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.432 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.432 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.432 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.432 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.432 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.433 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.433 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.433 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.433 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.433 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.434 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.396+0000 7fca0e19e700 1 Processor -- start 2021-05-26T16:40:54.434 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 1 -- start start 2021-05-26T16:40:54.434 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient: init 2021-05-26T16:40:54.434 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.435 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient: _add_conns ranks=[2,0,7,8,5,6,4,3,1] 2021-05-26T16:40:54.435 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient(hunting): picked mon.noname-b con 0x7fca08096d10 addr v1:172.21.15.3:6790/0 2021-05-26T16:40:54.435 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient(hunting): picked mon.noname-a con 0x7fca08129770 addr v1:172.21.15.3:6789/0 2021-05-26T16:40:54.435 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient(hunting): picked mon.noname-i con 0x7fca0812a050 addr v1:172.21.15.137:6792/0 2021-05-26T16:40:54.435 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08096370 con 0x7fca08129770 2021-05-26T16:40:54.436 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08096610 con 0x7fca08096d10 2021-05-26T16:40:54.436 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08095220 con 0x7fca0812a050 2021-05-26T16:40:54.436 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.436 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0e19e700 10 monclient(hunting): authenticate will time out at 798.876585s 2021-05-26T16:40:54.437 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0d99d700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7fca0812a050 0x7fca08144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.137:46958/0 (socket says 172.21.15.137:46958) 2021-05-26T16:40:54.437 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.397+0000 7fca0d99d700 1 -- 172.21.15.137:0/4208098838 learned_addr learned my addr 172.21.15.137:0/4208098838 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.437 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.399+0000 7fca0d99d700 1 -- 172.21.15.137:0/4208098838 >> v1:172.21.15.137:6792/0 conn(0x7fca0812a050 legacy=0x7fca08144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.437 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475800091 0 0) 0x7fca08095220 con 0x7fca0812a050 2021-05-26T16:40:54.437 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.438 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.438 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): my global_id is 4120 2021-05-26T16:40:54.438 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e8003270 con 0x7fca0812a050 2021-05-26T16:40:54.438 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0d19c700 1 -- 172.21.15.137:0/4208098838 >> v1:172.21.15.3:6790/0 conn(0x7fca08096d10 legacy=0x7fca0813c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.439 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0c99b700 1 -- 172.21.15.137:0/4208098838 >> v1:172.21.15.3:6789/0 conn(0x7fca08129770 legacy=0x7fca08128880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.439 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2472072149 0 0) 0x7fc9e8003270 con 0x7fca0812a050 2021-05-26T16:40:54.439 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca08095220 con 0x7fca0812a050 2021-05-26T16:40:54.439 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca040020d0 con 0x7fca0812a050 2021-05-26T16:40:54.439 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.440 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2021-05-26T16:40:54.440 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): dump: 2021-05-26T16:40:54.440 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.440 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.441 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.441 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.441 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.441 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.441 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.442 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.442 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.442 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.442 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.442 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.443 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.443 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.443 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.443 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.444 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:54.444 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259655742 0 0) 0x7fca08096370 con 0x7fca08129770 2021-05-26T16:40:54.444 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.444 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.444 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient(hunting): my global_id is 4140 2021-05-26T16:40:54.445 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e8003270 con 0x7fca08129770 2021-05-26T16:40:54.445 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3265106412 0 0) 0x7fca08095220 con 0x7fca0812a050 2021-05-26T16:40:54.445 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 >> v1:172.21.15.3:6790/0 conn(0x7fca08096d10 legacy=0x7fca0813c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.445 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 >> v1:172.21.15.3:6789/0 conn(0x7fca08129770 legacy=0x7fca08128880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.446 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.446 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 monclient: found mon.i 2021-05-26T16:40:54.446 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.446 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:40:54.446 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.137:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0813cb10 con 0x7fca0812a050 2021-05-26T16:40:54.447 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.447 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.447 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0e19e700 5 monclient: authenticate success, global_id 4120 2021-05-26T16:40:54.447 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0e19e700 10 monclient: _renew_subs 2021-05-26T16:40:54.448 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0e19e700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:40:54.448 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.137:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca08128f90 con 0x7fca0812a050 2021-05-26T16:40:54.448 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0e19e700 10 monclient: _renew_subs 2021-05-26T16:40:54.448 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0e19e700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:40:54.448 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.137:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fca08145e70 con 0x7fca0812a050 2021-05-26T16:40:54.449 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fca040027d0 con 0x7fca0812a050 2021-05-26T16:40:54.449 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.449 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca04002c80 con 0x7fca0812a050 2021-05-26T16:40:54.449 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.449 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f77fe700 4 set_mon_vals no callback set 2021-05-26T16:40:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:40:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 10 monclient: dump: 2021-05-26T16:40:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.451 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.451 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.451 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.451 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.451 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.452 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.452 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.452 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.452 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.453 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.453 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.453 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.453 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.453 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.454 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7fca04005890 con 0x7fca0812a050 2021-05-26T16:40:54.454 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.400+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (unknown 2118270455 0 0) 0x7fca04006960 con 0x7fca0812a050 2021-05-26T16:40:54.454 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.401+0000 7fca0e19e700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.454 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.401+0000 7fca0e19e700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.454 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.401+0000 7fca0e19e700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:40:54.455 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.401+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.137:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e0004db0 con 0x7fca0812a050 2021-05-26T16:40:54.455 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.404+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7fca04006630 con 0x7fca0812a050 2021-05-26T16:40:54.455 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.404+0000 7fc9f57fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.455 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.404+0000 7fc9f57fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:54.499 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.496+0000 7fca0e19e700 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ca01de00-a5fb-4b03-9412-bca079506190", "id": 2}] 2021-05-26T16:40:54.500 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.496+0000 7fca0e19e700 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ca01de00-a5fb-4b03-9412-bca079506190", "id": 2}] 2021-05-26T16:40:54.500 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.496+0000 7fca0e19e700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:40:54.500 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.496+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 --> v1:172.21.15.137:6792/0 -- mon_command({"prefix": "osd new", "uuid": "ca01de00-a5fb-4b03-9412-bca079506190", "id": 2} v 0) v1 -- 0x7fc9e00055e0 con 0x7fca0812a050 2021-05-26T16:40:54.503 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.500+0000 7fc9f57fa700 1 -- 172.21.15.137:0/4208098838 <== mon.7 v1:172.21.15.137:6792/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca01de00-a5fb-4b03-9412-bca079506190", "id": 2}]=0 v5) v1 ==== 112+0+2 (unknown 252180606 0 216599125) 0x7fca04005b70 con 0x7fca0812a050 2021-05-26T16:40:54.503 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.500+0000 7fc9f57fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ca01de00-a5fb-4b03-9412-bca079506190", "id": 2}] 2021-05-26T16:40:54.503 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.500+0000 7fc9f57fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:40:54.504 INFO:teuthology.orchestra.run.smithi137.stdout:2 2021-05-26T16:40:54.505 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.501+0000 7fca0e19e700 10 monclient: shutdown 2021-05-26T16:40:54.505 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.501+0000 7fca0e19e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.505 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.501+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 >> v1:172.21.15.137:6792/0 conn(0x7fca0812a050 legacy=0x7fca08144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.505 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.501+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 shutdown_connections 2021-05-26T16:40:54.506 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.501+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 >> 172.21.15.137:0/4208098838 conn(0x7fca0809ff30 msgr2=0x7fca080982e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.506 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.501+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 shutdown_connections 2021-05-26T16:40:54.506 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.501+0000 7fca0e19e700 1 -- 172.21.15.137:0/4208098838 wait complete. 2021-05-26T16:40:54.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new ecf54fc5-53a9-4585-a369-03a5d382cfd2 3 2021-05-26T16:40:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.624+0000 7f6af15f8700 10 monclient: get_monmap_and_config 2021-05-26T16:40:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.624+0000 7f6af15f8700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.624+0000 7f6af15f8700 10 monclient: monmap: 2021-05-26T16:40:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.629 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:54.625925+0000 2021-05-26T16:40:54.629 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:54.625925+0000 2021-05-26T16:40:54.629 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.629 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.629 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.630 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.630 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.630 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.630 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.631 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.643 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 1 Processor -- start 2021-05-26T16:40:54.644 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 1 -- start start 2021-05-26T16:40:54.644 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient: init 2021-05-26T16:40:54.645 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.645 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient: _add_conns ranks=[2,3,7,1,4,8,0,6,5] 2021-05-26T16:40:54.645 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient(hunting): picked mon.noname-b con 0x7f6aec09b5a0 addr v1:172.21.15.3:6790/0 2021-05-26T16:40:54.646 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient(hunting): picked mon.noname-g con 0x7f6aec099bf0 addr v1:172.21.15.137:6790/0 2021-05-26T16:40:54.646 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient(hunting): picked mon.noname-i con 0x7f6aec09a070 addr v1:172.21.15.137:6792/0 2021-05-26T16:40:54.647 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec046600 con 0x7f6aec09b5a0 2021-05-26T16:40:54.647 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec097500 con 0x7f6aec099bf0 2021-05-26T16:40:54.647 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec097730 con 0x7f6aec09a070 2021-05-26T16:40:54.648 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.648 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.625+0000 7f6af15f8700 10 monclient(hunting): authenticate will time out at 799.104906s 2021-05-26T16:40:54.649 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.626+0000 7f6aeb7fe700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7f6aec09a070 0x7f6aec135670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.137:46964/0 (socket says 172.21.15.137:46964) 2021-05-26T16:40:54.649 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.626+0000 7f6aeb7fe700 1 -- 172.21.15.137:0/2937095951 learned_addr learned my addr 172.21.15.137:0/2937095951 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.649 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.626+0000 7f6aea7fc700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f6aec099bf0 0x7f6aec131f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.137:56920/0 (socket says 172.21.15.137:56920) 2021-05-26T16:40:54.650 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6aeb7fe700 1 -- 172.21.15.137:0/2937095951 >> v1:172.21.15.137:6792/0 conn(0x7f6aec09a070 legacy=0x7f6aec135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.650 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6aea7fc700 1 -- 172.21.15.137:0/2937095951 >> v1:172.21.15.137:6790/0 conn(0x7f6aec099bf0 legacy=0x7f6aec131f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.650 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948453521 0 0) 0x7f6aec097500 con 0x7f6aec099bf0 2021-05-26T16:40:54.651 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.651 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.651 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient(hunting): my global_id is 4125 2021-05-26T16:40:54.652 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad8003270 con 0x7f6aec099bf0 2021-05-26T16:40:54.652 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566716799 0 0) 0x7f6aec097730 con 0x7f6aec09a070 2021-05-26T16:40:54.652 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.652 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.652 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient(hunting): my global_id is 4129 2021-05-26T16:40:54.653 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec097500 con 0x7f6aec09a070 2021-05-26T16:40:54.653 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6aeaffd700 1 -- 172.21.15.137:0/2937095951 >> v1:172.21.15.3:6790/0 conn(0x7f6aec09b5a0 legacy=0x7f6aec129c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.653 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154232270 0 0) 0x7f6ad8003270 con 0x7f6aec099bf0 2021-05-26T16:40:54.653 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 >> v1:172.21.15.137:6792/0 conn(0x7f6aec09a070 legacy=0x7f6aec135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.654 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 >> v1:172.21.15.3:6790/0 conn(0x7f6aec09b5a0 legacy=0x7f6aec129c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.654 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.654 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 monclient: found mon.noname-g 2021-05-26T16:40:54.654 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.654 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.137:6790/0 2021-05-26T16:40:54.655 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec096ca0 con 0x7f6aec099bf0 2021-05-26T16:40:54.655 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.655 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.655 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6ae0001a60 con 0x7f6aec099bf0 2021-05-26T16:40:54.656 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.656 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:40:54.656 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: dump: 2021-05-26T16:40:54.656 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.657 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.657 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.657 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.657 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.657 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.658 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.658 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.658 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.658 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.659 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.659 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.659 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.660 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.660 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.660 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.661 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6af15f8700 5 monclient: authenticate success, global_id 4125 2021-05-26T16:40:54.661 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6af15f8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:54.661 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 <== mon.3 v1:172.21.15.137:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6ae0001d70 con 0x7f6aec099bf0 2021-05-26T16:40:54.662 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.662 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 1 -- 172.21.15.137:0/2937095951 <== mon.3 v1:172.21.15.137:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6ae0004870 con 0x7f6aec099bf0 2021-05-26T16:40:54.662 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6af15f8700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:54.663 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6af15f8700 4 set_mon_vals no callback set 2021-05-26T16:40:54.663 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.664 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:40:54.664 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.628+0000 7f6ae9ffb700 10 monclient: dump: 2021-05-26T16:40:54.665 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.665 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.665 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.666 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.666 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.666 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.667 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.667 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.667 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.668 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.668 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.668 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.669 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.669 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.669 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.669 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.669 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 10 monclient: shutdown 2021-05-26T16:40:54.670 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.670 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 1 -- 172.21.15.137:0/2937095951 >> v1:172.21.15.137:6790/0 conn(0x7f6aec099bf0 legacy=0x7f6aec131f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.670 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 1 -- 172.21.15.137:0/2937095951 shutdown_connections 2021-05-26T16:40:54.671 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 1 -- 172.21.15.137:0/2937095951 >> 172.21.15.137:0/2937095951 conn(0x7f6aec09fe40 msgr2=0x7f6aec0a0250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.671 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 1 -- 172.21.15.137:0/2937095951 shutdown_connections 2021-05-26T16:40:54.671 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 1 -- 172.21.15.137:0/2937095951 wait complete. 2021-05-26T16:40:54.671 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.629+0000 7f6af15f8700 10 monclient: monmap: 2021-05-26T16:40:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 0.000000 2021-05-26T16:40:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:created 0.000000 2021-05-26T16:40:54.673 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.673 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.673 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.674 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.674 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.674 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.674 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.674 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.675 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.675 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.675 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.675 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 1 Processor -- start 2021-05-26T16:40:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 1 -- start start 2021-05-26T16:40:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient: init 2021-05-26T16:40:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient: _add_conns ranks=[5,1,3,6,2,7,0,4,8] 2021-05-26T16:40:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient(hunting): picked mon.noname-h con 0x7f6aec099bf0 addr v1:172.21.15.137:6791/0 2021-05-26T16:40:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient(hunting): picked mon.noname-f con 0x7f6aec09a070 addr v1:172.21.15.137:6789/0 2021-05-26T16:40:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient(hunting): picked mon.noname-g con 0x7f6aec09b5a0 addr v1:172.21.15.137:6790/0 2021-05-26T16:40:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec128b90 con 0x7f6aec09a070 2021-05-26T16:40:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec12ff90 con 0x7f6aec09b5a0 2021-05-26T16:40:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec130230 con 0x7f6aec099bf0 2021-05-26T16:40:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6af15f8700 10 monclient(hunting): authenticate will time out at 799.109762s 2021-05-26T16:40:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6aeb7fe700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f6aec09b5a0 0x7f6aec1446d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.137:56928/0 (socket says 172.21.15.137:56928) 2021-05-26T16:40:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6aeaffd700 1 --1- >> v1:172.21.15.137:6791/0 conn(0x7f6aec099bf0 0x7f6aec13c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6791/0 says I am v1:172.21.15.137:48488/0 (socket says 172.21.15.137:48488) 2021-05-26T16:40:54.680 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.630+0000 7f6aeb7fe700 1 -- 172.21.15.137:0/2279390642 learned_addr learned my addr 172.21.15.137:0/2279390642 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.680 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.632+0000 7f6aeb7fe700 1 -- 172.21.15.137:0/2279390642 >> v1:172.21.15.137:6790/0 conn(0x7f6aec09b5a0 legacy=0x7f6aec1446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.680 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6aeaffd700 1 -- 172.21.15.137:0/2279390642 >> v1:172.21.15.137:6791/0 conn(0x7f6aec099bf0 legacy=0x7f6aec13c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.680 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6aea7fc700 1 -- 172.21.15.137:0/2279390642 >> v1:172.21.15.137:6789/0 conn(0x7f6aec09a070 legacy=0x7f6aec140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.680 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6aeb7fe700 1 --1- 172.21.15.137:0/2279390642 >> v1:172.21.15.137:6790/0 conn(0x7f6aec09b5a0 0x7f6aec1446d0 :-1 s=OPENED pgs=29 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7f6aec12ff90 auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:40:54.681 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313799787 0 0) 0x7f6aec128b90 con 0x7f6aec09a070 2021-05-26T16:40:54.681 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.681 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.681 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): my global_id is 4141 2021-05-26T16:40:54.681 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6acc003270 con 0x7f6aec09a070 2021-05-26T16:40:54.682 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191307997 0 0) 0x7f6aec130230 con 0x7f6aec099bf0 2021-05-26T16:40:54.682 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.682 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.682 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): my global_id is 4118 2021-05-26T16:40:54.683 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec128b90 con 0x7f6aec099bf0 2021-05-26T16:40:54.683 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2038138277 0 0) 0x7f6acc003270 con 0x7f6aec09a070 2021-05-26T16:40:54.683 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6aec130230 con 0x7f6aec09a070 2021-05-26T16:40:54.683 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6ae0004870 con 0x7f6aec09a070 2021-05-26T16:40:54.683 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.684 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2021-05-26T16:40:54.684 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): dump: 2021-05-26T16:40:54.684 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.684 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.684 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.685 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.685 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.685 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.685 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.685 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.686 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.686 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.686 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.686 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.687 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.687 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.687 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.687 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.687 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:54.688 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3955734007 0 0) 0x7f6aec128b90 con 0x7f6aec099bf0 2021-05-26T16:40:54.688 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6acc003270 con 0x7f6aec099bf0 2021-05-26T16:40:54.688 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6ad4001c20 con 0x7f6aec099bf0 2021-05-26T16:40:54.688 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.688 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:40:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient(hunting): dump: 2021-05-26T16:40:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.690 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.690 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.690 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.690 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.691 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.691 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.691 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.691 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.691 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.692 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.692 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.692 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.692 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.692 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 421394064 0 0) 0x7f6aec130230 con 0x7f6aec09a070 2021-05-26T16:40:54.693 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 >> v1:172.21.15.137:6791/0 conn(0x7f6aec099bf0 legacy=0x7f6aec13c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.693 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 >> v1:172.21.15.137:6790/0 conn(0x7f6aec09b5a0 legacy=0x7f6aec1446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.693 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.693 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 monclient: found mon.f 2021-05-26T16:40:54.693 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.694 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.694 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec1304d0 con 0x7f6aec09a070 2021-05-26T16:40:54.694 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.694 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.695 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6af15f8700 5 monclient: authenticate success, global_id 4141 2021-05-26T16:40:54.695 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6af15f8700 10 monclient: _renew_subs 2021-05-26T16:40:54.695 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6af15f8700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.695 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec12e360 con 0x7f6aec09a070 2021-05-26T16:40:54.695 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766714992 0 0) 0x7f6aec12ff90 con 0x7f6aec09b5a0 2021-05-26T16:40:54.696 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:40:54.696 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6af15f8700 10 monclient: _renew_subs 2021-05-26T16:40:54.696 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6af15f8700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.696 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec13cad0 con 0x7f6aec09a070 2021-05-26T16:40:54.696 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6ae0001320 con 0x7f6aec09a070 2021-05-26T16:40:54.697 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.697 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6ae0005120 con 0x7f6aec09a070 2021-05-26T16:40:54.697 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.697 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:40:54.697 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 10 monclient: dump: 2021-05-26T16:40:54.698 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.698 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.698 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.698 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.699 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.699 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.699 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.699 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.701 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7f6ae0005560 con 0x7f6aec09a070 2021-05-26T16:40:54.702 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.633+0000 7f6ae97fa700 4 set_mon_vals no callback set 2021-05-26T16:40:54.702 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.634+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (unknown 2195560515 0 0) 0x7f6ae0005cb0 con 0x7f6aec09a070 2021-05-26T16:40:54.702 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.634+0000 7f6af15f8700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.702 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.634+0000 7f6af15f8700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.702 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.634+0000 7f6af15f8700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.634+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac4004db0 con 0x7f6aec09a070 2021-05-26T16:40:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.636+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7f6ae00057f0 con 0x7f6aec09a070 2021-05-26T16:40:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.636+0000 7f6ad2ffd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.636+0000 7f6ad2ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.714+0000 7f6af15f8700 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ecf54fc5-53a9-4585-a369-03a5d382cfd2", "id": 3}] 2021-05-26T16:40:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.714+0000 7f6af15f8700 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ecf54fc5-53a9-4585-a369-03a5d382cfd2", "id": 3}] 2021-05-26T16:40:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.714+0000 7f6af15f8700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:40:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.714+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 --> v1:172.21.15.137:6789/0 -- mon_command({"prefix": "osd new", "uuid": "ecf54fc5-53a9-4585-a369-03a5d382cfd2", "id": 3} v 0) v1 -- 0x7f6ac4005060 con 0x7f6aec09a070 2021-05-26T16:40:54.721 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.718+0000 7f6ad2ffd700 1 -- 172.21.15.137:0/2279390642 <== mon.1 v1:172.21.15.137:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecf54fc5-53a9-4585-a369-03a5d382cfd2", "id": 3}]=0 v6) v1 ==== 112+0+2 (unknown 4008513715 0 525046306) 0x7f6ae0005b10 con 0x7f6aec09a070 2021-05-26T16:40:54.721 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.718+0000 7f6ad2ffd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ecf54fc5-53a9-4585-a369-03a5d382cfd2", "id": 3}] 2021-05-26T16:40:54.721 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.718+0000 7f6ad2ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:40:54.722 INFO:teuthology.orchestra.run.smithi137.stdout:3 2021-05-26T16:40:54.723 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.719+0000 7f6af15f8700 10 monclient: shutdown 2021-05-26T16:40:54.723 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.719+0000 7f6af15f8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.724 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.719+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 >> v1:172.21.15.137:6789/0 conn(0x7f6aec09a070 legacy=0x7f6aec140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.724 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.719+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 shutdown_connections 2021-05-26T16:40:54.724 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.719+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 >> 172.21.15.137:0/2279390642 conn(0x7f6aec09fe40 msgr2=0x7f6aec097af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.724 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.719+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 shutdown_connections 2021-05-26T16:40:54.724 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.719+0000 7f6af15f8700 1 -- 172.21.15.137:0/2279390642 wait complete. 2021-05-26T16:40:54.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new c2926c74-967a-4c6d-acb7-4a0d32f89e78 4 2021-05-26T16:40:54.850 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.846+0000 7fb72c870700 10 monclient: get_monmap_and_config 2021-05-26T16:40:54.850 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.846+0000 7fb72c870700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.847+0000 7fb72c870700 10 monclient: monmap: 2021-05-26T16:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:54.848053+0000 2021-05-26T16:40:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:54.848053+0000 2021-05-26T16:40:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.853 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.853 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.853 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.853 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.853 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.854 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.854 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.854 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.854 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.847+0000 7fb72c870700 1 Processor -- start 2021-05-26T16:40:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.847+0000 7fb72c870700 1 -- start start 2021-05-26T16:40:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.847+0000 7fb72c870700 10 monclient: init 2021-05-26T16:40:54.867 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.867 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 10 monclient: _add_conns ranks=[5,3,2,6,4,7,0,1,8] 2021-05-26T16:40:54.867 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 10 monclient(hunting): picked mon.noname-h con 0x7fb728096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:40:54.867 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 10 monclient(hunting): picked mon.noname-g con 0x7fb72812d460 addr v1:172.21.15.137:6790/0 2021-05-26T16:40:54.868 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 10 monclient(hunting): picked mon.noname-b con 0x7fb72812d910 addr v1:172.21.15.3:6790/0 2021-05-26T16:40:54.868 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb728059750 con 0x7fb72812d910 2021-05-26T16:40:54.868 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72809c760 con 0x7fb72812d460 2021-05-26T16:40:54.868 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72809ca00 con 0x7fb728096ca0 2021-05-26T16:40:54.869 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.869 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72c870700 10 monclient(hunting): authenticate will time out at 799.327231s 2021-05-26T16:40:54.869 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72659c700 1 --1- >> v1:172.21.15.137:6791/0 conn(0x7fb728096ca0 0x7fb72812cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6791/0 says I am v1:172.21.15.137:48496/0 (socket says 172.21.15.137:48496) 2021-05-26T16:40:54.869 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb725d9b700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7fb72812d460 0x7fb7281320e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.137:56934/0 (socket says 172.21.15.137:56934) 2021-05-26T16:40:54.869 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.848+0000 7fb72659c700 1 -- 172.21.15.137:0/839009339 learned_addr learned my addr 172.21.15.137:0/839009339 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.870 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72659c700 1 -- 172.21.15.137:0/839009339 >> v1:172.21.15.137:6791/0 conn(0x7fb728096ca0 legacy=0x7fb72812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.870 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb725d9b700 1 -- 172.21.15.137:0/839009339 >> v1:172.21.15.137:6790/0 conn(0x7fb72812d460 legacy=0x7fb7281320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.870 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb726d9d700 1 -- 172.21.15.137:0/839009339 >> v1:172.21.15.3:6790/0 conn(0x7fb72812d910 legacy=0x7fb728135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.870 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228007291 0 0) 0x7fb72809c760 con 0x7fb72812d460 2021-05-26T16:40:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): my global_id is 4143 2021-05-26T16:40:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c003270 con 0x7fb72812d460 2021-05-26T16:40:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104917402 0 0) 0x7fb72809ca00 con 0x7fb728096ca0 2021-05-26T16:40:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): my global_id is 4127 2021-05-26T16:40:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72809c760 con 0x7fb728096ca0 2021-05-26T16:40:54.873 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094794972 0 0) 0x7fb728059750 con 0x7fb72812d910 2021-05-26T16:40:54.873 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.873 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.873 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient(hunting): my global_id is 4142 2021-05-26T16:40:54.874 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72809ca00 con 0x7fb72812d910 2021-05-26T16:40:54.874 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494471339 0 0) 0x7fb72809c760 con 0x7fb728096ca0 2021-05-26T16:40:54.874 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 >> v1:172.21.15.137:6790/0 conn(0x7fb72812d460 legacy=0x7fb7281320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.874 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 >> v1:172.21.15.3:6790/0 conn(0x7fb72812d910 legacy=0x7fb728135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.874 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.875 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 monclient: found mon.noname-h 2021-05-26T16:40:54.875 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.875 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.137:6791/0 2021-05-26T16:40:54.875 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.850+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728097730 con 0x7fb728096ca0 2021-05-26T16:40:54.876 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.876 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.876 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb710001a60 con 0x7fb728096ca0 2021-05-26T16:40:54.876 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.876 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2021-05-26T16:40:54.877 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: dump: 2021-05-26T16:40:54.877 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.877 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.877 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.877 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.878 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.878 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.878 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.878 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.879 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.879 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.879 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.879 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.879 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.880 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.880 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.880 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.880 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 5 monclient: authenticate success, global_id 4127 2021-05-26T16:40:54.881 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:54.881 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 <== mon.5 v1:172.21.15.137:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb710001d70 con 0x7fb728096ca0 2021-05-26T16:40:54.881 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.881 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 1 -- 172.21.15.137:0/839009339 <== mon.5 v1:172.21.15.137:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb710004930 con 0x7fb728096ca0 2021-05-26T16:40:54.881 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:54.882 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 4 set_mon_vals no callback set 2021-05-26T16:40:54.882 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.882 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:40:54.882 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72559a700 10 monclient: dump: 2021-05-26T16:40:54.883 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.883 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.883 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.883 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.884 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.884 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.884 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.885 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.885 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.885 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.885 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.886 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.886 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.886 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.886 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.887 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.887 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 10 monclient: shutdown 2021-05-26T16:40:54.887 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.887 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 1 -- 172.21.15.137:0/839009339 >> v1:172.21.15.137:6791/0 conn(0x7fb728096ca0 legacy=0x7fb72812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 1 -- 172.21.15.137:0/839009339 shutdown_connections 2021-05-26T16:40:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 1 -- 172.21.15.137:0/839009339 >> 172.21.15.137:0/839009339 conn(0x7fb7280a00e0 msgr2=0x7fb7280a04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 1 -- 172.21.15.137:0/839009339 shutdown_connections 2021-05-26T16:40:54.889 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.851+0000 7fb72c870700 1 -- 172.21.15.137:0/839009339 wait complete. 2021-05-26T16:40:54.889 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.852+0000 7fb72c870700 10 monclient: build_initial_monmap 2021-05-26T16:40:54.889 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.852+0000 7fb72c870700 10 monclient: monmap: 2021-05-26T16:40:54.889 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:54.889 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:54.890 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 0.000000 2021-05-26T16:40:54.890 INFO:teuthology.orchestra.run.smithi137.stderr:created 0.000000 2021-05-26T16:40:54.890 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:54.890 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.891 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:54.891 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:54.891 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:54.891 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:54.891 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:54.892 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:54.892 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:54.892 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:54.892 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:54.893 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.893 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.852+0000 7fb72c870700 1 Processor -- start 2021-05-26T16:40:54.893 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.852+0000 7fb72c870700 1 -- start start 2021-05-26T16:40:54.893 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.852+0000 7fb72c870700 10 monclient: init 2021-05-26T16:40:54.893 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:54.894 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 10 monclient: _add_conns ranks=[0,5,4,3,1,8,6,2,7] 2021-05-26T16:40:54.894 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 10 monclient(hunting): picked mon.noname-a con 0x7fb728096ca0 addr v1:172.21.15.3:6789/0 2021-05-26T16:40:54.894 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 10 monclient(hunting): picked mon.noname-h con 0x7fb72812d460 addr v1:172.21.15.137:6791/0 2021-05-26T16:40:54.894 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 10 monclient(hunting): picked mon.noname-c con 0x7fb72812d910 addr v1:172.21.15.3:6791/0 2021-05-26T16:40:54.894 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72813cce0 con 0x7fb728096ca0 2021-05-26T16:40:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb728119d70 con 0x7fb72812d910 2021-05-26T16:40:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72811a010 con 0x7fb72812d460 2021-05-26T16:40:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb72c870700 10 monclient(hunting): authenticate will time out at 799.332290s 2021-05-26T16:40:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb725d9b700 1 --1- >> v1:172.21.15.137:6791/0 conn(0x7fb72812d460 0x7fb728141170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6791/0 says I am v1:172.21.15.137:48504/0 (socket says 172.21.15.137:48504) 2021-05-26T16:40:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.853+0000 7fb725d9b700 1 -- 172.21.15.137:0/304320442 learned_addr learned my addr 172.21.15.137:0/304320442 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb725d9b700 1 -- 172.21.15.137:0/304320442 >> v1:172.21.15.137:6791/0 conn(0x7fb72812d460 legacy=0x7fb728141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb72659c700 1 -- 172.21.15.137:0/304320442 >> v1:172.21.15.3:6789/0 conn(0x7fb728096ca0 legacy=0x7fb728129840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb726d9d700 1 -- 172.21.15.137:0/304320442 >> v1:172.21.15.3:6791/0 conn(0x7fb72812d910 legacy=0x7fb7281448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840107202 0 0) 0x7fb72811a010 con 0x7fb72812d460 2021-05-26T16:40:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): my global_id is 4136 2021-05-26T16:40:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb704003270 con 0x7fb72812d460 2021-05-26T16:40:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680445402 0 0) 0x7fb72813cce0 con 0x7fb728096ca0 2021-05-26T16:40:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): my global_id is 4149 2021-05-26T16:40:54.899 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72811a010 con 0x7fb728096ca0 2021-05-26T16:40:54.899 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920086218 0 0) 0x7fb728119d70 con 0x7fb72812d910 2021-05-26T16:40:54.899 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:54.899 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:54.900 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): my global_id is 4108 2021-05-26T16:40:54.900 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72813cce0 con 0x7fb72812d910 2021-05-26T16:40:54.900 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4151493115 0 0) 0x7fb704003270 con 0x7fb72812d460 2021-05-26T16:40:54.900 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb728119d70 con 0x7fb72812d460 2021-05-26T16:40:54.900 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb71c001a10 con 0x7fb72812d460 2021-05-26T16:40:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2021-05-26T16:40:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.855+0000 7fb7167fc700 10 monclient(hunting): dump: 2021-05-26T16:40:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.903 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.903 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.903 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.903 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.904 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.904 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.904 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.904 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.904 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.905 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.905 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:54.905 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3691775493 0 0) 0x7fb72811a010 con 0x7fb728096ca0 2021-05-26T16:40:54.905 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb704003270 con 0x7fb728096ca0 2021-05-26T16:40:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb710004870 con 0x7fb728096ca0 2021-05-26T16:40:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:40:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient(hunting): dump: 2021-05-26T16:40:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.909 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.909 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.909 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.910 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3154554620 0 0) 0x7fb72813cce0 con 0x7fb72812d910 2021-05-26T16:40:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb72811a010 con 0x7fb72812d910 2021-05-26T16:40:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb718002080 con 0x7fb72812d910 2021-05-26T16:40:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:40:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient(hunting): dump: 2021-05-26T16:40:54.912 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.912 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.912 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.912 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.913 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.913 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.913 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.913 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.913 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.914 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.914 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.914 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.914 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.915 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.915 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.915 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.915 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 618472571 0 0) 0x7fb728119d70 con 0x7fb72812d460 2021-05-26T16:40:54.915 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 >> v1:172.21.15.3:6791/0 conn(0x7fb72812d910 legacy=0x7fb7281448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.916 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 >> v1:172.21.15.3:6789/0 conn(0x7fb728096ca0 legacy=0x7fb728129840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.916 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient: _finish_hunting 0 2021-05-26T16:40:54.916 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 monclient: found mon.h 2021-05-26T16:40:54.916 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:54.917 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:40:54.917 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72811a2b0 con 0x7fb72812d460 2021-05-26T16:40:54.917 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient: _finish_auth 0 2021-05-26T16:40:54.917 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:54.917 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb72c870700 5 monclient: authenticate success, global_id 4136 2021-05-26T16:40:54.918 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb72c870700 10 monclient: _renew_subs 2021-05-26T16:40:54.918 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb72c870700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:40:54.918 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.137:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb728118140 con 0x7fb72812d460 2021-05-26T16:40:54.918 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb72c870700 10 monclient: _renew_subs 2021-05-26T16:40:54.919 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb72c870700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:40:54.919 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.137:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72812e430 con 0x7fb72812d460 2021-05-26T16:40:54.919 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb71c004b20 con 0x7fb72812d460 2021-05-26T16:40:54.919 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:54.919 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb71c004fd0 con 0x7fb72812d460 2021-05-26T16:40:54.920 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:54.920 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb724d99700 4 set_mon_vals no callback set 2021-05-26T16:40:54.920 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:40:54.920 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 10 monclient: dump: 2021-05-26T16:40:54.921 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:54.921 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:54.921 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.921 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:54.922 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:54.922 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:54.922 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:54.922 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:54.923 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:54.923 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:54.923 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:54.923 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:54.923 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:54.924 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:54.924 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:54.924 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:54.924 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7fb71c005490 con 0x7fb72812d460 2021-05-26T16:40:54.924 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.856+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (unknown 3534309604 0 0) 0x7fb71c005c50 con 0x7fb72812d460 2021-05-26T16:40:54.925 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.857+0000 7fb72c870700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.925 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.857+0000 7fb72c870700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.925 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.857+0000 7fb72c870700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:40:54.925 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.857+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.137:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb708004db0 con 0x7fb72812d460 2021-05-26T16:40:54.926 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.859+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7fb71c006430 con 0x7fb72812d460 2021-05-26T16:40:54.926 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.859+0000 7fb7167fc700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:54.926 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.859+0000 7fb7167fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:54.942 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.938+0000 7fb72c870700 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c2926c74-967a-4c6d-acb7-4a0d32f89e78", "id": 4}] 2021-05-26T16:40:54.942 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.938+0000 7fb72c870700 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c2926c74-967a-4c6d-acb7-4a0d32f89e78", "id": 4}] 2021-05-26T16:40:54.942 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.938+0000 7fb72c870700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:40:54.942 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.938+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 --> v1:172.21.15.137:6791/0 -- mon_command({"prefix": "osd new", "uuid": "c2926c74-967a-4c6d-acb7-4a0d32f89e78", "id": 4} v 0) v1 -- 0x7fb7080055e0 con 0x7fb72812d460 2021-05-26T16:40:54.946 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.943+0000 7fb7167fc700 1 -- 172.21.15.137:0/304320442 <== mon.5 v1:172.21.15.137:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2926c74-967a-4c6d-acb7-4a0d32f89e78", "id": 4}]=0 v7) v1 ==== 112+0+2 (unknown 3064494262 0 1697012583) 0x7fb71c006650 con 0x7fb72812d460 2021-05-26T16:40:54.946 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.943+0000 7fb7167fc700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c2926c74-967a-4c6d-acb7-4a0d32f89e78", "id": 4}] 2021-05-26T16:40:54.947 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.943+0000 7fb7167fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:40:54.947 INFO:teuthology.orchestra.run.smithi137.stdout:4 2021-05-26T16:40:54.948 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.944+0000 7fb72c870700 10 monclient: shutdown 2021-05-26T16:40:54.948 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.944+0000 7fb72c870700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:54.949 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.944+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 >> v1:172.21.15.137:6791/0 conn(0x7fb72812d460 legacy=0x7fb728141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:54.949 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.944+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 shutdown_connections 2021-05-26T16:40:54.949 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.944+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 >> 172.21.15.137:0/304320442 conn(0x7fb7280a00e0 msgr2=0x7fb728098b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:54.949 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.944+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 shutdown_connections 2021-05-26T16:40:54.949 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:54.944+0000 7fb72c870700 1 -- 172.21.15.137:0/304320442 wait complete. 2021-05-26T16:40:54.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new acee8981-3ab2-4bad-b287-217a027a7b93 5 2021-05-26T16:40:55.070 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.067+0000 7f2745542700 10 monclient: get_monmap_and_config 2021-05-26T16:40:55.071 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.067+0000 7f2745542700 10 monclient: build_initial_monmap 2021-05-26T16:40:55.071 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.067+0000 7f2745542700 10 monclient: monmap: 2021-05-26T16:40:55.071 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:55.071 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.072 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:55.068300+0000 2021-05-26T16:40:55.072 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:55.068300+0000 2021-05-26T16:40:55.072 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:55.073 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:55.074 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:55.075 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:55.075 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:55.075 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:55.075 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:55.076 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:55.076 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:55.076 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:55.076 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:55.076 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.067+0000 7f2745542700 1 Processor -- start 2021-05-26T16:40:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.067+0000 7f2745542700 1 -- start start 2021-05-26T16:40:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.067+0000 7f2745542700 10 monclient: init 2021-05-26T16:40:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 10 monclient: _add_conns ranks=[7,8,6,4,5,0,3,1,2] 2021-05-26T16:40:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 10 monclient(hunting): picked mon.noname-i con 0x7f2740064a20 addr v1:172.21.15.137:6792/0 2021-05-26T16:40:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 10 monclient(hunting): picked mon.noname-e con 0x7f2740063e30 addr v1:172.21.15.3:6793/0 2021-05-26T16:40:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 10 monclient(hunting): picked mon.noname-d con 0x7f27400642e0 addr v1:172.21.15.3:6792/0 2021-05-26T16:40:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2740059750 con 0x7f27400642e0 2021-05-26T16:40:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2740064e00 con 0x7f2740064a20 2021-05-26T16:40:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274009c770 con 0x7f2740063e30 2021-05-26T16:40:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f2745542700 10 monclient(hunting): authenticate will time out at 799.547333s 2021-05-26T16:40:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f273effd700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7f2740064a20 0x7f2740099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.137:46986/0 (socket says 172.21.15.137:46986) 2021-05-26T16:40:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f273effd700 1 -- 172.21.15.137:0/3041207003 learned_addr learned my addr 172.21.15.137:0/3041207003 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f273f7fe700 1 -- 172.21.15.137:0/3041207003 >> v1:172.21.15.3:6792/0 conn(0x7f27400642e0 legacy=0x7f27401357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-05-26T16:40:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f273f7fe700 1 -- 172.21.15.137:0/3041207003 >> v1:172.21.15.3:6792/0 conn(0x7f27400642e0 legacy=0x7f27401357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-05-26T16:40:55.090 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.068+0000 7f273f7fe700 1 --1- 172.21.15.137:0/3041207003 >> v1:172.21.15.3:6792/0 conn(0x7f27400642e0 0x7f27401357b0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2021-05-26T16:40:55.090 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273effd700 1 -- 172.21.15.137:0/3041207003 >> v1:172.21.15.137:6792/0 conn(0x7f2740064a20 legacy=0x7f2740099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.090 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728072817 0 0) 0x7f2740064e00 con 0x7f2740064a20 2021-05-26T16:40:55.090 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:55.090 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:55.091 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273dffb700 10 monclient(hunting): my global_id is 4138 2021-05-26T16:40:55.091 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f272c003270 con 0x7f2740064a20 2021-05-26T16:40:55.091 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273e7fc700 1 -- 172.21.15.137:0/3041207003 >> v1:172.21.15.3:6793/0 conn(0x7f2740063e30 legacy=0x7f2740132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.091 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314813556 0 0) 0x7f272c003270 con 0x7f2740064a20 2021-05-26T16:40:55.092 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.070+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 >> v1:172.21.15.3:6793/0 conn(0x7f2740063e30 legacy=0x7f2740132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.092 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 >> v1:172.21.15.3:6792/0 conn(0x7f27400642e0 legacy=0x7f27401357b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:40:55.092 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:40:55.092 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 1 monclient: found mon.noname-i 2021-05-26T16:40:55.092 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.137:6792/0 2021-05-26T16:40:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 --> v1:172.21.15.137:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400977a0 con 0x7f2740064a20 2021-05-26T16:40:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: _finish_auth 0 2021-05-26T16:40:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 5 monclient: authenticate success, global_id 4138 2021-05-26T16:40:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2728001a60 con 0x7f2740064a20 2021-05-26T16:40:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2021-05-26T16:40:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: dump: 2021-05-26T16:40:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.097 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.097 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.097 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.097 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.097 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.098 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.098 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:55.098 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:55.098 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 <== mon.7 v1:172.21.15.137:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2728001d70 con 0x7f2740064a20 2021-05-26T16:40:55.099 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:55.099 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 1 -- 172.21.15.137:0/3041207003 <== mon.7 v1:172.21.15.137:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2728004930 con 0x7f2740064a20 2021-05-26T16:40:55.099 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:55.099 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 4 set_mon_vals no callback set 2021-05-26T16:40:55.099 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.100 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:40:55.100 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f273dffb700 10 monclient: dump: 2021-05-26T16:40:55.100 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:55.101 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.101 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.101 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.101 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.101 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:55.102 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.102 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.102 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.102 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.102 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.103 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.103 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.103 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.103 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.103 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:55.104 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 10 monclient: shutdown 2021-05-26T16:40:55.104 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:55.104 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 1 -- 172.21.15.137:0/3041207003 >> v1:172.21.15.137:6792/0 conn(0x7f2740064a20 legacy=0x7f2740099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.104 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 1 -- 172.21.15.137:0/3041207003 shutdown_connections 2021-05-26T16:40:55.105 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 1 -- 172.21.15.137:0/3041207003 >> 172.21.15.137:0/3041207003 conn(0x7f27400a0db0 msgr2=0x7f274009cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:55.105 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 1 -- 172.21.15.137:0/3041207003 shutdown_connections 2021-05-26T16:40:55.105 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.071+0000 7f2745542700 1 -- 172.21.15.137:0/3041207003 wait complete. 2021-05-26T16:40:55.105 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.072+0000 7f2745542700 10 monclient: build_initial_monmap 2021-05-26T16:40:55.105 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.072+0000 7f2745542700 10 monclient: monmap: 2021-05-26T16:40:55.106 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 0 2021-05-26T16:40:55.106 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:55.106 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 0.000000 2021-05-26T16:40:55.106 INFO:teuthology.orchestra.run.smithi137.stderr:created 0.000000 2021-05-26T16:40:55.107 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:55.107 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:55.107 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:55.107 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:55.108 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:55.108 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:55.108 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:55.110 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.073+0000 7f2745542700 1 Processor -- start 2021-05-26T16:40:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.073+0000 7f2745542700 1 -- start start 2021-05-26T16:40:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.073+0000 7f2745542700 10 monclient: init 2021-05-26T16:40:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 10 monclient: _add_conns ranks=[0,3,4,6,2,8,5,1,7] 2021-05-26T16:40:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 10 monclient(hunting): picked mon.noname-a con 0x7f2740063e30 addr v1:172.21.15.3:6789/0 2021-05-26T16:40:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 10 monclient(hunting): picked mon.noname-g con 0x7f27400642e0 addr v1:172.21.15.137:6790/0 2021-05-26T16:40:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 10 monclient(hunting): picked mon.noname-c con 0x7f2740064a20 addr v1:172.21.15.3:6791/0 2021-05-26T16:40:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274011cab0 con 0x7f2740063e30 2021-05-26T16:40:55.112 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274011cd50 con 0x7f27400642e0 2021-05-26T16:40:55.112 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274011cff0 con 0x7f2740064a20 2021-05-26T16:40:55.112 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:55.112 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f2745542700 10 monclient(hunting): authenticate will time out at 799.553206s 2021-05-26T16:40:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f273e7fc700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f27400642e0 0x7f2740141160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.137:56952/0 (socket says 172.21.15.137:56952) 2021-05-26T16:40:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.074+0000 7f273e7fc700 1 -- 172.21.15.137:0/1734207215 learned_addr learned my addr 172.21.15.137:0/1734207215 (peer_addr_for_me v1:172.21.15.137:0/0) 2021-05-26T16:40:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f273e7fc700 1 -- 172.21.15.137:0/1734207215 >> v1:172.21.15.137:6790/0 conn(0x7f27400642e0 legacy=0x7f2740141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48652686 0 0) 0x7f274011cd50 con 0x7f27400642e0 2021-05-26T16:40:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): my global_id is 4152 2021-05-26T16:40:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f273effd700 1 -- 172.21.15.137:0/1734207215 >> v1:172.21.15.3:6789/0 conn(0x7f2740063e30 legacy=0x7f274013c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2720003270 con 0x7f27400642e0 2021-05-26T16:40:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f273f7fe700 1 -- 172.21.15.137:0/1734207215 >> v1:172.21.15.3:6791/0 conn(0x7f2740064a20 legacy=0x7f2740144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 570208387 0 0) 0x7f2720003270 con 0x7f27400642e0 2021-05-26T16:40:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f274011cd50 con 0x7f27400642e0 2021-05-26T16:40:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647137616 0 0) 0x7f274011cab0 con 0x7f2740063e30 2021-05-26T16:40:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): my global_id is 4158 2021-05-26T16:40:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2720003270 con 0x7f2740063e30 2021-05-26T16:40:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2734001f00 con 0x7f27400642e0 2021-05-26T16:40:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:40:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): dump: 2021-05-26T16:40:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.120 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.120 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.120 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.120 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.121 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:55.122 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35276934 0 0) 0x7f274011cff0 con 0x7f2740064a20 2021-05-26T16:40:55.122 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:55.122 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:55.122 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 10 monclient(hunting): my global_id is 4117 2021-05-26T16:40:55.122 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.076+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274011cab0 con 0x7f2740064a20 2021-05-26T16:40:55.123 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 824634846 0 0) 0x7f274011cd50 con 0x7f27400642e0 2021-05-26T16:40:55.123 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 >> v1:172.21.15.3:6791/0 conn(0x7f2740064a20 legacy=0x7f2740144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.123 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 >> v1:172.21.15.3:6789/0 conn(0x7f2740063e30 legacy=0x7f274013c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.123 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:40:55.124 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 monclient: found mon.g 2021-05-26T16:40:55.124 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:55.124 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:40:55.124 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274011b120 con 0x7f27400642e0 2021-05-26T16:40:55.124 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 10 monclient: _finish_auth 0 2021-05-26T16:40:55.125 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:55.125 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2745542700 5 monclient: authenticate success, global_id 4152 2021-05-26T16:40:55.125 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2745542700 10 monclient: _renew_subs 2021-05-26T16:40:55.125 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2745542700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:40:55.126 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.137:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274011bdc0 con 0x7f27400642e0 2021-05-26T16:40:55.126 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2745542700 10 monclient: _renew_subs 2021-05-26T16:40:55.126 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2745542700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:40:55.126 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.137:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f274013cc90 con 0x7f27400642e0 2021-05-26T16:40:55.126 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2734002570 con 0x7f27400642e0 2021-05-26T16:40:55.127 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:55.127 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2734002aa0 con 0x7f27400642e0 2021-05-26T16:40:55.127 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.127 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f273d7fa700 4 set_mon_vals no callback set 2021-05-26T16:40:55.127 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:40:55.128 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 10 monclient: dump: 2021-05-26T16:40:55.128 INFO:teuthology.orchestra.run.smithi137.stderr:epoch 1 2021-05-26T16:40:55.128 INFO:teuthology.orchestra.run.smithi137.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.128 INFO:teuthology.orchestra.run.smithi137.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.129 INFO:teuthology.orchestra.run.smithi137.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.129 INFO:teuthology.orchestra.run.smithi137.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.129 INFO:teuthology.orchestra.run.smithi137.stderr:election_strategy: 1 2021-05-26T16:40:55.129 INFO:teuthology.orchestra.run.smithi137.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.129 INFO:teuthology.orchestra.run.smithi137.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.130 INFO:teuthology.orchestra.run.smithi137.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.130 INFO:teuthology.orchestra.run.smithi137.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.130 INFO:teuthology.orchestra.run.smithi137.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.130 INFO:teuthology.orchestra.run.smithi137.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.130 INFO:teuthology.orchestra.run.smithi137.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.131 INFO:teuthology.orchestra.run.smithi137.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.131 INFO:teuthology.orchestra.run.smithi137.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.131 INFO:teuthology.orchestra.run.smithi137.stderr: 2021-05-26T16:40:55.131 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7f2734002c80 con 0x7f27400642e0 2021-05-26T16:40:55.131 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.077+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 8 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (unknown 2722888909 0 0) 0x7f2734006880 con 0x7f27400642e0 2021-05-26T16:40:55.132 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.078+0000 7f2745542700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:55.132 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.078+0000 7f2745542700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:55.132 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.078+0000 7f2745542700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:40:55.132 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.078+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.137:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2718004db0 con 0x7f27400642e0 2021-05-26T16:40:55.133 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.080+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7f2734006bd0 con 0x7f27400642e0 2021-05-26T16:40:55.133 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.080+0000 7f2726ffd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:55.133 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.080+0000 7f2726ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:55.161 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.157+0000 7f2745542700 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "acee8981-3ab2-4bad-b287-217a027a7b93", "id": 5}] 2021-05-26T16:40:55.161 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.157+0000 7f2745542700 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "acee8981-3ab2-4bad-b287-217a027a7b93", "id": 5}] 2021-05-26T16:40:55.161 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.157+0000 7f2745542700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:40:55.161 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.158+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 --> v1:172.21.15.137:6790/0 -- mon_command({"prefix": "osd new", "uuid": "acee8981-3ab2-4bad-b287-217a027a7b93", "id": 5} v 0) v1 -- 0x7f27180055e0 con 0x7f27400642e0 2021-05-26T16:40:55.165 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.162+0000 7f2726ffd700 1 -- 172.21.15.137:0/1734207215 <== mon.3 v1:172.21.15.137:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "acee8981-3ab2-4bad-b287-217a027a7b93", "id": 5}]=0 v8) v1 ==== 112+0+2 (unknown 1990463569 0 1988412176) 0x7f2734006470 con 0x7f27400642e0 2021-05-26T16:40:55.165 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.162+0000 7f2726ffd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "acee8981-3ab2-4bad-b287-217a027a7b93", "id": 5}] 2021-05-26T16:40:55.165 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.162+0000 7f2726ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:40:55.165 INFO:teuthology.orchestra.run.smithi137.stdout:5 2021-05-26T16:40:55.167 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.163+0000 7f2745542700 10 monclient: shutdown 2021-05-26T16:40:55.167 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.163+0000 7f2745542700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:55.167 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.163+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 >> v1:172.21.15.137:6790/0 conn(0x7f27400642e0 legacy=0x7f2740141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.167 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.163+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 shutdown_connections 2021-05-26T16:40:55.168 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.163+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 >> 172.21.15.137:0/1734207215 conn(0x7f27400a0db0 msgr2=0x7f274009ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:55.168 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.163+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 shutdown_connections 2021-05-26T16:40:55.168 INFO:teuthology.orchestra.run.smithi137.stderr:2021-05-26T16:40:55.163+0000 7f2745542700 1 -- 172.21.15.137:0/1734207215 wait complete. 2021-05-26T16:40:55.177 INFO:tasks.ceph.osd.0:Restarting daemon 2021-05-26T16:40:55.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-05-26T16:40:55.180 INFO:tasks.ceph.osd.0:Started 2021-05-26T16:40:55.181 INFO:tasks.ceph.osd.1:Restarting daemon 2021-05-26T16:40:55.181 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-05-26T16:40:55.183 INFO:tasks.ceph.osd.1:Started 2021-05-26T16:40:55.184 INFO:tasks.ceph.osd.2:Restarting daemon 2021-05-26T16:40:55.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-05-26T16:40:55.186 INFO:tasks.ceph.osd.2:Started 2021-05-26T16:40:55.187 INFO:tasks.ceph.osd.3:Restarting daemon 2021-05-26T16:40:55.187 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-05-26T16:40:55.190 INFO:tasks.ceph.osd.3:Started 2021-05-26T16:40:55.190 INFO:tasks.ceph.osd.4:Restarting daemon 2021-05-26T16:40:55.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-05-26T16:40:55.193 INFO:tasks.ceph.osd.4:Started 2021-05-26T16:40:55.193 INFO:tasks.ceph.osd.5:Restarting daemon 2021-05-26T16:40:55.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-05-26T16:40:55.195 INFO:tasks.ceph.osd.5:Started 2021-05-26T16:40:55.196 INFO:tasks.ceph:Waiting for OSDs to come up 2021-05-26T16:40:55.783 INFO:tasks.ceph.osd.3.smithi137.stderr:2021-05-26T16:40:55.780+0000 7fb039ba30c0 -1 Falling back to public interface 2021-05-26T16:40:55.785 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-05-26T16:40:55.783+0000 7f731f0180c0 -1 Falling back to public interface 2021-05-26T16:40:55.786 INFO:tasks.ceph.osd.4.smithi137.stderr:2021-05-26T16:40:55.783+0000 7fb2941f90c0 -1 Falling back to public interface 2021-05-26T16:40:55.786 INFO:tasks.ceph.osd.5.smithi137.stderr:2021-05-26T16:40:55.784+0000 7feedb14a0c0 -1 Falling back to public interface 2021-05-26T16:40:55.788 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-05-26T16:40:55.786+0000 7f74671f20c0 -1 Falling back to public interface 2021-05-26T16:40:55.789 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-05-26T16:40:55.787+0000 7fa187cbb0c0 -1 Falling back to public interface 2021-05-26T16:40:55.801 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-05-26T16:40:55.918 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.915+0000 7f445c856700 10 monclient: get_monmap_and_config 2021-05-26T16:40:55.918 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.915+0000 7f445c856700 10 monclient: build_initial_monmap 2021-05-26T16:40:55.918 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.915+0000 7f445c856700 10 monclient: monmap: 2021-05-26T16:40:55.919 INFO:teuthology.misc.health.smithi003.stderr:epoch 0 2021-05-26T16:40:55.919 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.919 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:55.915810+0000 2021-05-26T16:40:55.919 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:55.915810+0000 2021-05-26T16:40:55.919 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:55.920 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:55.920 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:55.920 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:55.920 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:55.921 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:55.921 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:55.921 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:55.921 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:55.921 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:55.922 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:55.922 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:40:55.922 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.915+0000 7f445c856700 1 Processor -- start 2021-05-26T16:40:55.922 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.915+0000 7f445c856700 1 -- start start 2021-05-26T16:40:55.923 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.915+0000 7f445c856700 10 monclient: init 2021-05-26T16:40:55.932 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:55.933 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 10 monclient: _add_conns ranks=[4,3,0,5,6,8,7,2,1] 2021-05-26T16:40:55.933 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 10 monclient(hunting): picked mon.noname-c con 0x7f4458064a20 addr v1:172.21.15.3:6791/0 2021-05-26T16:40:55.933 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 10 monclient(hunting): picked mon.noname-g con 0x7f4458063e30 addr v1:172.21.15.137:6790/0 2021-05-26T16:40:55.933 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 10 monclient(hunting): picked mon.noname-a con 0x7f44580642e0 addr v1:172.21.15.3:6789/0 2021-05-26T16:40:55.934 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4458059750 con 0x7f44580642e0 2021-05-26T16:40:55.934 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4458064e00 con 0x7f4458063e30 2021-05-26T16:40:55.934 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445809c770 con 0x7f4458064a20 2021-05-26T16:40:55.934 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:55.934 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445c856700 10 monclient(hunting): authenticate will time out at 813.547480s 2021-05-26T16:40:55.935 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445659c700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f4458064a20 0x7f4458099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36150/0 (socket says 172.21.15.3:36150) 2021-05-26T16:40:55.935 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f445659c700 1 -- 172.21.15.3:0/1865899752 learned_addr learned my addr 172.21.15.3:0/1865899752 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:40:55.935 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.916+0000 7f4456d9d700 1 --1- 172.21.15.3:0/1865899752 >> v1:172.21.15.3:6789/0 conn(0x7f44580642e0 0x7f44581357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50642/0 (socket says 172.21.15.3:50642) 2021-05-26T16:40:55.935 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.918+0000 7f445659c700 1 -- 172.21.15.3:0/1865899752 >> v1:172.21.15.3:6791/0 conn(0x7f4458064a20 legacy=0x7f4458099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.936 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.918+0000 7f4456d9d700 1 -- 172.21.15.3:0/1865899752 >> v1:172.21.15.3:6789/0 conn(0x7f44580642e0 legacy=0x7f44581357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.936 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.918+0000 7f4455d9b700 1 -- 172.21.15.3:0/1865899752 >> v1:172.21.15.137:6790/0 conn(0x7f4458063e30 legacy=0x7f4458132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.936 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873624216 0 0) 0x7f4458059750 con 0x7f44580642e0 2021-05-26T16:40:55.936 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:55.936 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:55.937 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient(hunting): my global_id is 4176 2021-05-26T16:40:55.937 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443c003270 con 0x7f44580642e0 2021-05-26T16:40:55.937 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3481046060 0 0) 0x7f443c003270 con 0x7f44580642e0 2021-05-26T16:40:55.937 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 >> v1:172.21.15.3:6791/0 conn(0x7f4458064a20 legacy=0x7f4458099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.937 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 >> v1:172.21.15.137:6790/0 conn(0x7f4458063e30 legacy=0x7f4458132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.938 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: _finish_hunting 0 2021-05-26T16:40:55.938 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 monclient: found mon.noname-a 2021-05-26T16:40:55.938 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:55.938 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:40:55.939 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44580977a0 con 0x7f44580642e0 2021-05-26T16:40:55.939 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: _finish_auth 0 2021-05-26T16:40:55.939 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:55.939 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 5 monclient: authenticate success, global_id 4176 2021-05-26T16:40:55.939 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:55.940 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4448001de0 con 0x7f44580642e0 2021-05-26T16:40:55.940 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.940 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:40:55.940 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: dump: 2021-05-26T16:40:55.940 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:40:55.941 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.941 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.941 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.941 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.942 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:55.942 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.942 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.942 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.942 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.943 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.943 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.943 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.943 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.943 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.944 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:40:55.944 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:40:55.944 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f44480020f0 con 0x7f44580642e0 2021-05-26T16:40:55.944 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:55.945 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 10 monclient: get_monmap_and_config success 2021-05-26T16:40:55.945 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 1 -- 172.21.15.3:0/1865899752 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4448004bf0 con 0x7f44580642e0 2021-05-26T16:40:55.945 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 4 set_mon_vals no callback set 2021-05-26T16:40:55.945 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.946 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:40:55.946 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445559a700 10 monclient: dump: 2021-05-26T16:40:55.946 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:40:55.946 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.946 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.947 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.947 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.947 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:55.947 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.947 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.948 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.948 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.948 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.948 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.949 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.949 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.949 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.949 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:40:55.949 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 10 monclient: shutdown 2021-05-26T16:40:55.950 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:55.950 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 1 -- 172.21.15.3:0/1865899752 >> v1:172.21.15.3:6789/0 conn(0x7f44580642e0 legacy=0x7f44581357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.950 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 1 -- 172.21.15.3:0/1865899752 shutdown_connections 2021-05-26T16:40:55.950 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 1 -- 172.21.15.3:0/1865899752 >> 172.21.15.3:0/1865899752 conn(0x7f44580a0db0 msgr2=0x7f445809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:55.950 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.919+0000 7f445c856700 1 -- 172.21.15.3:0/1865899752 shutdown_connections 2021-05-26T16:40:55.951 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.920+0000 7f445c856700 1 -- 172.21.15.3:0/1865899752 wait complete. 2021-05-26T16:40:55.951 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.920+0000 7f445c856700 10 monclient: build_initial_monmap 2021-05-26T16:40:55.951 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.920+0000 7f445c856700 10 monclient: monmap: 2021-05-26T16:40:55.951 INFO:teuthology.misc.health.smithi003.stderr:epoch 0 2021-05-26T16:40:55.952 INFO:teuthology.misc.health.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:40:55.952 INFO:teuthology.misc.health.smithi003.stderr:last_changed 0.000000 2021-05-26T16:40:55.952 INFO:teuthology.misc.health.smithi003.stderr:created 0.000000 2021-05-26T16:40:55.952 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:40:55.952 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:55.953 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:40:55.953 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:40:55.953 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:40:55.953 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:40:55.953 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:40:55.954 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:40:55.954 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:40:55.954 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:40:55.954 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:40:55.954 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:40:55.955 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.920+0000 7f445c856700 1 Processor -- start 2021-05-26T16:40:55.955 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.920+0000 7f445c856700 1 -- start start 2021-05-26T16:40:55.955 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.920+0000 7f445c856700 10 monclient: init 2021-05-26T16:40:55.955 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 10 monclient: _reopen_session rank -1 2021-05-26T16:40:55.956 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 10 monclient: _add_conns ranks=[6,2,8,0,5,7,4,1,3] 2021-05-26T16:40:55.956 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 10 monclient(hunting): picked mon.noname-d con 0x7f4458063e30 addr v1:172.21.15.3:6792/0 2021-05-26T16:40:55.956 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 10 monclient(hunting): picked mon.noname-b con 0x7f44580642e0 addr v1:172.21.15.3:6790/0 2021-05-26T16:40:55.956 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 10 monclient(hunting): picked mon.noname-e con 0x7f4458064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:40:55.956 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4458116c80 con 0x7f44580642e0 2021-05-26T16:40:55.957 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4458116f20 con 0x7f4458063e30 2021-05-26T16:40:55.957 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44581171c0 con 0x7f4458064a20 2021-05-26T16:40:55.957 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 10 monclient(hunting): _renew_subs 2021-05-26T16:40:55.957 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f445c856700 10 monclient(hunting): authenticate will time out at 813.552300s 2021-05-26T16:40:55.957 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f4455d9b700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f44580642e0 0x7f44581412c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52686/0 (socket says 172.21.15.3:52686) 2021-05-26T16:40:55.958 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.921+0000 7f4455d9b700 1 -- 172.21.15.3:0/2060537971 learned_addr learned my addr 172.21.15.3:0/2060537971 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:40:55.958 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f4455d9b700 1 -- 172.21.15.3:0/2060537971 >> v1:172.21.15.3:6790/0 conn(0x7f44580642e0 legacy=0x7f44581412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.958 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f4456d9d700 1 -- 172.21.15.3:0/2060537971 >> v1:172.21.15.3:6793/0 conn(0x7f4458064a20 legacy=0x7f44581449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.958 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f445659c700 1 -- 172.21.15.3:0/2060537971 >> v1:172.21.15.3:6792/0 conn(0x7f4458063e30 legacy=0x7f4458129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:40:55.959 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765799201 0 0) 0x7f4458116c80 con 0x7f44580642e0 2021-05-26T16:40:55.959 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f44467fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:40:55.959 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f44467fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:40:55.959 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f44467fc700 10 monclient(hunting): my global_id is 4160 2021-05-26T16:40:55.959 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.923+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4434003270 con 0x7f44580642e0 2021-05-26T16:40:55.960 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2516310170 0 0) 0x7f4434003270 con 0x7f44580642e0 2021-05-26T16:40:55.960 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4458116c80 con 0x7f44580642e0 2021-05-26T16:40:55.960 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f444c001f00 con 0x7f44580642e0 2021-05-26T16:40:55.960 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.960 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:40:55.961 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient(hunting): dump: 2021-05-26T16:40:55.961 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:40:55.961 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.961 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.962 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.962 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.962 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:55.962 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.962 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.963 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.963 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.963 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.963 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.963 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.964 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.964 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.964 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:40:55.964 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:40:55.965 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2945484544 0 0) 0x7f4458116c80 con 0x7f44580642e0 2021-05-26T16:40:55.965 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 >> v1:172.21.15.3:6793/0 conn(0x7f4458064a20 legacy=0x7f44581449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.965 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 >> v1:172.21.15.3:6792/0 conn(0x7f4458063e30 legacy=0x7f4458129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.965 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient: _finish_hunting 0 2021-05-26T16:40:55.965 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 monclient: found mon.b 2021-05-26T16:40:55.966 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:40:55.966 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:40:55.966 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445812e470 con 0x7f44580642e0 2021-05-26T16:40:55.966 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient: _finish_auth 0 2021-05-26T16:40:55.966 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:40:55.967 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f445c856700 5 monclient: authenticate success, global_id 4160 2021-05-26T16:40:55.967 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f445c856700 10 monclient: _renew_subs 2021-05-26T16:40:55.967 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f445c856700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:40:55.967 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4458131410 con 0x7f44580642e0 2021-05-26T16:40:55.968 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f445c856700 10 monclient: _renew_subs 2021-05-26T16:40:55.968 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f445c856700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:40:55.968 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f44581316c0 con 0x7f44580642e0 2021-05-26T16:40:55.968 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f444c002500 con 0x7f44580642e0 2021-05-26T16:40:55.968 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:40:55.969 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f444c0029b0 con 0x7f44580642e0 2021-05-26T16:40:55.969 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:40:55.969 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f4454d99700 4 set_mon_vals no callback set 2021-05-26T16:40:55.969 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:40:55.969 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 10 monclient: dump: 2021-05-26T16:40:55.970 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:40:55.970 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:40:55.970 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.970 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:40:55.971 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:40:55.971 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:40:55.971 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:40:55.971 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:40:55.972 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:40:55.972 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:40:55.972 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:40:55.972 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:40:55.972 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:40:55.973 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:40:55.973 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:40:55.973 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:40:55.973 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 1) v1 ==== 630+0+0 (unknown 1505881080 0 0) 0x7f444c005510 con 0x7f44580642e0 2021-05-26T16:40:55.973 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.924+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (unknown 1880931099 0 0) 0x7f444c006990 con 0x7f44580642e0 2021-05-26T16:40:55.974 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.925+0000 7f445c856700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:55.974 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.925+0000 7f445c856700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:55.974 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.925+0000 7f445c856700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:40:55.974 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.925+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4438004db0 con 0x7f44580642e0 2021-05-26T16:40:55.975 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.927+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72237 (unknown 1092875540 0 1415944542) 0x7f444c006490 con 0x7f44580642e0 2021-05-26T16:40:55.975 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.927+0000 7f44467fc700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:40:55.975 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.927+0000 7f44467fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:40:55.996 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.993+0000 7f445c856700 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:40:55.996 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.993+0000 7f445c856700 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:40:55.996 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.993+0000 7f445c856700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:40:55.996 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.993+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4438005060 con 0x7f44580642e0 2021-05-26T16:40:55.997 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.993+0000 7f44467fc700 1 -- 172.21.15.3:0/2060537971 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+5570 (unknown 150273500 0 2181451609) 0x7f444c006770 con 0x7f44580642e0 2021-05-26T16:40:55.997 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.993+0000 7f44467fc700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:40:55.997 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.993+0000 7f44467fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:40:55.997 INFO:teuthology.misc.health.smithi003.stdout: 2021-05-26T16:40:55.998 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":8,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","created":"2021-05-26T16:40:51.540326+0000","modified":"2021-05-26T16:40:55.160191+0000","last_up_change":"0.000000","last_in_change":"2021-05-26T16:40:55.160191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"15008bbc-879f-43a6-bfbc-f16853c84582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"13c28fda-7809-4964-9b17-4c6fb9fff0ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ca01de00-a5fb-4b03-9412-bca079506190","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ecf54fc5-53a9-4585-a369-03a5d382cfd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c2926c74-967a-4c6d-acb7-4a0d32f89e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"acee8981-3ab2-4bad-b287-217a027a7b93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-05-26T16:40:55.999 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.994+0000 7f445c856700 10 monclient: shutdown 2021-05-26T16:40:55.999 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.994+0000 7f445c856700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:40:55.999 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.994+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 >> v1:172.21.15.3:6790/0 conn(0x7f44580642e0 legacy=0x7f44581412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:40:55.999 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.994+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 shutdown_connections 2021-05-26T16:40:56.000 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.994+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 >> 172.21.15.3:0/2060537971 conn(0x7f44580a0db0 msgr2=0x7f44580986b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:40:56.000 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.994+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 shutdown_connections 2021-05-26T16:40:56.000 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:40:55.994+0000 7f445c856700 1 -- 172.21.15.3:0/2060537971 wait complete. 2021-05-26T16:40:56.007 DEBUG:teuthology.misc:0 of 6 OSDs are up 2021-05-26T16:40:59.232 INFO:tasks.ceph.osd.3.smithi137.stderr:2021-05-26T16:40:59.229+0000 7fb039ba30c0 -1 osd.3 0 log_to_monitors {default=true} 2021-05-26T16:40:59.233 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-05-26T16:40:59.230+0000 7f731f0180c0 -1 osd.0 0 log_to_monitors {default=true} 2021-05-26T16:40:59.251 INFO:tasks.ceph.osd.5.smithi137.stderr:2021-05-26T16:40:59.248+0000 7feedb14a0c0 -1 osd.5 0 log_to_monitors {default=true} 2021-05-26T16:40:59.262 INFO:tasks.ceph.osd.4.smithi137.stderr:2021-05-26T16:40:59.259+0000 7fb2941f90c0 -1 osd.4 0 log_to_monitors {default=true} 2021-05-26T16:40:59.263 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-05-26T16:40:59.261+0000 7f74671f20c0 -1 osd.1 0 log_to_monitors {default=true} 2021-05-26T16:40:59.277 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-05-26T16:40:59.275+0000 7fa187cbb0c0 -1 osd.2 0 log_to_monitors {default=true} 2021-05-26T16:41:00.304 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-05-26T16:41:00.302+0000 7f745d979700 -1 osd.1 0 waiting for initial osdmap 2021-05-26T16:41:00.305 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-05-26T16:41:00.303+0000 7f731579f700 -1 osd.0 0 waiting for initial osdmap 2021-05-26T16:41:00.310 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-05-26T16:41:00.308+0000 7f7310145700 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-05-26T16:41:00.311 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-05-26T16:41:00.307+0000 7f745831f700 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-05-26T16:41:00.311 INFO:tasks.ceph.osd.3.smithi137.stderr:2021-05-26T16:41:00.307+0000 7fb03032a700 -1 osd.3 0 waiting for initial osdmap 2021-05-26T16:41:00.312 INFO:tasks.ceph.osd.0.smithi003.stdout: vendor '' 2021-05-26T16:41:00.312 INFO:tasks.ceph.osd.0.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:00.312 INFO:tasks.ceph.osd.0.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:00.313 INFO:tasks.ceph.osd.0.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:00.313 INFO:tasks.ceph.osd.0.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:00.313 INFO:tasks.ceph.osd.4.smithi137.stderr:2021-05-26T16:41:00.307+0000 7fb28a980700 -1 osd.4 0 waiting for initial osdmap 2021-05-26T16:41:00.314 INFO:tasks.ceph.osd.5.smithi137.stderr:2021-05-26T16:41:00.308+0000 7feed18d1700 -1 osd.5 0 waiting for initial osdmap 2021-05-26T16:41:00.314 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-05-26T16:41:00.310+0000 7fa17e442700 -1 osd.2 0 waiting for initial osdmap 2021-05-26T16:41:00.315 INFO:tasks.ceph.osd.3.smithi137.stderr:2021-05-26T16:41:00.312+0000 7fb02acd0700 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-05-26T16:41:00.315 INFO:tasks.ceph.osd.4.smithi137.stderr:2021-05-26T16:41:00.312+0000 7fb285326700 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-05-26T16:41:00.316 INFO:tasks.ceph.osd.5.smithi137.stderr:2021-05-26T16:41:00.312+0000 7feecc277700 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-05-26T16:41:00.316 INFO:tasks.ceph.osd.5.smithi137.stdout: vendor '' 2021-05-26T16:41:00.316 INFO:tasks.ceph.osd.5.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:00.317 INFO:tasks.ceph.osd.5.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:00.317 INFO:tasks.ceph.osd.5.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:00.317 INFO:tasks.ceph.osd.5.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:00.318 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-05-26T16:41:00.313+0000 7fa178de8700 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-05-26T16:41:00.318 INFO:tasks.ceph.osd.2.smithi003.stdout: vendor '' 2021-05-26T16:41:00.318 INFO:tasks.ceph.osd.2.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:00.319 INFO:tasks.ceph.osd.2.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:00.319 INFO:tasks.ceph.osd.2.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:00.319 INFO:tasks.ceph.osd.2.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:00.322 INFO:tasks.ceph.osd.1.smithi003.stdout: vendor '' 2021-05-26T16:41:00.323 INFO:tasks.ceph.osd.1.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:00.323 INFO:tasks.ceph.osd.1.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:00.323 INFO:tasks.ceph.osd.1.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:00.323 INFO:tasks.ceph.osd.1.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:00.327 INFO:tasks.ceph.osd.3.smithi137.stdout: vendor '' 2021-05-26T16:41:00.327 INFO:tasks.ceph.osd.3.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:00.328 INFO:tasks.ceph.osd.3.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:00.328 INFO:tasks.ceph.osd.3.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:00.328 INFO:tasks.ceph.osd.3.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:00.328 INFO:tasks.ceph.osd.4.smithi137.stdout: vendor '' 2021-05-26T16:41:00.329 INFO:tasks.ceph.osd.4.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:00.329 INFO:tasks.ceph.osd.4.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:00.329 INFO:tasks.ceph.osd.4.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:00.329 INFO:tasks.ceph.osd.4.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:02.612 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-05-26T16:41:02.732 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.729+0000 7ff20aa43700 10 monclient: get_monmap_and_config 2021-05-26T16:41:02.732 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.729+0000 7ff20aa43700 10 monclient: build_initial_monmap 2021-05-26T16:41:02.732 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.729+0000 7ff20aa43700 10 monclient: monmap: 2021-05-26T16:41:02.733 INFO:teuthology.misc.health.smithi003.stderr:epoch 0 2021-05-26T16:41:02.733 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:02.733 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:41:02.730054+0000 2021-05-26T16:41:02.733 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:41:02.730054+0000 2021-05-26T16:41:02.734 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:02.734 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.734 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:02.734 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:02.734 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:02.735 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:02.735 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:02.735 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:02.735 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:02.735 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:02.736 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:02.736 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.748 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 1 Processor -- start 2021-05-26T16:41:02.748 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 1 -- start start 2021-05-26T16:41:02.749 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient: init 2021-05-26T16:41:02.749 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:02.749 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient: _add_conns ranks=[6,2,4,3,0,7,5,8,1] 2021-05-26T16:41:02.749 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient(hunting): picked mon.noname-d con 0x7ff204096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:02.749 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient(hunting): picked mon.noname-b con 0x7ff204099db0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:02.750 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient(hunting): picked mon.noname-c con 0x7ff20409a260 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:02.750 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204059750 con 0x7ff204099db0 2021-05-26T16:41:02.750 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204064620 con 0x7ff20409a260 2021-05-26T16:41:02.750 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204064e50 con 0x7ff204096ca0 2021-05-26T16:41:02.751 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:02.751 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff20aa43700 10 monclient(hunting): authenticate will time out at 820.361710s 2021-05-26T16:41:02.751 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff203fff700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7ff204096ca0 0x7ff204063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56174/0 (socket says 172.21.15.3:56174) 2021-05-26T16:41:02.751 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff203fff700 1 -- 172.21.15.3:0/3240265139 learned_addr learned my addr 172.21.15.3:0/3240265139 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:02.751 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff2037fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7ff204099db0 0x7ff204132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52818/0 (socket says 172.21.15.3:52818) 2021-05-26T16:41:02.752 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.730+0000 7ff208fe0700 1 --1- 172.21.15.3:0/3240265139 >> v1:172.21.15.3:6791/0 conn(0x7ff20409a260 0x7ff2041357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36290/0 (socket says 172.21.15.3:36290) 2021-05-26T16:41:02.752 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff208fe0700 1 -- 172.21.15.3:0/3240265139 >> v1:172.21.15.3:6791/0 conn(0x7ff20409a260 legacy=0x7ff2041357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:02.752 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff203fff700 1 -- 172.21.15.3:0/3240265139 >> v1:172.21.15.3:6792/0 conn(0x7ff204096ca0 legacy=0x7ff204063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:02.752 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff2037fe700 1 -- 172.21.15.3:0/3240265139 >> v1:172.21.15.3:6790/0 conn(0x7ff204099db0 legacy=0x7ff204132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:02.752 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553687130 0 0) 0x7ff204064620 con 0x7ff20409a260 2021-05-26T16:41:02.753 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:02.753 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:02.753 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): my global_id is 4198 2021-05-26T16:41:02.753 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e8003270 con 0x7ff20409a260 2021-05-26T16:41:02.754 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361353920 0 0) 0x7ff204059750 con 0x7ff204099db0 2021-05-26T16:41:02.754 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:02.754 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:02.754 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): my global_id is 4187 2021-05-26T16:41:02.754 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff204064620 con 0x7ff204099db0 2021-05-26T16:41:02.755 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296917426 0 0) 0x7ff204064e50 con 0x7ff204096ca0 2021-05-26T16:41:02.755 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:02.755 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:02.755 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient(hunting): my global_id is 4173 2021-05-26T16:41:02.756 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff204059750 con 0x7ff204096ca0 2021-05-26T16:41:02.756 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321186124 0 0) 0x7ff1e8003270 con 0x7ff20409a260 2021-05-26T16:41:02.756 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 >> v1:172.21.15.3:6792/0 conn(0x7ff204096ca0 legacy=0x7ff204063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:02.756 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 >> v1:172.21.15.3:6790/0 conn(0x7ff204099db0 legacy=0x7ff204132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:02.757 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:02.757 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 monclient: found mon.noname-c 2021-05-26T16:41:02.757 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:02.757 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:02.757 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20409c390 con 0x7ff20409a260 2021-05-26T16:41:02.758 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:02.758 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:02.758 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff1f8001de0 con 0x7ff20409a260 2021-05-26T16:41:02.758 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:02.758 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:02.759 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff202ffd700 10 monclient: dump: 2021-05-26T16:41:02.759 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:41:02.759 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:02.760 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.760 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.760 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:02.760 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.760 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:02.761 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:02.761 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:02.761 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:02.761 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:02.762 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:02.762 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:02.762 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:02.762 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:02.763 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.763 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff20aa43700 5 monclient: authenticate success, global_id 4198 2021-05-26T16:41:02.764 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.733+0000 7ff20aa43700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:02.764 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff1f80020f0 con 0x7ff20409a260 2021-05-26T16:41:02.764 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff202ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:02.765 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:02.765 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff202ffd700 1 -- 172.21.15.3:0/3240265139 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff1f8004bf0 con 0x7ff20409a260 2021-05-26T16:41:02.766 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff202ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:02.766 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 4 set_mon_vals no callback set 2021-05-26T16:41:02.767 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff202ffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:02.767 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff202ffd700 10 monclient: dump: 2021-05-26T16:41:02.767 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:41:02.768 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:02.768 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.769 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.769 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:02.769 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.770 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:02.770 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:02.771 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:02.771 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:02.771 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:02.772 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:02.772 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:02.773 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:02.773 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:02.773 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.774 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 10 monclient: shutdown 2021-05-26T16:41:02.774 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:02.775 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 1 -- 172.21.15.3:0/3240265139 >> v1:172.21.15.3:6791/0 conn(0x7ff20409a260 legacy=0x7ff2041357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:02.775 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 1 -- 172.21.15.3:0/3240265139 shutdown_connections 2021-05-26T16:41:02.776 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 1 -- 172.21.15.3:0/3240265139 >> 172.21.15.3:0/3240265139 conn(0x7ff20409cc00 msgr2=0x7ff20409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:02.776 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 1 -- 172.21.15.3:0/3240265139 shutdown_connections 2021-05-26T16:41:02.776 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.734+0000 7ff20aa43700 1 -- 172.21.15.3:0/3240265139 wait complete. 2021-05-26T16:41:02.777 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.735+0000 7ff20aa43700 10 monclient: build_initial_monmap 2021-05-26T16:41:02.777 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.735+0000 7ff20aa43700 10 monclient: monmap: 2021-05-26T16:41:02.778 INFO:teuthology.misc.health.smithi003.stderr:epoch 0 2021-05-26T16:41:02.778 INFO:teuthology.misc.health.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:02.778 INFO:teuthology.misc.health.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:02.779 INFO:teuthology.misc.health.smithi003.stderr:created 0.000000 2021-05-26T16:41:02.779 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:02.780 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.780 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:02.781 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:02.781 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:02.781 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:02.782 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:02.782 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:02.783 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:02.783 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:02.783 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:02.784 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.784 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.735+0000 7ff20aa43700 1 Processor -- start 2021-05-26T16:41:02.784 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.735+0000 7ff20aa43700 1 -- start start 2021-05-26T16:41:02.785 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.735+0000 7ff20aa43700 10 monclient: init 2021-05-26T16:41:02.785 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:02.785 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 10 monclient: _add_conns ranks=[0,6,8,3,1,4,5,7,2] 2021-05-26T16:41:02.786 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 10 monclient(hunting): picked mon.noname-a con 0x7ff204096ca0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:02.786 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 10 monclient(hunting): picked mon.noname-d con 0x7ff204099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:02.786 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 10 monclient(hunting): picked mon.noname-e con 0x7ff20409a260 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:02.787 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2041186b0 con 0x7ff204096ca0 2021-05-26T16:41:02.787 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040962d0 con 0x7ff204099db0 2021-05-26T16:41:02.787 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2041188e0 con 0x7ff20409a260 2021-05-26T16:41:02.788 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:02.788 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff20aa43700 10 monclient(hunting): authenticate will time out at 820.367236s 2021-05-26T16:41:02.788 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff203fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff204096ca0 0x7ff2040954b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50780/0 (socket says 172.21.15.3:50780) 2021-05-26T16:41:02.788 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.736+0000 7ff203fff700 1 -- 172.21.15.3:0/1756206102 learned_addr learned my addr 172.21.15.3:0/1756206102 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:02.788 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff2037fe700 1 -- 172.21.15.3:0/1756206102 >> v1:172.21.15.3:6792/0 conn(0x7ff204099db0 legacy=0x7ff204095bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:02.789 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff208fe0700 1 -- 172.21.15.3:0/1756206102 >> v1:172.21.15.3:6793/0 conn(0x7ff20409a260 legacy=0x7ff20413fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:02.789 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff203fff700 1 -- 172.21.15.3:0/1756206102 >> v1:172.21.15.3:6789/0 conn(0x7ff204096ca0 legacy=0x7ff2040954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:02.789 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089247799 0 0) 0x7ff2040962d0 con 0x7ff204099db0 2021-05-26T16:41:02.789 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:02.789 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:02.790 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): my global_id is 4182 2021-05-26T16:41:02.790 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e4003270 con 0x7ff204099db0 2021-05-26T16:41:02.790 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622036949 0 0) 0x7ff2041188e0 con 0x7ff20409a260 2021-05-26T16:41:02.790 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:02.791 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:02.791 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): my global_id is 4166 2021-05-26T16:41:02.792 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2040962d0 con 0x7ff20409a260 2021-05-26T16:41:02.792 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519584274 0 0) 0x7ff2041186b0 con 0x7ff204096ca0 2021-05-26T16:41:02.792 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:02.792 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:02.792 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): my global_id is 4239 2021-05-26T16:41:02.793 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2041188e0 con 0x7ff204096ca0 2021-05-26T16:41:02.793 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2105317363 0 0) 0x7ff1e4003270 con 0x7ff204099db0 2021-05-26T16:41:02.793 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff2041186b0 con 0x7ff204099db0 2021-05-26T16:41:02.793 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff1f4001cb0 con 0x7ff204099db0 2021-05-26T16:41:02.794 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:02.794 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:02.794 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.738+0000 7ff1effff700 10 monclient(hunting): dump: 2021-05-26T16:41:02.795 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:41:02.795 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:02.795 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.796 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.796 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:02.796 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.796 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:02.797 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:02.797 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:02.797 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:02.797 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:02.797 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:02.798 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:02.798 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:02.798 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:02.798 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.799 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:02.799 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2970059665 0 0) 0x7ff2040962d0 con 0x7ff20409a260 2021-05-26T16:41:02.799 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1e4003270 con 0x7ff20409a260 2021-05-26T16:41:02.799 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2668519268 0 0) 0x7ff2041188e0 con 0x7ff204096ca0 2021-05-26T16:41:02.799 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff2040962d0 con 0x7ff204096ca0 2021-05-26T16:41:02.800 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff1f8001e10 con 0x7ff20409a260 2021-05-26T16:41:02.800 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:02.800 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:02.800 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient(hunting): dump: 2021-05-26T16:41:02.800 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:41:02.801 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:02.801 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.801 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.801 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:02.801 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.802 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:02.802 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:02.802 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:02.802 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:02.803 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:02.803 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:02.803 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:02.803 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:02.803 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:02.804 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.804 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff1f0001cb0 con 0x7ff204096ca0 2021-05-26T16:41:02.804 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:02.804 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:02.805 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient(hunting): dump: 2021-05-26T16:41:02.805 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:41:02.805 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:02.805 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.806 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.806 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:02.807 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.807 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:02.808 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:02.808 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:02.809 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:02.809 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:02.809 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:02.809 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:02.810 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:02.810 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:02.810 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.810 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3565401118 0 0) 0x7ff2041186b0 con 0x7ff204099db0 2021-05-26T16:41:02.810 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 >> v1:172.21.15.3:6793/0 conn(0x7ff20409a260 legacy=0x7ff20413fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:02.811 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 >> v1:172.21.15.3:6789/0 conn(0x7ff204096ca0 legacy=0x7ff2040954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:02.811 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:02.811 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 monclient: found mon.d 2021-05-26T16:41:02.811 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:02.811 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:02.812 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204118b80 con 0x7ff204099db0 2021-05-26T16:41:02.812 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient: _finish_auth 0 2021-05-26T16:41:02.812 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:02.812 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff20aa43700 5 monclient: authenticate success, global_id 4182 2021-05-26T16:41:02.813 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff20aa43700 10 monclient: _renew_subs 2021-05-26T16:41:02.813 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff20aa43700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:02.813 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff204118e80 con 0x7ff204099db0 2021-05-26T16:41:02.813 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff20aa43700 10 monclient: _renew_subs 2021-05-26T16:41:02.813 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff20aa43700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:02.814 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2041179b0 con 0x7ff204099db0 2021-05-26T16:41:02.814 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff1f40019c0 con 0x7ff204099db0 2021-05-26T16:41:02.814 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:02.814 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff1f4004e60 con 0x7ff204099db0 2021-05-26T16:41:02.815 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:02.815 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff2027fc700 4 set_mon_vals no callback set 2021-05-26T16:41:02.815 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:02.815 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.739+0000 7ff1effff700 10 monclient: dump: 2021-05-26T16:41:02.815 INFO:teuthology.misc.health.smithi003.stderr:epoch 1 2021-05-26T16:41:02.816 INFO:teuthology.misc.health.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:02.816 INFO:teuthology.misc.health.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.816 INFO:teuthology.misc.health.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:02.816 INFO:teuthology.misc.health.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:02.816 INFO:teuthology.misc.health.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:02.817 INFO:teuthology.misc.health.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:02.817 INFO:teuthology.misc.health.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:02.817 INFO:teuthology.misc.health.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:02.817 INFO:teuthology.misc.health.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:02.817 INFO:teuthology.misc.health.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:02.818 INFO:teuthology.misc.health.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:02.818 INFO:teuthology.misc.health.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:02.818 INFO:teuthology.misc.health.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:02.818 INFO:teuthology.misc.health.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:02.819 INFO:teuthology.misc.health.smithi003.stderr: 2021-05-26T16:41:02.819 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.740+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7ff1f400e3d0 con 0x7ff204099db0 2021-05-26T16:41:02.819 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.740+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(12..12 src has 1..12) v4 ==== 3172+0+0 (unknown 924368914 0 0) 0x7ff1f403d470 con 0x7ff204099db0 2021-05-26T16:41:02.819 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.740+0000 7ff20aa43700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:02.819 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.740+0000 7ff20aa43700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:02.820 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.740+0000 7ff20aa43700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:02.820 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.740+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc004db0 con 0x7ff204099db0 2021-05-26T16:41:02.820 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.740+0000 7ff203fff700 10 monclient: get_auth_request con 0x7ff1e40334f0 auth_method 0 2021-05-26T16:41:02.820 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.745+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7ff1f40132c0 con 0x7ff204099db0 2021-05-26T16:41:02.820 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.745+0000 7ff1effff700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:02.821 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.745+0000 7ff1effff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:02.907 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.904+0000 7ff20aa43700 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:02.908 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.904+0000 7ff20aa43700 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:02.908 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.904+0000 7ff20aa43700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:02.908 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.904+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1dc005060 con 0x7ff204099db0 2021-05-26T16:41:02.908 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.905+0000 7ff1effff700 1 -- 172.21.15.3:0/1756206102 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8448 (unknown 4250787923 0 797384006) 0x7ff1f4012eb0 con 0x7ff204099db0 2021-05-26T16:41:02.909 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.905+0000 7ff1effff700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:02.909 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.905+0000 7ff1effff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:02.909 INFO:teuthology.misc.health.smithi003.stdout: 2021-05-26T16:41:02.910 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":12,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","created":"2021-05-26T16:40:51.540326+0000","modified":"2021-05-26T16:41:02.308057+0000","last_up_change":"2021-05-26T16:41:01.304218+0000","last_in_change":"2021-05-26T16:40:55.160191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-05-26T16:41:01.359450+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"15008bbc-879f-43a6-bfbc-f16853c84582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6800","nonce":30458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6801","nonce":30458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6803","nonce":30458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6802","nonce":30458}]},"public_addr":"172.21.15.3:6800/30458","cluster_addr":"172.21.15.3:6801/30458","heartbeat_back_addr":"172.21.15.3:6803/30458","heartbeat_front_addr":"172.21.15.3:6802/30458","state":["exists","up"]},{"osd":1,"uuid":"13c28fda-7809-4964-9b17-4c6fb9fff0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6804","nonce":30459}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6805","nonce":30459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6808","nonce":30459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6806","nonce":30459}]},"public_addr":"172.21.15.3:6804/30459","cluster_addr":"172.21.15.3:6805/30459","heartbeat_back_addr":"172.21.15.3:6808/30459","heartbeat_front_addr":"172.21.15.3:6806/30459","state":["exists","up"]},{"osd":2,"uuid":"ca01de00-a5fb-4b03-9412-bca079506190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6807","nonce":30460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6809","nonce":30460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6811","nonce":30460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6810","nonce":30460}]},"public_addr":"172.21.15.3:6807/30460","cluster_addr":"172.21.15.3:6809/30460","heartbeat_back_addr":"172.21.15.3:6811/30460","heartbeat_front_addr":"172.21.15.3:6810/30460","state":["exists","up"]},{"osd":3,"uuid":"ecf54fc5-53a9-4585-a369-03a5d382cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6800","nonce":30479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6801","nonce":30479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6803","nonce":30479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6802","nonce":30479}]},"public_addr":"172.21.15.137:6800/30479","cluster_addr":"172.21.15.137:6801/30479","heartbeat_back_addr":"172.21.15.137:6803/30479","heartbeat_front_addr":"172.21.15.137:6802/30479","state":["exists","up"]},{"osd":4,"uuid":"c2926c74-967a-4c6d-acb7-4a0d32f89e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6804","nonce":30480}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6806","nonce":30480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6811","nonce":30480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6808","nonce":30480}]},"public_addr":"172.21.15.137:6804/30480","cluster_addr":"172.21.15.137:6806/30480","heartbeat_back_addr":"172.21.15.137:6811/30480","heartbeat_front_addr":"172.21.15.137:6808/30480","state":["exists","up"]},{"osd":5,"uuid":"acee8981-3ab2-4bad-b287-217a027a7b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6805","nonce":30481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6807","nonce":30481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6810","nonce":30481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6809","nonce":30481}]},"public_addr":"172.21.15.137:6805/30481","cluster_addr":"172.21.15.137:6807/30481","heartbeat_back_addr":"172.21.15.137:6810/30481","heartbeat_front_addr":"172.21.15.137:6809/30481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.244103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.235066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.269488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.281565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.243717+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.240437+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-05-26T16:41:02.911 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.906+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 >> v1:172.21.15.137:6812/30003 conn(0x7ff1e40334f0 legacy=0x7ff1e40359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:02.911 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.906+0000 7ff20aa43700 10 monclient: shutdown 2021-05-26T16:41:02.911 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.906+0000 7ff20aa43700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:02.911 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.906+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 >> v1:172.21.15.3:6792/0 conn(0x7ff204099db0 legacy=0x7ff204095bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:02.912 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.907+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 shutdown_connections 2021-05-26T16:41:02.912 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.907+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 >> 172.21.15.3:0/1756206102 conn(0x7ff20409cc00 msgr2=0x7ff20409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:02.912 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.907+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 shutdown_connections 2021-05-26T16:41:02.912 INFO:teuthology.misc.health.smithi003.stderr:2021-05-26T16:41:02.907+0000 7ff20aa43700 1 -- 172.21.15.3:0/1756206102 wait complete. 2021-05-26T16:41:02.920 DEBUG:teuthology.misc:6 of 6 OSDs are up 2021-05-26T16:41:02.921 INFO:tasks.ceph:Creating RBD pool 2021-05-26T16:41:02.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool create rbd 8 2021-05-26T16:41:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.035+0000 7fca7f0c3700 10 monclient: get_monmap_and_config 2021-05-26T16:41:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.035+0000 7fca7f0c3700 10 monclient: build_initial_monmap 2021-05-26T16:41:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.035+0000 7fca7f0c3700 10 monclient: monmap: 2021-05-26T16:41:03.039 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:03.039 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.039 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:03.036083+0000 2021-05-26T16:41:03.039 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:03.036083+0000 2021-05-26T16:41:03.039 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:03.042 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:03.042 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:03.043 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.035+0000 7fca7f0c3700 1 Processor -- start 2021-05-26T16:41:03.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 1 -- start start 2021-05-26T16:41:03.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient: init 2021-05-26T16:41:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient: _add_conns ranks=[2,0,8,4,7,6,1,5,3] 2021-05-26T16:41:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient(hunting): picked mon.noname-b con 0x7fca7812cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient(hunting): picked mon.noname-a con 0x7fca78099a30 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient(hunting): picked mon.noname-e con 0x7fca78099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca78046600 con 0x7fca78099a30 2021-05-26T16:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7809b5e0 con 0x7fca7812cbd0 2021-05-26T16:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7812d8f0 con 0x7fca78099eb0 2021-05-26T16:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:03.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7f0c3700 10 monclient(hunting): authenticate will time out at 820.667678s 2021-05-26T16:41:03.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7e8c2700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fca78099eb0 0x7fca78135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:51868/0 (socket says 172.21.15.3:51868) 2021-05-26T16:41:03.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7d8c0700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fca78099a30 0x7fca78131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50788/0 (socket says 172.21.15.3:50788) 2021-05-26T16:41:03.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7e8c2700 1 -- 172.21.15.3:0/1336618958 learned_addr learned my addr 172.21.15.3:0/1336618958 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:03.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.036+0000 7fca7e0c1700 1 --1- 172.21.15.3:0/1336618958 >> v1:172.21.15.3:6790/0 conn(0x7fca7812cbd0 0x7fca7812d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52830/0 (socket says 172.21.15.3:52830) 2021-05-26T16:41:03.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.038+0000 7fca7e0c1700 1 -- 172.21.15.3:0/1336618958 >> v1:172.21.15.3:6790/0 conn(0x7fca7812cbd0 legacy=0x7fca7812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7e8c2700 1 -- 172.21.15.3:0/1336618958 >> v1:172.21.15.3:6793/0 conn(0x7fca78099eb0 legacy=0x7fca78135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d8c0700 1 -- 172.21.15.3:0/1336618958 >> v1:172.21.15.3:6789/0 conn(0x7fca78099a30 legacy=0x7fca78131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497891936 0 0) 0x7fca78046600 con 0x7fca78099a30 2021-05-26T16:41:03.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): my global_id is 4248 2021-05-26T16:41:03.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca60003270 con 0x7fca78099a30 2021-05-26T16:41:03.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754694786 0 0) 0x7fca7809b5e0 con 0x7fca7812cbd0 2021-05-26T16:41:03.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): my global_id is 4196 2021-05-26T16:41:03.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca78046600 con 0x7fca7812cbd0 2021-05-26T16:41:03.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591203556 0 0) 0x7fca7812d8f0 con 0x7fca78099eb0 2021-05-26T16:41:03.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient(hunting): my global_id is 4175 2021-05-26T16:41:03.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca7809b5e0 con 0x7fca78099eb0 2021-05-26T16:41:03.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662304570 0 0) 0x7fca60003270 con 0x7fca78099a30 2021-05-26T16:41:03.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 >> v1:172.21.15.3:6793/0 conn(0x7fca78099eb0 legacy=0x7fca78135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 >> v1:172.21.15.3:6790/0 conn(0x7fca7812cbd0 legacy=0x7fca7812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: _finish_hunting 0 2021-05-26T16:41:03.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 monclient: found mon.noname-a 2021-05-26T16:41:03.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:03.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:03.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7809c2b0 con 0x7fca78099a30 2021-05-26T16:41:03.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: _finish_auth 0 2021-05-26T16:41:03.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:03.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7f0c3700 5 monclient: authenticate success, global_id 4248 2021-05-26T16:41:03.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca68001a60 con 0x7fca78099a30 2021-05-26T16:41:03.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:03.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: dump: 2021-05-26T16:41:03.067 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.067 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.067 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.068 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.068 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.068 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.068 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.070 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7f0c3700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fca68001d70 con 0x7fca78099a30 2021-05-26T16:41:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 1 -- 172.21.15.3:0/1336618958 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca68004870 con 0x7fca78099a30 2021-05-26T16:41:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7f0c3700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:03.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7f0c3700 4 set_mon_vals no callback set 2021-05-26T16:41:03.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:03.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7d0bf700 10 monclient: dump: 2021-05-26T16:41:03.073 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.073 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.073 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.076 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7f0c3700 10 monclient: shutdown 2021-05-26T16:41:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7f0c3700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.039+0000 7fca7f0c3700 1 -- 172.21.15.3:0/1336618958 >> v1:172.21.15.3:6789/0 conn(0x7fca78099a30 legacy=0x7fca78131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 1 -- 172.21.15.3:0/1336618958 shutdown_connections 2021-05-26T16:41:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 1 -- 172.21.15.3:0/1336618958 >> 172.21.15.3:0/1336618958 conn(0x7fca780a00c0 msgr2=0x7fca780a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 1 -- 172.21.15.3:0/1336618958 shutdown_connections 2021-05-26T16:41:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 1 -- 172.21.15.3:0/1336618958 wait complete. 2021-05-26T16:41:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 10 monclient: build_initial_monmap 2021-05-26T16:41:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 10 monclient: monmap: 2021-05-26T16:41:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:03.082 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 1 Processor -- start 2021-05-26T16:41:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 1 -- start start 2021-05-26T16:41:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.040+0000 7fca7f0c3700 10 monclient: init 2021-05-26T16:41:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 10 monclient: _add_conns ranks=[1,0,2,4,5,3,8,6,7] 2021-05-26T16:41:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 10 monclient(hunting): picked mon.noname-f con 0x7fca78099a30 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 10 monclient(hunting): picked mon.noname-a con 0x7fca78099eb0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 10 monclient(hunting): picked mon.noname-b con 0x7fca7812cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7809b850 con 0x7fca78099eb0 2021-05-26T16:41:03.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7813cc50 con 0x7fca78099a30 2021-05-26T16:41:03.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca78129c30 con 0x7fca7812cbd0 2021-05-26T16:41:03.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:03.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7f0c3700 10 monclient(hunting): authenticate will time out at 820.672407s 2021-05-26T16:41:03.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7d8c0700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fca78099eb0 0x7fca78141050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50792/0 (socket says 172.21.15.3:50792) 2021-05-26T16:41:03.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7e8c2700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fca7812cbd0 0x7fca78144780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52836/0 (socket says 172.21.15.3:52836) 2021-05-26T16:41:03.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.041+0000 7fca7d8c0700 1 -- 172.21.15.3:0/310877516 learned_addr learned my addr 172.21.15.3:0/310877516 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:03.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.043+0000 7fca7e8c2700 1 -- 172.21.15.3:0/310877516 >> v1:172.21.15.3:6790/0 conn(0x7fca7812cbd0 legacy=0x7fca78144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.043+0000 7fca7d8c0700 1 -- 172.21.15.3:0/310877516 >> v1:172.21.15.3:6789/0 conn(0x7fca78099eb0 legacy=0x7fca78141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.043+0000 7fca7e0c1700 1 -- 172.21.15.3:0/310877516 >> v1:172.21.15.137:6789/0 conn(0x7fca78099a30 legacy=0x7fca78129520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825441723 0 0) 0x7fca78129c30 con 0x7fca7812cbd0 2021-05-26T16:41:03.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): my global_id is 4205 2021-05-26T16:41:03.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca58003270 con 0x7fca7812cbd0 2021-05-26T16:41:03.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095151932 0 0) 0x7fca7809b850 con 0x7fca78099eb0 2021-05-26T16:41:03.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): my global_id is 4257 2021-05-26T16:41:03.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca78129c30 con 0x7fca78099eb0 2021-05-26T16:41:03.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403546641 0 0) 0x7fca7813cc50 con 0x7fca78099a30 2021-05-26T16:41:03.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): my global_id is 4186 2021-05-26T16:41:03.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca7809b850 con 0x7fca78099a30 2021-05-26T16:41:03.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2593806783 0 0) 0x7fca58003270 con 0x7fca7812cbd0 2021-05-26T16:41:03.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca7813cc50 con 0x7fca7812cbd0 2021-05-26T16:41:03.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca74002010 con 0x7fca7812cbd0 2021-05-26T16:41:03.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:03.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): dump: 2021-05-26T16:41:03.092 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.092 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.093 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.093 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.093 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.093 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.093 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.094 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.094 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.094 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.094 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.094 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.095 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.095 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.095 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.095 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:03.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4066938271 0 0) 0x7fca78129c30 con 0x7fca78099eb0 2021-05-26T16:41:03.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca58003270 con 0x7fca78099eb0 2021-05-26T16:41:03.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2170985075 0 0) 0x7fca7809b850 con 0x7fca78099a30 2021-05-26T16:41:03.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca78129c30 con 0x7fca78099a30 2021-05-26T16:41:03.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca68004870 con 0x7fca78099eb0 2021-05-26T16:41:03.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:03.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): dump: 2021-05-26T16:41:03.098 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.098 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.098 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.099 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.099 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.099 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.099 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.100 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.100 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.100 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.100 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.100 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.101 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.101 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.101 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.101 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca6c001c50 con 0x7fca78099a30 2021-05-26T16:41:03.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:03.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient(hunting): dump: 2021-05-26T16:41:03.103 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.103 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.103 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.103 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.104 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.104 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.104 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.104 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.105 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.105 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.105 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.105 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.106 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 793844861 0 0) 0x7fca7813cc50 con 0x7fca7812cbd0 2021-05-26T16:41:03.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 >> v1:172.21.15.137:6789/0 conn(0x7fca78099a30 legacy=0x7fca78129520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 >> v1:172.21.15.3:6789/0 conn(0x7fca78099eb0 legacy=0x7fca78141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:03.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 monclient: found mon.b 2021-05-26T16:41:03.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:03.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:03.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78095d70 con 0x7fca7812cbd0 2021-05-26T16:41:03.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7f0c3700 5 monclient: authenticate success, global_id 4205 2021-05-26T16:41:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7f0c3700 10 monclient: _renew_subs 2021-05-26T16:41:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7f0c3700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca78116780 con 0x7fca7812cbd0 2021-05-26T16:41:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7f0c3700 10 monclient: _renew_subs 2021-05-26T16:41:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7f0c3700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fca78116cc0 con 0x7fca7812cbd0 2021-05-26T16:41:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fca74004c60 con 0x7fca7812cbd0 2021-05-26T16:41:03.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:03.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fca74005110 con 0x7fca7812cbd0 2021-05-26T16:41:03.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:03.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca7c8be700 4 set_mon_vals no callback set 2021-05-26T16:41:03.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.044+0000 7fca667fc700 10 monclient: dump: 2021-05-26T16:41:03.113 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.113 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.116 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.116 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.118 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.118 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.118 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.045+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fca74005270 con 0x7fca7812cbd0 2021-05-26T16:41:03.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.045+0000 7fca7f0c3700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:03.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.045+0000 7fca7f0c3700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:03.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.045+0000 7fca7f0c3700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:03.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.045+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(12..12 src has 1..12) v4 ==== 3172+0+0 (unknown 924368914 0 0) 0x7fca7403da10 con 0x7fca7812cbd0 2021-05-26T16:41:03.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.045+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c004db0 con 0x7fca7812cbd0 2021-05-26T16:41:03.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.045+0000 7fca7e0c1700 10 monclient: get_auth_request con 0x7fca58033390 auth_method 0 2021-05-26T16:41:03.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.050+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fca74013800 con 0x7fca7812cbd0 2021-05-26T16:41:03.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.050+0000 7fca667fc700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:03.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.050+0000 7fca667fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:03.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.208+0000 7fca7f0c3700 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2021-05-26T16:41:03.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.208+0000 7fca7f0c3700 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2021-05-26T16:41:03.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.208+0000 7fca7f0c3700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:03.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.208+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fca5c0055e0 con 0x7fca7812cbd0 2021-05-26T16:41:03.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.317+0000 7fca667fc700 1 -- 172.21.15.3:0/310877516 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (unknown 2984082091 0 0) 0x7fca740133f0 con 0x7fca7812cbd0 2021-05-26T16:41:03.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.317+0000 7fca667fc700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2021-05-26T16:41:03.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.317+0000 7fca667fc700 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2021-05-26T16:41:03.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.319+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 >> v1:172.21.15.137:6812/30003 conn(0x7fca58033390 legacy=0x7fca58035850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.319+0000 7fca7f0c3700 10 monclient: shutdown 2021-05-26T16:41:03.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.319+0000 7fca7f0c3700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:03.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.319+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 >> v1:172.21.15.3:6790/0 conn(0x7fca7812cbd0 legacy=0x7fca78144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.320+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 shutdown_connections 2021-05-26T16:41:03.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.320+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 >> 172.21.15.3:0/310877516 conn(0x7fca780a00c0 msgr2=0x7fca7812b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:03.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.320+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 shutdown_connections 2021-05-26T16:41:03.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.320+0000 7fca7f0c3700 1 -- 172.21.15.3:0/310877516 wait complete. 2021-05-26T16:41:03.324 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'rbd' created 2021-05-26T16:41:03.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-05-26T16:41:03.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.451+0000 7f1097da8700 10 monclient: get_monmap_and_config 2021-05-26T16:41:03.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.451+0000 7f1097da8700 10 monclient: build_initial_monmap 2021-05-26T16:41:03.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.451+0000 7f1097da8700 10 monclient: monmap: 2021-05-26T16:41:03.455 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:03.455 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.456 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:03.452511+0000 2021-05-26T16:41:03.456 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:03.452511+0000 2021-05-26T16:41:03.456 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:03.456 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.456 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:03.457 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:03.457 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:03.457 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:03.457 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:03.457 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:03.458 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:03.458 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:03.458 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:03.458 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.452+0000 7f1097da8700 1 Processor -- start 2021-05-26T16:41:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.452+0000 7f1097da8700 1 -- start start 2021-05-26T16:41:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.452+0000 7f1097da8700 10 monclient: init 2021-05-26T16:41:03.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:03.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 10 monclient: _add_conns ranks=[8,1,0,6,5,7,3,4,2] 2021-05-26T16:41:03.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 10 monclient(hunting): picked mon.noname-e con 0x7f109012cc20 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:03.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 10 monclient(hunting): picked mon.noname-f con 0x7f109012d000 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:03.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 10 monclient(hunting): picked mon.noname-a con 0x7f109012d480 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:03.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1090059750 con 0x7f109012d480 2021-05-26T16:41:03.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1090064d10 con 0x7f109012d000 2021-05-26T16:41:03.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109009a1c0 con 0x7f109012cc20 2021-05-26T16:41:03.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:03.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1097da8700 10 monclient(hunting): authenticate will time out at 821.084120s 2021-05-26T16:41:03.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1096345700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f109012d480 0x7f10901356e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50802/0 (socket says 172.21.15.3:50802) 2021-05-26T16:41:03.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1096345700 1 -- 172.21.15.3:0/3842757935 learned_addr learned my addr 172.21.15.3:0/3842757935 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:03.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.453+0000 7f1095b44700 1 --1- 172.21.15.3:0/3842757935 >> v1:172.21.15.3:6793/0 conn(0x7f109012cc20 0x7f1090099ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:51882/0 (socket says 172.21.15.3:51882) 2021-05-26T16:41:03.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1096345700 1 -- 172.21.15.3:0/3842757935 >> v1:172.21.15.3:6789/0 conn(0x7f109012d480 legacy=0x7f10901356e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1095b44700 1 -- 172.21.15.3:0/3842757935 >> v1:172.21.15.3:6793/0 conn(0x7f109012cc20 legacy=0x7f1090099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782594427 0 0) 0x7f1090059750 con 0x7f109012d480 2021-05-26T16:41:03.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): my global_id is 4266 2021-05-26T16:41:03.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1095343700 1 -- 172.21.15.3:0/3842757935 >> v1:172.21.15.137:6789/0 conn(0x7f109012d000 legacy=0x7f1090131fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1078003270 con 0x7f109012d480 2021-05-26T16:41:03.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032568057 0 0) 0x7f109009a1c0 con 0x7f109012cc20 2021-05-26T16:41:03.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): my global_id is 4184 2021-05-26T16:41:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1090059750 con 0x7f109012cc20 2021-05-26T16:41:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663262716 0 0) 0x7f1090064d10 con 0x7f109012d000 2021-05-26T16:41:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient(hunting): my global_id is 4195 2021-05-26T16:41:03.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f109009a1c0 con 0x7f109012d000 2021-05-26T16:41:03.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3205683529 0 0) 0x7f1078003270 con 0x7f109012d480 2021-05-26T16:41:03.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 >> v1:172.21.15.3:6793/0 conn(0x7f109012cc20 legacy=0x7f1090099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 >> v1:172.21.15.137:6789/0 conn(0x7f109012d000 legacy=0x7f1090131fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient: _finish_hunting 0 2021-05-26T16:41:03.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 monclient: found mon.noname-a 2021-05-26T16:41:03.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:03.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:03.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109009c370 con 0x7f109012d480 2021-05-26T16:41:03.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient: _finish_auth 0 2021-05-26T16:41:03.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:03.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f108c001de0 con 0x7f109012d480 2021-05-26T16:41:03.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1097da8700 5 monclient: authenticate success, global_id 4266 2021-05-26T16:41:03.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.455+0000 7f1094b42700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:03.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 10 monclient: dump: 2021-05-26T16:41:03.477 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.478 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.478 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.478 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.478 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.478 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.479 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.479 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.479 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.479 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.479 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.480 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.480 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.480 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.480 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.480 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:03.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f108c0020f0 con 0x7f109012d480 2021-05-26T16:41:03.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 1 -- 172.21.15.3:0/3842757935 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f108c004cb0 con 0x7f109012d480 2021-05-26T16:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 4 set_mon_vals no callback set 2021-05-26T16:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1094b42700 10 monclient: dump: 2021-05-26T16:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.486 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.486 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.486 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.486 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.487 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 10 monclient: shutdown 2021-05-26T16:41:03.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:03.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 1 -- 172.21.15.3:0/3842757935 >> v1:172.21.15.3:6789/0 conn(0x7f109012d480 legacy=0x7f10901356e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 1 -- 172.21.15.3:0/3842757935 shutdown_connections 2021-05-26T16:41:03.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 1 -- 172.21.15.3:0/3842757935 >> 172.21.15.3:0/3842757935 conn(0x7f109009ca40 msgr2=0x7f109009ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:03.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 1 -- 172.21.15.3:0/3842757935 shutdown_connections 2021-05-26T16:41:03.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.456+0000 7f1097da8700 1 -- 172.21.15.3:0/3842757935 wait complete. 2021-05-26T16:41:03.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 10 monclient: build_initial_monmap 2021-05-26T16:41:03.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 10 monclient: monmap: 2021-05-26T16:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 1 Processor -- start 2021-05-26T16:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 1 -- start start 2021-05-26T16:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 10 monclient: init 2021-05-26T16:41:03.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:03.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 10 monclient: _add_conns ranks=[0,5,8,1,7,2,4,6,3] 2021-05-26T16:41:03.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 10 monclient(hunting): picked mon.noname-a con 0x7f109012cc20 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:03.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.457+0000 7f1097da8700 10 monclient(hunting): picked mon.noname-h con 0x7f109012d000 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:03.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1097da8700 10 monclient(hunting): picked mon.noname-e con 0x7f109012d480 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:03.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1097da8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1090119e70 con 0x7f109012cc20 2021-05-26T16:41:03.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1097da8700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109011a110 con 0x7f109012d000 2021-05-26T16:41:03.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1097da8700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109011a3b0 con 0x7f109012d480 2021-05-26T16:41:03.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1097da8700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:03.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1097da8700 10 monclient(hunting): authenticate will time out at 821.089044s 2021-05-26T16:41:03.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1095b44700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f109012cc20 0x7f1090129940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50806/0 (socket says 172.21.15.3:50806) 2021-05-26T16:41:03.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.458+0000 7f1095b44700 1 -- 172.21.15.3:0/1081280348 learned_addr learned my addr 172.21.15.3:0/1081280348 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:03.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f1096345700 1 -- 172.21.15.3:0/1081280348 >> v1:172.21.15.3:6793/0 conn(0x7f109012d480 legacy=0x7f1090144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f1095b44700 1 -- 172.21.15.3:0/1081280348 >> v1:172.21.15.3:6789/0 conn(0x7f109012cc20 legacy=0x7f1090129940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490378810 0 0) 0x7f109011a3b0 con 0x7f109012d480 2021-05-26T16:41:03.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): my global_id is 4193 2021-05-26T16:41:03.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1070003270 con 0x7f109012d480 2021-05-26T16:41:03.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654986836 0 0) 0x7f1090119e70 con 0x7f109012cc20 2021-05-26T16:41:03.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): my global_id is 4275 2021-05-26T16:41:03.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f109011a3b0 con 0x7f109012cc20 2021-05-26T16:41:03.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f1095343700 1 -- 172.21.15.3:0/1081280348 >> v1:172.21.15.137:6791/0 conn(0x7f109012d000 legacy=0x7f10901410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:03.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3171221489 0 0) 0x7f1070003270 con 0x7f109012d480 2021-05-26T16:41:03.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1090119e70 con 0x7f109012d480 2021-05-26T16:41:03.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f108c001e10 con 0x7f109012d480 2021-05-26T16:41:03.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:03.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): dump: 2021-05-26T16:41:03.499 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.500 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.500 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.500 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.500 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.500 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.501 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.501 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.501 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.501 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.501 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.502 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.502 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.502 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.502 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.503 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:03.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3584458575 0 0) 0x7f109011a3b0 con 0x7f109012cc20 2021-05-26T16:41:03.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1070003270 con 0x7f109012cc20 2021-05-26T16:41:03.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1084001d90 con 0x7f109012cc20 2021-05-26T16:41:03.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:03.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): dump: 2021-05-26T16:41:03.504 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.505 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.505 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.505 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.505 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.505 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.506 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.506 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.506 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.506 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.507 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.507 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.507 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.507 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.507 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.508 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693584432 0 0) 0x7f109011a110 con 0x7f109012d000 2021-05-26T16:41:03.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:03.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:03.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient(hunting): my global_id is 4208 2021-05-26T16:41:03.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f109011a3b0 con 0x7f109012d000 2021-05-26T16:41:03.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2634262385 0 0) 0x7f1090119e70 con 0x7f109012d480 2021-05-26T16:41:03.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 >> v1:172.21.15.137:6791/0 conn(0x7f109012d000 legacy=0x7f10901410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 >> v1:172.21.15.3:6789/0 conn(0x7f109012cc20 legacy=0x7f1090129940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:03.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:03.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 monclient: found mon.e 2021-05-26T16:41:03.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:03.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:03.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109013cc20 con 0x7f109012d480 2021-05-26T16:41:03.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:03.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f107dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:03.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f1097da8700 5 monclient: authenticate success, global_id 4193 2021-05-26T16:41:03.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f1097da8700 10 monclient: _renew_subs 2021-05-26T16:41:03.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f1097da8700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:03.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.460+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1090118240 con 0x7f109012d480 2021-05-26T16:41:03.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f108c004fa0 con 0x7f109012d480 2021-05-26T16:41:03.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:03.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f108c005450 con 0x7f109012d480 2021-05-26T16:41:03.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:03.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:03.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 10 monclient: dump: 2021-05-26T16:41:03.513 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:03.513 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:03.513 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.514 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:03.514 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:03.514 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:03.514 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:03.515 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:03.515 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:03.515 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:03.515 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:03.515 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:03.516 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:03.516 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:03.516 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:03.516 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:03.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f1097da8700 10 monclient: _renew_subs 2021-05-26T16:41:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f1097da8700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107ffff700 4 set_mon_vals no callback set 2021-05-26T16:41:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f109012e3b0 con 0x7f109012d480 2021-05-26T16:41:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f108c0055b0 con 0x7f109012d480 2021-05-26T16:41:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.461+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 3538+0+0 (unknown 4264988073 0 0) 0x7f108c03dc40 con 0x7f109012d480 2021-05-26T16:41:03.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.462+0000 7f1097da8700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:03.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.462+0000 7f1097da8700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:03.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.462+0000 7f1097da8700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:03.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.462+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090046ef0 con 0x7f109012d480 2021-05-26T16:41:03.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.462+0000 7f1095b44700 10 monclient: get_auth_request con 0x7f10700330b0 auth_method 0 2021-05-26T16:41:03.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.466+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f108c013990 con 0x7f109012d480 2021-05-26T16:41:03.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.466+0000 7f107dffb700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:03.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.466+0000 7f107dffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:03.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.624+0000 7f1097da8700 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2021-05-26T16:41:03.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.624+0000 7f1097da8700 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2021-05-26T16:41:03.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.624+0000 7f1097da8700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:03.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:03.624+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f109009b940 con 0x7f109012d480 2021-05-26T16:41:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.324+0000 7f107dffb700 1 -- 172.21.15.3:0/1081280348 <== mon.8 v1:172.21.15.3:6793/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (unknown 3289125425 0 0) 0x7f109009b940 con 0x7f109012d480 2021-05-26T16:41:04.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.324+0000 7f107dffb700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2021-05-26T16:41:04.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.324+0000 7f107dffb700 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2021-05-26T16:41:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.327+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 >> v1:172.21.15.137:6812/30003 conn(0x7f10700330b0 legacy=0x7f1070035570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.328+0000 7f1097da8700 10 monclient: shutdown 2021-05-26T16:41:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.328+0000 7f1097da8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.328+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 >> v1:172.21.15.3:6793/0 conn(0x7f109012d480 legacy=0x7f1090144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.328+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 shutdown_connections 2021-05-26T16:41:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.328+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 >> 172.21.15.3:0/1081280348 conn(0x7f109009ca40 msgr2=0x7f109009e220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.328+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 shutdown_connections 2021-05-26T16:41:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.328+0000 7f1097da8700 1 -- 172.21.15.3:0/1081280348 wait complete. 2021-05-26T16:41:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rbd' on pool 'rbd' 2021-05-26T16:41:04.346 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-05-26T16:41:04.347 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-05-26T16:41:04.347 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-05-26T16:41:04.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.465+0000 7f686f444700 10 monclient: get_monmap_and_config 2021-05-26T16:41:04.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.465+0000 7f686f444700 10 monclient: build_initial_monmap 2021-05-26T16:41:04.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.465+0000 7f686f444700 10 monclient: monmap: 2021-05-26T16:41:04.469 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:04.470 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:04.470 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:04.466882+0000 2021-05-26T16:41:04.470 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:04.466882+0000 2021-05-26T16:41:04.471 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:04.471 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:04.471 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:04.471 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:04.472 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:04.472 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:04.472 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:04.472 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:04.472 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:04.473 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:04.473 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:04.473 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:04.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.465+0000 7f686f444700 1 Processor -- start 2021-05-26T16:41:04.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.465+0000 7f686f444700 1 -- start start 2021-05-26T16:41:04.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient: init 2021-05-26T16:41:04.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:04.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient: _add_conns ranks=[8,2,3,5,1,7,4,0,6] 2021-05-26T16:41:04.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient(hunting): picked mon.noname-e con 0x7f6868064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:04.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient(hunting): picked mon.noname-b con 0x7f6868063e30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:04.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient(hunting): picked mon.noname-g con 0x7f68680642e0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:04.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6868059750 con 0x7f6868063e30 2021-05-26T16:41:04.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6868064e00 con 0x7f68680642e0 2021-05-26T16:41:04.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686809c770 con 0x7f6868064a20 2021-05-26T16:41:04.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:04.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686f444700 10 monclient(hunting): authenticate will time out at 822.098485s 2021-05-26T16:41:04.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686d1e0700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f6868064a20 0x7f6868099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:51894/0 (socket says 172.21.15.3:51894) 2021-05-26T16:41:04.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686c9df700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f6868063e30 0x7f6868132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52856/0 (socket says 172.21.15.3:52856) 2021-05-26T16:41:04.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.466+0000 7f686d1e0700 1 -- 172.21.15.3:0/2579448547 learned_addr learned my addr 172.21.15.3:0/2579448547 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:04.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.468+0000 7f686d1e0700 1 -- 172.21.15.3:0/2579448547 >> v1:172.21.15.3:6793/0 conn(0x7f6868064a20 legacy=0x7f6868099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:04.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.468+0000 7f686c9df700 1 -- 172.21.15.3:0/2579448547 >> v1:172.21.15.3:6790/0 conn(0x7f6868063e30 legacy=0x7f6868132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:04.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:04.469+0000 7f686d9e1700 1 -- 172.21.15.3:0/2579448547 >> v1:172.21.15.137:6790/0 conn(0x7f68680642e0 legacy=0x7f68681357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614368898 0 0) 0x7f6868059750 con 0x7f6868063e30 2021-05-26T16:41:05.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): my global_id is 4214 2021-05-26T16:41:05.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6850003270 con 0x7f6868063e30 2021-05-26T16:41:05.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024197371 0 0) 0x7f6868064e00 con 0x7f68680642e0 2021-05-26T16:41:05.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): my global_id is 4206 2021-05-26T16:41:05.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868059750 con 0x7f68680642e0 2021-05-26T16:41:05.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535199487 0 0) 0x7f686809c770 con 0x7f6868064a20 2021-05-26T16:41:05.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient(hunting): my global_id is 4202 2021-05-26T16:41:05.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868064e00 con 0x7f6868064a20 2021-05-26T16:41:05.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 225580283 0 0) 0x7f6850003270 con 0x7f6868063e30 2021-05-26T16:41:05.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 >> v1:172.21.15.3:6793/0 conn(0x7f6868064a20 legacy=0x7f6868099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 >> v1:172.21.15.137:6790/0 conn(0x7f68680642e0 legacy=0x7f68681357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:05.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 monclient: found mon.noname-b 2021-05-26T16:41:05.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:05.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680977a0 con 0x7f6868063e30 2021-05-26T16:41:05.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:05.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:05.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f685c001a60 con 0x7f6868063e30 2021-05-26T16:41:05.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:05.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.169+0000 7f6857fff700 10 monclient: dump: 2021-05-26T16:41:05.183 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.183 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.183 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.184 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.184 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.184 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.184 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.185 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.185 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.185 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.185 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.185 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.186 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.186 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.186 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.186 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f685c001d70 con 0x7f6868063e30 2021-05-26T16:41:05.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f6857fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:05.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f6857fff700 1 -- 172.21.15.3:0/2579448547 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f685c004870 con 0x7f6868063e30 2021-05-26T16:41:05.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 5 monclient: authenticate success, global_id 4214 2021-05-26T16:41:05.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:05.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 4 set_mon_vals no callback set 2021-05-26T16:41:05.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f6857fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f6857fff700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:05.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f6857fff700 10 monclient: dump: 2021-05-26T16:41:05.189 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.189 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.189 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.189 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.189 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.190 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.190 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.190 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.190 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.191 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.191 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.191 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.191 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.191 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.192 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.192 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.192 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 10 monclient: shutdown 2021-05-26T16:41:05.192 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:05.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 1 -- 172.21.15.3:0/2579448547 >> v1:172.21.15.3:6790/0 conn(0x7f6868063e30 legacy=0x7f6868132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 1 -- 172.21.15.3:0/2579448547 shutdown_connections 2021-05-26T16:41:05.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.170+0000 7f686f444700 1 -- 172.21.15.3:0/2579448547 >> 172.21.15.3:0/2579448547 conn(0x7f68680a0db0 msgr2=0x7f686809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:05.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.171+0000 7f686f444700 1 -- 172.21.15.3:0/2579448547 shutdown_connections 2021-05-26T16:41:05.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.171+0000 7f686f444700 1 -- 172.21.15.3:0/2579448547 wait complete. 2021-05-26T16:41:05.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.171+0000 7f686f444700 10 monclient: build_initial_monmap 2021-05-26T16:41:05.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.171+0000 7f686f444700 10 monclient: monmap: 2021-05-26T16:41:05.194 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:05.194 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:05.194 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:05.195 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:05.195 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:05.195 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.195 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:05.195 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:05.196 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:05.196 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:05.196 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:05.196 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:05.196 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:05.197 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 1 Processor -- start 2021-05-26T16:41:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 1 -- start start 2021-05-26T16:41:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient: init 2021-05-26T16:41:05.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:05.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient: _add_conns ranks=[1,0,2,6,5,7,8,3,4] 2021-05-26T16:41:05.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient(hunting): picked mon.noname-f con 0x7f6868063e30 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:05.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient(hunting): picked mon.noname-a con 0x7f68680642e0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:05.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient(hunting): picked mon.noname-b con 0x7f6868064a20 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:05.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686812ea90 con 0x7f68680642e0 2021-05-26T16:41:05.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686812e480 con 0x7f6868063e30 2021-05-26T16:41:05.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6868116cf0 con 0x7f6868064a20 2021-05-26T16:41:05.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:05.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686f444700 10 monclient(hunting): authenticate will time out at 822.804834s 2021-05-26T16:41:05.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686d9e1700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f6868064a20 0x7f6868144100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52884/0 (socket says 172.21.15.3:52884) 2021-05-26T16:41:05.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.172+0000 7f686d9e1700 1 -- 172.21.15.3:0/2474347955 learned_addr learned my addr 172.21.15.3:0/2474347955 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:05.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f686d9e1700 1 -- 172.21.15.3:0/2474347955 >> v1:172.21.15.3:6790/0 conn(0x7f6868064a20 legacy=0x7f6868144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f686c9df700 1 -- 172.21.15.3:0/2474347955 >> v1:172.21.15.3:6789/0 conn(0x7f68680642e0 legacy=0x7f686812dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f686d1e0700 1 -- 172.21.15.3:0/2474347955 >> v1:172.21.15.137:6789/0 conn(0x7f6868063e30 legacy=0x7f686812d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088250187 0 0) 0x7f6868116cf0 con 0x7f6868064a20 2021-05-26T16:41:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): my global_id is 4223 2021-05-26T16:41:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6848003270 con 0x7f6868064a20 2021-05-26T16:41:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916248629 0 0) 0x7f68680977a0 con 0x7f68680642e0 2021-05-26T16:41:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): my global_id is 4284 2021-05-26T16:41:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868116cf0 con 0x7f68680642e0 2021-05-26T16:41:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480770334 0 0) 0x7f686812e480 con 0x7f6868063e30 2021-05-26T16:41:05.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): my global_id is 4204 2021-05-26T16:41:05.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68680977a0 con 0x7f6868063e30 2021-05-26T16:41:05.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3214648990 0 0) 0x7f6848003270 con 0x7f6868064a20 2021-05-26T16:41:05.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f686812e480 con 0x7f6868064a20 2021-05-26T16:41:05.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f68640025c0 con 0x7f6868064a20 2021-05-26T16:41:05.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:05.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): dump: 2021-05-26T16:41:05.211 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.211 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.211 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.211 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.212 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.212 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.212 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.212 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.212 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.213 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.213 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.213 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.213 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.213 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.214 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.214 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:05.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2145209285 0 0) 0x7f6868116cf0 con 0x7f68680642e0 2021-05-26T16:41:05.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6848003270 con 0x7f68680642e0 2021-05-26T16:41:05.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1216952531 0 0) 0x7f68680977a0 con 0x7f6868063e30 2021-05-26T16:41:05.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.175+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6868116cf0 con 0x7f6868063e30 2021-05-26T16:41:05.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f685c004870 con 0x7f68680642e0 2021-05-26T16:41:05.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:05.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient(hunting): dump: 2021-05-26T16:41:05.216 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.216 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.216 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.217 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.217 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.217 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.217 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.217 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.218 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.218 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.218 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.218 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.218 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.219 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.219 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.219 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6858001cb0 con 0x7f6868063e30 2021-05-26T16:41:05.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:05.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient(hunting): dump: 2021-05-26T16:41:05.220 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.220 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.221 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.221 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.221 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.221 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.221 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.222 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.222 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.222 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.222 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.222 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.223 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.223 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.223 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.223 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.223 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2226242100 0 0) 0x7f686812e480 con 0x7f6868064a20 2021-05-26T16:41:05.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 >> v1:172.21.15.137:6789/0 conn(0x7f6868063e30 legacy=0x7f686812d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 >> v1:172.21.15.3:6789/0 conn(0x7f68680642e0 legacy=0x7f686812dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:05.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 monclient: found mon.b 2021-05-26T16:41:05.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:05.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868116f90 con 0x7f6868064a20 2021-05-26T16:41:05.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:05.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:05.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f686f444700 5 monclient: authenticate success, global_id 4223 2021-05-26T16:41:05.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f686f444700 10 monclient: _renew_subs 2021-05-26T16:41:05.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f686f444700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686812f230 con 0x7f6868064a20 2021-05-26T16:41:05.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f686f444700 10 monclient: _renew_subs 2021-05-26T16:41:05.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f686f444700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6868130090 con 0x7f6868064a20 2021-05-26T16:41:05.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6864002820 con 0x7f6868064a20 2021-05-26T16:41:05.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:05.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6864002cd0 con 0x7f6868064a20 2021-05-26T16:41:05.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68577fe700 4 set_mon_vals no callback set 2021-05-26T16:41:05.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:05.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.176+0000 7f68557fa700 10 monclient: dump: 2021-05-26T16:41:05.228 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.229 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.229 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.229 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.229 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.230 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.230 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.230 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.230 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.230 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.231 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.231 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.231 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.231 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.231 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.232 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.177+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f6864002e70 con 0x7f6868064a20 2021-05-26T16:41:05.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.177+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3549+0+0 (unknown 956845911 0 0) 0x7f686403dd00 con 0x7f6868064a20 2021-05-26T16:41:05.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.177+0000 7f686f444700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.177+0000 7f686f444700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.177+0000 7f686f444700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.177+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6840004db0 con 0x7f6868064a20 2021-05-26T16:41:05.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.177+0000 7f686d1e0700 10 monclient: get_auth_request con 0x7f6848033570 auth_method 0 2021-05-26T16:41:05.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.182+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f6864013980 con 0x7f6868064a20 2021-05-26T16:41:05.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.182+0000 7f68557fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.182+0000 7f68557fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:05.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.349+0000 7f686f444700 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:05.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.349+0000 7f686f444700 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:05.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.349+0000 7f686f444700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.349+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6840005060 con 0x7f6868064a20 2021-05-26T16:41:05.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.349+0000 7f68557fa700 1 -- 172.21.15.3:0/2474347955 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9976 (unknown 4221056075 0 4226676142) 0x7f6864013570 con 0x7f6868064a20 2021-05-26T16:41:05.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.349+0000 7f68557fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:05.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.349+0000 7f68557fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:05.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:05.357 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","created":"2021-05-26T16:40:51.540326+0000","modified":"2021-05-26T16:41:05.316620+0000","last_up_change":"2021-05-26T16:41:01.304218+0000","last_in_change":"2021-05-26T16:40:55.160191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-05-26T16:41:01.359450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-05-26T16:41:03.248067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15008bbc-879f-43a6-bfbc-f16853c84582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6800","nonce":30458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6801","nonce":30458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6803","nonce":30458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6802","nonce":30458}]},"public_addr":"172.21.15.3:6800/30458","cluster_addr":"172.21.15.3:6801/30458","heartbeat_back_addr":"172.21.15.3:6803/30458","heartbeat_front_addr":"172.21.15.3:6802/30458","state":["exists","up"]},{"osd":1,"uuid":"13c28fda-7809-4964-9b17-4c6fb9fff0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6804","nonce":30459}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6805","nonce":30459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6808","nonce":30459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6806","nonce":30459}]},"public_addr":"172.21.15.3:6804/30459","cluster_addr":"172.21.15.3:6805/30459","heartbeat_back_addr":"172.21.15.3:6808/30459","heartbeat_front_addr":"172.21.15.3:6806/30459","state":["exists","up"]},{"osd":2,"uuid":"ca01de00-a5fb-4b03-9412-bca079506190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6807","nonce":30460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6809","nonce":30460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6811","nonce":30460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6810","nonce":30460}]},"public_addr":"172.21.15.3:6807/30460","cluster_addr":"172.21.15.3:6809/30460","heartbeat_back_addr":"172.21.15.3:6811/30460","heartbeat_front_addr":"172.21.15.3:6810/30460","state":["exists","up"]},{"osd":3,"uuid":"ecf54fc5-53a9-4585-a369-03a5d382cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6800","nonce":30479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6801","nonce":30479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6803","nonce":30479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6802","nonce":30479}]},"public_addr":"172.21.15.137:6800/30479","cluster_addr":"172.21.15.137:6801/30479","heartbeat_back_addr":"172.21.15.137:6803/30479","heartbeat_front_addr":"172.21.15.137:6802/30479","state":["exists","up"]},{"osd":4,"uuid":"c2926c74-967a-4c6d-acb7-4a0d32f89e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6804","nonce":30480}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6806","nonce":30480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6811","nonce":30480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6808","nonce":30480}]},"public_addr":"172.21.15.137:6804/30480","cluster_addr":"172.21.15.137:6806/30480","heartbeat_back_addr":"172.21.15.137:6811/30480","heartbeat_front_addr":"172.21.15.137:6808/30480","state":["exists","up"]},{"osd":5,"uuid":"acee8981-3ab2-4bad-b287-217a027a7b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6805","nonce":30481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6807","nonce":30481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6810","nonce":30481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6809","nonce":30481}]},"public_addr":"172.21.15.137:6805/30481","cluster_addr":"172.21.15.137:6807/30481","heartbeat_back_addr":"172.21.15.137:6810/30481","heartbeat_front_addr":"172.21.15.137:6809/30481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.244103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.235066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.269488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.281565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.243717+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.240437+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-05-26T16:41:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 >> v1:172.21.15.137:6812/30003 conn(0x7f6848033570 legacy=0x7f6848035a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 10 monclient: shutdown 2021-05-26T16:41:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:05.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 >> v1:172.21.15.3:6790/0 conn(0x7f6868064a20 legacy=0x7f6868144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 shutdown_connections 2021-05-26T16:41:05.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 >> 172.21.15.3:0/2474347955 conn(0x7f68680a0db0 msgr2=0x7f686809ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:05.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 shutdown_connections 2021-05-26T16:41:05.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.351+0000 7f686f444700 1 -- 172.21.15.3:0/2474347955 wait complete. 2021-05-26T16:41:05.366 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-05-26T16:41:01.359450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-05-26T16:41:03.248067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-05-26T16:41:05.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-05-26T16:41:05.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.483+0000 7fe600e89700 10 monclient: get_monmap_and_config 2021-05-26T16:41:05.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.483+0000 7fe600e89700 10 monclient: build_initial_monmap 2021-05-26T16:41:05.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.483+0000 7fe600e89700 10 monclient: monmap: 2021-05-26T16:41:05.489 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:05.489 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.490 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:05.485043+0000 2021-05-26T16:41:05.490 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:05.485043+0000 2021-05-26T16:41:05.490 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:05.491 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.491 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:05.491 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:05.491 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:05.492 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:05.492 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:05.492 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:05.492 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:05.492 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:05.493 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:05.493 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 1 Processor -- start 2021-05-26T16:41:05.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 1 -- start start 2021-05-26T16:41:05.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient: init 2021-05-26T16:41:05.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:05.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient: _add_conns ranks=[5,4,7,6,2,8,3,1,0] 2021-05-26T16:41:05.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient(hunting): picked mon.noname-h con 0x7fe5fc12cbd0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:05.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient(hunting): picked mon.noname-c con 0x7fe5fc099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:05.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient(hunting): picked mon.noname-i con 0x7fe5fc099eb0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:05.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc046600 con 0x7fe5fc099a30 2021-05-26T16:41:05.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc09b5e0 con 0x7fe5fc12cbd0 2021-05-26T16:41:05.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc12d8f0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:05.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe600e89700 10 monclient(hunting): authenticate will time out at 823.116662s 2021-05-26T16:41:05.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe5faffd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fe5fc099a30 0x7fe5fc131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36358/0 (socket says 172.21.15.3:36358) 2021-05-26T16:41:05.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.484+0000 7fe5faffd700 1 -- 172.21.15.3:0/3434639649 learned_addr learned my addr 172.21.15.3:0/3434639649 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:05.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.486+0000 7fe5faffd700 1 -- 172.21.15.3:0/3434639649 >> v1:172.21.15.3:6791/0 conn(0x7fe5fc099a30 legacy=0x7fe5fc131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058658917 0 0) 0x7fe5fc046600 con 0x7fe5fc099a30 2021-05-26T16:41:05.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient(hunting): my global_id is 4207 2021-05-26T16:41:05.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e0003270 con 0x7fe5fc099a30 2021-05-26T16:41:05.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fbfff700 1 -- 172.21.15.3:0/3434639649 >> v1:172.21.15.137:6792/0 conn(0x7fe5fc099eb0 legacy=0x7fe5fc135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fb7fe700 1 -- 172.21.15.3:0/3434639649 >> v1:172.21.15.137:6791/0 conn(0x7fe5fc12cbd0 legacy=0x7fe5fc12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1643553033 0 0) 0x7fe5e0003270 con 0x7fe5fc099a30 2021-05-26T16:41:05.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 >> v1:172.21.15.137:6792/0 conn(0x7fe5fc099eb0 legacy=0x7fe5fc135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 >> v1:172.21.15.137:6791/0 conn(0x7fe5fc12cbd0 legacy=0x7fe5fc12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:05.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 monclient: found mon.noname-c 2021-05-26T16:41:05.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:05.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:05.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc09c2b0 con 0x7fe5fc099a30 2021-05-26T16:41:05.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:05.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:05.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe600e89700 5 monclient: authenticate success, global_id 4207 2021-05-26T16:41:05.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe5ec001a60 con 0x7fe5fc099a30 2021-05-26T16:41:05.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:05.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: dump: 2021-05-26T16:41:05.514 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.514 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.515 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.515 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.515 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.515 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.515 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.516 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.516 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.516 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.516 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.517 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.517 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.517 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.517 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.517 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe600e89700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:05.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe5ec001d70 con 0x7fe5fc099a30 2021-05-26T16:41:05.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:05.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 1 -- 172.21.15.3:0/3434639649 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe5ec004930 con 0x7fe5fc099a30 2021-05-26T16:41:05.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe600e89700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:05.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe600e89700 4 set_mon_vals no callback set 2021-05-26T16:41:05.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:05.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe5fa7fc700 10 monclient: dump: 2021-05-26T16:41:05.520 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.520 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.520 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.521 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.521 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.521 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.521 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.521 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.522 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.522 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.522 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.522 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.523 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.523 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.523 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.523 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe600e89700 10 monclient: shutdown 2021-05-26T16:41:05.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe600e89700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:05.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.487+0000 7fe600e89700 1 -- 172.21.15.3:0/3434639649 >> v1:172.21.15.3:6791/0 conn(0x7fe5fc099a30 legacy=0x7fe5fc131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.488+0000 7fe600e89700 1 -- 172.21.15.3:0/3434639649 shutdown_connections 2021-05-26T16:41:05.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.488+0000 7fe600e89700 1 -- 172.21.15.3:0/3434639649 >> 172.21.15.3:0/3434639649 conn(0x7fe5fc0a00c0 msgr2=0x7fe5fc0a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:05.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.488+0000 7fe600e89700 1 -- 172.21.15.3:0/3434639649 shutdown_connections 2021-05-26T16:41:05.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.488+0000 7fe600e89700 1 -- 172.21.15.3:0/3434639649 wait complete. 2021-05-26T16:41:05.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.488+0000 7fe600e89700 10 monclient: build_initial_monmap 2021-05-26T16:41:05.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.488+0000 7fe600e89700 10 monclient: monmap: 2021-05-26T16:41:05.526 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:05.526 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:05.526 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:05.526 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:05.527 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:05.527 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.527 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:05.527 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:05.528 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:05.528 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:05.528 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:05.528 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:05.528 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:05.529 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:05.529 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:05.529 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 1 Processor -- start 2021-05-26T16:41:05.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 1 -- start start 2021-05-26T16:41:05.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient: init 2021-05-26T16:41:05.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:05.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient: _add_conns ranks=[2,6,1,4,8,0,7,5,3] 2021-05-26T16:41:05.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient(hunting): picked mon.noname-b con 0x7fe5fc099a30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:05.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient(hunting): picked mon.noname-d con 0x7fe5fc099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:05.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient(hunting): picked mon.noname-f con 0x7fe5fc12cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:05.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc09b850 con 0x7fe5fc12cbd0 2021-05-26T16:41:05.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc119e40 con 0x7fe5fc099a30 2021-05-26T16:41:05.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc11a0c0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:05.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe600e89700 10 monclient(hunting): authenticate will time out at 823.121633s 2021-05-26T16:41:05.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe5fb7fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fe5fc099a30 0x7fe5fc129650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52894/0 (socket says 172.21.15.3:52894) 2021-05-26T16:41:05.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.489+0000 7fe5fb7fe700 1 -- 172.21.15.3:0/2732460344 learned_addr learned my addr 172.21.15.3:0/2732460344 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:05.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.491+0000 7fe5fb7fe700 1 -- 172.21.15.3:0/2732460344 >> v1:172.21.15.3:6790/0 conn(0x7fe5fc099a30 legacy=0x7fe5fc129650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.491+0000 7fe5faffd700 1 -- 172.21.15.3:0/2732460344 >> v1:172.21.15.3:6792/0 conn(0x7fe5fc099eb0 legacy=0x7fe5fc140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.491+0000 7fe5fbfff700 1 -- 172.21.15.3:0/2732460344 >> v1:172.21.15.137:6789/0 conn(0x7fe5fc12cbd0 legacy=0x7fe5fc144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234469694 0 0) 0x7fe5fc11a0c0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): my global_id is 4191 2021-05-26T16:41:05.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5dc003270 con 0x7fe5fc099eb0 2021-05-26T16:41:05.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230291431 0 0) 0x7fe5fc119e40 con 0x7fe5fc099a30 2021-05-26T16:41:05.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): my global_id is 4232 2021-05-26T16:41:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc11a0c0 con 0x7fe5fc099a30 2021-05-26T16:41:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592657140 0 0) 0x7fe5fc09b850 con 0x7fe5fc12cbd0 2021-05-26T16:41:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): my global_id is 4213 2021-05-26T16:41:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc119e40 con 0x7fe5fc12cbd0 2021-05-26T16:41:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2324000005 0 0) 0x7fe5dc003270 con 0x7fe5fc099eb0 2021-05-26T16:41:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5fc09b850 con 0x7fe5fc099eb0 2021-05-26T16:41:05.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe5ec004870 con 0x7fe5fc099eb0 2021-05-26T16:41:05.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:05.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): dump: 2021-05-26T16:41:05.540 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.540 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.540 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.540 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.540 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.541 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.541 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.541 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.541 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.542 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.542 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.542 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.542 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.543 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.543 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.543 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:05.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3249859621 0 0) 0x7fe5fc11a0c0 con 0x7fe5fc099a30 2021-05-26T16:41:05.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5dc003270 con 0x7fe5fc099a30 2021-05-26T16:41:05.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2905995857 0 0) 0x7fe5fc119e40 con 0x7fe5fc12cbd0 2021-05-26T16:41:05.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5fc11a0c0 con 0x7fe5fc12cbd0 2021-05-26T16:41:05.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe5e8001d40 con 0x7fe5fc099a30 2021-05-26T16:41:05.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:05.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): dump: 2021-05-26T16:41:05.545 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.546 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.546 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.546 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.546 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.546 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.548 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.548 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.548 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.548 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.549 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe5f0002060 con 0x7fe5fc12cbd0 2021-05-26T16:41:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient(hunting): dump: 2021-05-26T16:41:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.553 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.553 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.553 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.553 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.553 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 735998113 0 0) 0x7fe5fc09b850 con 0x7fe5fc099eb0 2021-05-26T16:41:05.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 >> v1:172.21.15.3:6790/0 conn(0x7fe5fc099a30 legacy=0x7fe5fc129650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 >> v1:172.21.15.137:6789/0 conn(0x7fe5fc12cbd0 legacy=0x7fe5fc144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 monclient: found mon.d 2021-05-26T16:41:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc118a50 con 0x7fe5fc099eb0 2021-05-26T16:41:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe600e89700 5 monclient: authenticate success, global_id 4191 2021-05-26T16:41:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe600e89700 10 monclient: _renew_subs 2021-05-26T16:41:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe600e89700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc1175d0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe600e89700 10 monclient: _renew_subs 2021-05-26T16:41:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe600e89700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc12dfb0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe5ec001a50 con 0x7fe5fc099eb0 2021-05-26T16:41:05.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:05.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe5ec005260 con 0x7fe5fc099eb0 2021-05-26T16:41:05.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5f9ffb700 4 set_mon_vals no callback set 2021-05-26T16:41:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.492+0000 7fe5e77fe700 10 monclient: dump: 2021-05-26T16:41:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.561 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.561 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.561 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.561 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.561 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.563 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.493+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fe5ec00e7d0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.493+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fe5ec03d9b0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.493+0000 7fe600e89700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.493+0000 7fe600e89700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.493+0000 7fe600e89700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.493+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d4004db0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.493+0000 7fe5fb7fe700 10 monclient: get_auth_request con 0x7fe5dc0335c0 auth_method 0 2021-05-26T16:41:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.497+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fe5ec0136e0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.497+0000 7fe5e77fe700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.497+0000 7fe5e77fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.657+0000 7fe600e89700 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}] 2021-05-26T16:41:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.657+0000 7fe600e89700 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}] 2021-05-26T16:41:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.657+0000 7fe600e89700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.657+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe5d40055e0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.657+0000 7fe5e77fe700 1 -- 172.21.15.3:0/2732460344 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v15) v1 ==== 110+0+10 (unknown 1134451309 0 2170607528) 0x7fe5ec0132d0 con 0x7fe5fc099eb0 2021-05-26T16:41:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.657+0000 7fe5e77fe700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}] 2021-05-26T16:41:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.657+0000 7fe5e77fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:05.663 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2021-05-26T16:41:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 >> v1:172.21.15.137:6812/30003 conn(0x7fe5dc0335c0 legacy=0x7fe5dc035a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 10 monclient: shutdown 2021-05-26T16:41:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 >> v1:172.21.15.3:6792/0 conn(0x7fe5fc099eb0 legacy=0x7fe5fc140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 shutdown_connections 2021-05-26T16:41:05.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 >> 172.21.15.3:0/2732460344 conn(0x7fe5fc0a00c0 msgr2=0x7fe5fc12ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:05.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 shutdown_connections 2021-05-26T16:41:05.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.659+0000 7fe600e89700 1 -- 172.21.15.3:0/2732460344 wait complete. 2021-05-26T16:41:05.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-05-26T16:41:05.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.788+0000 7f7105d0b700 10 monclient: get_monmap_and_config 2021-05-26T16:41:05.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.788+0000 7f7105d0b700 10 monclient: build_initial_monmap 2021-05-26T16:41:05.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.788+0000 7f7105d0b700 10 monclient: monmap: 2021-05-26T16:41:05.792 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:05.793 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.793 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:05.789904+0000 2021-05-26T16:41:05.793 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:05.789904+0000 2021-05-26T16:41:05.793 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:05.794 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.794 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:05.794 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:05.794 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:05.795 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:05.795 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:05.795 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:05.795 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:05.795 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:05.796 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:05.796 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.788+0000 7f7105d0b700 1 Processor -- start 2021-05-26T16:41:05.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 1 -- start start 2021-05-26T16:41:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient: init 2021-05-26T16:41:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient: _add_conns ranks=[3,2,8,5,1,0,6,7,4] 2021-05-26T16:41:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient(hunting): picked mon.noname-g con 0x7f710012cbd0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient(hunting): picked mon.noname-b con 0x7f7100099a30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient(hunting): picked mon.noname-e con 0x7f7100099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7100046600 con 0x7f7100099a30 2021-05-26T16:41:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710009b5e0 con 0x7f710012cbd0 2021-05-26T16:41:05.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710012d8f0 con 0x7f7100099eb0 2021-05-26T16:41:05.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:05.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f7105d0b700 10 monclient(hunting): authenticate will time out at 823.421546s 2021-05-26T16:41:05.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f710550a700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f7100099eb0 0x7f7100135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:51944/0 (socket says 172.21.15.3:51944) 2021-05-26T16:41:05.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f70f7fff700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f7100099a30 0x7f7100131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52902/0 (socket says 172.21.15.3:52902) 2021-05-26T16:41:05.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.789+0000 7f710550a700 1 -- 172.21.15.3:0/1026675533 learned_addr learned my addr 172.21.15.3:0/1026675533 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:05.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.791+0000 7f70f7fff700 1 -- 172.21.15.3:0/1026675533 >> v1:172.21.15.3:6790/0 conn(0x7f7100099a30 legacy=0x7f7100131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.791+0000 7f710550a700 1 -- 172.21.15.3:0/1026675533 >> v1:172.21.15.3:6793/0 conn(0x7f7100099eb0 legacy=0x7f7100135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836123244 0 0) 0x7f710012d8f0 con 0x7f7100099eb0 2021-05-26T16:41:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient(hunting): my global_id is 4211 2021-05-26T16:41:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec003270 con 0x7f7100099eb0 2021-05-26T16:41:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554233770 0 0) 0x7f7100046600 con 0x7f7100099a30 2021-05-26T16:41:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient(hunting): my global_id is 4241 2021-05-26T16:41:05.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f710012d8f0 con 0x7f7100099a30 2021-05-26T16:41:05.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7104d09700 1 -- 172.21.15.3:0/1026675533 >> v1:172.21.15.137:6790/0 conn(0x7f710012cbd0 legacy=0x7f710012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1845521853 0 0) 0x7f710012d8f0 con 0x7f7100099a30 2021-05-26T16:41:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 >> v1:172.21.15.3:6793/0 conn(0x7f7100099eb0 legacy=0x7f7100135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 >> v1:172.21.15.137:6790/0 conn(0x7f710012cbd0 legacy=0x7f710012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 monclient: found mon.noname-b 2021-05-26T16:41:05.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:05.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710009c2b0 con 0x7f7100099a30 2021-05-26T16:41:05.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 5 monclient: authenticate success, global_id 4241 2021-05-26T16:41:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f70e8001a60 con 0x7f7100099a30 2021-05-26T16:41:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: dump: 2021-05-26T16:41:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.818 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.818 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.818 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.818 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.820 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.820 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.820 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.820 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.820 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.821 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:05.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f7fff700 1 --1- 172.21.15.3:0/1026675533 >> v1:172.21.15.3:6790/0 conn(0x7f7100099a30 0x7f7100131f20 :-1 s=OPENED pgs=56 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7f70e8004870 mon_map magic: 0 v1 2021-05-26T16:41:05.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f70e8001d70 con 0x7f7100099a30 2021-05-26T16:41:05.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:05.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:05.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 4 set_mon_vals no callback set 2021-05-26T16:41:05.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 10 monclient: shutdown 2021-05-26T16:41:05.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:05.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 1 -- 172.21.15.3:0/1026675533 >> v1:172.21.15.3:6790/0 conn(0x7f7100099a30 legacy=0x7f7100131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 1 -- 172.21.15.3:0/1026675533 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f70e8004870 con 0x7f7100099a30 2021-05-26T16:41:05.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f70f77fe700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:41:05.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 1 -- 172.21.15.3:0/1026675533 shutdown_connections 2021-05-26T16:41:05.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.792+0000 7f7105d0b700 1 -- 172.21.15.3:0/1026675533 >> 172.21.15.3:0/1026675533 conn(0x7f71000a00c0 msgr2=0x7f71000a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:05.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.793+0000 7f7105d0b700 1 -- 172.21.15.3:0/1026675533 shutdown_connections 2021-05-26T16:41:05.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.793+0000 7f7105d0b700 1 -- 172.21.15.3:0/1026675533 wait complete. 2021-05-26T16:41:05.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.793+0000 7f7105d0b700 10 monclient: build_initial_monmap 2021-05-26T16:41:05.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.793+0000 7f7105d0b700 10 monclient: monmap: 2021-05-26T16:41:05.825 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:05.825 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:05.825 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:05.826 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:05.826 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:05.826 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.826 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:05.827 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:05.827 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:05.827 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:05.827 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:05.828 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:05.828 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:05.828 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:05.828 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:05.829 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.793+0000 7f7105d0b700 1 Processor -- start 2021-05-26T16:41:05.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 1 -- start start 2021-05-26T16:41:05.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient: init 2021-05-26T16:41:05.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:05.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient: _add_conns ranks=[5,6,2,0,8,7,1,3,4] 2021-05-26T16:41:05.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient(hunting): picked mon.noname-h con 0x7f7100099a30 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:05.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient(hunting): picked mon.noname-d con 0x7f7100099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:05.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient(hunting): picked mon.noname-b con 0x7f710012cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:05.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7100116ee0 con 0x7f710012cbd0 2021-05-26T16:41:05.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710009bd30 con 0x7f7100099a30 2021-05-26T16:41:05.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710009b850 con 0x7f7100099eb0 2021-05-26T16:41:05.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:05.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f7105d0b700 10 monclient(hunting): authenticate will time out at 823.426449s 2021-05-26T16:41:05.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f70f7fff700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f7100099eb0 0x7f71001410c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56268/0 (socket says 172.21.15.3:56268) 2021-05-26T16:41:05.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f710550a700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f710012cbd0 0x7f71001447f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52912/0 (socket says 172.21.15.3:52912) 2021-05-26T16:41:05.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.794+0000 7f70f7fff700 1 -- 172.21.15.3:0/3240772498 learned_addr learned my addr 172.21.15.3:0/3240772498 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:05.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f7fff700 1 -- 172.21.15.3:0/3240772498 >> v1:172.21.15.3:6792/0 conn(0x7f7100099eb0 legacy=0x7f71001410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f710550a700 1 -- 172.21.15.3:0/3240772498 >> v1:172.21.15.3:6790/0 conn(0x7f710012cbd0 legacy=0x7f71001447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f7104d09700 1 -- 172.21.15.3:0/3240772498 >> v1:172.21.15.137:6791/0 conn(0x7f7100099a30 legacy=0x7f7100129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:05.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009084350 0 0) 0x7f7100116ee0 con 0x7f710012cbd0 2021-05-26T16:41:05.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 10 monclient(hunting): my global_id is 4250 2021-05-26T16:41:05.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0003270 con 0x7f710012cbd0 2021-05-26T16:41:05.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889361580 0 0) 0x7f710009b850 con 0x7f7100099eb0 2021-05-26T16:41:05.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 10 monclient(hunting): my global_id is 4200 2021-05-26T16:41:05.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.796+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7100116ee0 con 0x7f7100099eb0 2021-05-26T16:41:05.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429875831 0 0) 0x7f710009bd30 con 0x7f7100099a30 2021-05-26T16:41:05.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:05.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:05.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): my global_id is 4226 2021-05-26T16:41:05.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f710009b850 con 0x7f7100099a30 2021-05-26T16:41:05.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 21750955 0 0) 0x7f70e0003270 con 0x7f710012cbd0 2021-05-26T16:41:05.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f710009bd30 con 0x7f710012cbd0 2021-05-26T16:41:05.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f70fc0016a0 con 0x7f710012cbd0 2021-05-26T16:41:05.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:05.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:05.838 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.839 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.839 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.839 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.839 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.839 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.840 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.840 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.840 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.841 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.841 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.841 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.841 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.841 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.842 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.842 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:05.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1934711855 0 0) 0x7f7100116ee0 con 0x7f7100099eb0 2021-05-26T16:41:05.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f70e0003270 con 0x7f7100099eb0 2021-05-26T16:41:05.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f70e8001a60 con 0x7f7100099eb0 2021-05-26T16:41:05.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:05.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:05.844 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.844 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.844 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.844 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.844 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.845 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.845 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.845 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.845 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.847 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3184403317 0 0) 0x7f710009b850 con 0x7f7100099a30 2021-05-26T16:41:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7100116ee0 con 0x7f7100099a30 2021-05-26T16:41:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f70f0001ba0 con 0x7f7100099a30 2021-05-26T16:41:05.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:05.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:05.848 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.848 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.849 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.849 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.849 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.849 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.849 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.850 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.850 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.850 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.850 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.850 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.851 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.851 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.851 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.851 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1784362510 0 0) 0x7f710009bd30 con 0x7f710012cbd0 2021-05-26T16:41:05.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 >> v1:172.21.15.3:6792/0 conn(0x7f7100099eb0 legacy=0x7f71001410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 >> v1:172.21.15.137:6791/0 conn(0x7f7100099a30 legacy=0x7f7100129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:41:05.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 monclient: found mon.b 2021-05-26T16:41:05.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:05.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000953d0 con 0x7f710012cbd0 2021-05-26T16:41:05.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient: _finish_auth 0 2021-05-26T16:41:05.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:05.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f7105d0b700 5 monclient: authenticate success, global_id 4250 2021-05-26T16:41:05.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f7105d0b700 10 monclient: _renew_subs 2021-05-26T16:41:05.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f7105d0b700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710013cb30 con 0x7f710012cbd0 2021-05-26T16:41:05.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f7105d0b700 10 monclient: _renew_subs 2021-05-26T16:41:05.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f7105d0b700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f71000968a0 con 0x7f710012cbd0 2021-05-26T16:41:05.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f70fc001e50 con 0x7f710012cbd0 2021-05-26T16:41:05.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:05.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f70fc0051e0 con 0x7f710012cbd0 2021-05-26T16:41:05.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:05.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f6ffd700 4 set_mon_vals no callback set 2021-05-26T16:41:05.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:05.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.797+0000 7f70f4ff9700 10 monclient: dump: 2021-05-26T16:41:05.856 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:05.857 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:05.857 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.857 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:05.857 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:05.857 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:05.858 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:05.858 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:05.858 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:05.858 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:05.859 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:05.859 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:05.859 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:05.859 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:05.859 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:05.860 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:05.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.798+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f70fc00e790 con 0x7f710012cbd0 2021-05-26T16:41:05.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.798+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f70fc03dc20 con 0x7f710012cbd0 2021-05-26T16:41:05.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.798+0000 7f7105d0b700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.798+0000 7f7105d0b700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.798+0000 7f7105d0b700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.798+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d8004db0 con 0x7f710012cbd0 2021-05-26T16:41:05.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.798+0000 7f7104d09700 10 monclient: get_auth_request con 0x7f70e00333d0 auth_method 0 2021-05-26T16:41:05.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.802+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f70fc0138f0 con 0x7f710012cbd0 2021-05-26T16:41:05.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.802+0000 7f70f4ff9700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:05.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.802+0000 7f70f4ff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:05.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.961+0000 7f7105d0b700 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2021-05-26T16:41:05.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.961+0000 7f7105d0b700 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2021-05-26T16:41:05.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.961+0000 7f7105d0b700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:05.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.961+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70d80055e0 con 0x7f710012cbd0 2021-05-26T16:41:05.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.961+0000 7f70f4ff9700 1 -- 172.21.15.3:0/3240772498 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (unknown 946793192 0 265718887) 0x7f70fc0134e0 con 0x7f710012cbd0 2021-05-26T16:41:05.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.961+0000 7f70f4ff9700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2021-05-26T16:41:05.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.961+0000 7f70f4ff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:05.967 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2021-05-26T16:41:05.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 >> v1:172.21.15.137:6812/30003 conn(0x7f70e00333d0 legacy=0x7f70e0035890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 10 monclient: shutdown 2021-05-26T16:41:05.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:05.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 >> v1:172.21.15.3:6790/0 conn(0x7f710012cbd0 legacy=0x7f71001447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:05.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 shutdown_connections 2021-05-26T16:41:05.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 >> 172.21.15.3:0/3240772498 conn(0x7f71000a00c0 msgr2=0x7f710012b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:05.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 shutdown_connections 2021-05-26T16:41:05.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:05.963+0000 7f7105d0b700 1 -- 172.21.15.3:0/3240772498 wait complete. 2021-05-26T16:41:05.977 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-05-26T16:41:05.978 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-05-26T16:41:05.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-05-26T16:41:06.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.090+0000 7fcfeb632700 10 monclient: get_monmap_and_config 2021-05-26T16:41:06.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.090+0000 7fcfeb632700 10 monclient: build_initial_monmap 2021-05-26T16:41:06.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.090+0000 7fcfeb632700 10 monclient: monmap: 2021-05-26T16:41:06.094 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:06.094 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.094 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:06.091719+0000 2021-05-26T16:41:06.095 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:06.091719+0000 2021-05-26T16:41:06.095 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:06.095 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.096 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:06.096 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:06.096 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:06.096 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:06.097 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:06.097 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:06.097 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:06.097 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:06.097 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:06.098 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.090+0000 7fcfeb632700 1 Processor -- start 2021-05-26T16:41:06.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.090+0000 7fcfeb632700 1 -- start start 2021-05-26T16:41:06.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.090+0000 7fcfeb632700 10 monclient: init 2021-05-26T16:41:06.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:06.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 10 monclient: _add_conns ranks=[3,1,0,5,8,4,2,6,7] 2021-05-26T16:41:06.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 10 monclient(hunting): picked mon.noname-g con 0x7fcfe4096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:06.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 10 monclient(hunting): picked mon.noname-f con 0x7fcfe4099db0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:06.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 10 monclient(hunting): picked mon.noname-a con 0x7fcfe409a260 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:06.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe4059750 con 0x7fcfe409a260 2021-05-26T16:41:06.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe4064620 con 0x7fcfe4099db0 2021-05-26T16:41:06.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe4064e50 con 0x7fcfe4096ca0 2021-05-26T16:41:06.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:06.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfeb632700 10 monclient(hunting): authenticate will time out at 823.723441s 2021-05-26T16:41:06.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfe9bcf700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcfe409a260 0x7fcfe41357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50878/0 (socket says 172.21.15.3:50878) 2021-05-26T16:41:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.091+0000 7fcfe9bcf700 1 -- 172.21.15.3:0/349794134 learned_addr learned my addr 172.21.15.3:0/349794134 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.093+0000 7fcfe9bcf700 1 -- 172.21.15.3:0/349794134 >> v1:172.21.15.3:6789/0 conn(0x7fcfe409a260 legacy=0x7fcfe41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfe8bcd700 1 -- 172.21.15.3:0/349794134 >> v1:172.21.15.137:6789/0 conn(0x7fcfe4099db0 legacy=0x7fcfe4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfe93ce700 1 -- 172.21.15.3:0/349794134 >> v1:172.21.15.137:6790/0 conn(0x7fcfe4096ca0 legacy=0x7fcfe4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334447700 0 0) 0x7fcfe4059750 con 0x7fcfe409a260 2021-05-26T16:41:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): my global_id is 4293 2021-05-26T16:41:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc003270 con 0x7fcfe409a260 2021-05-26T16:41:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431661967 0 0) 0x7fcfe4064e50 con 0x7fcfe4096ca0 2021-05-26T16:41:06.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): my global_id is 4224 2021-05-26T16:41:06.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe4059750 con 0x7fcfe4096ca0 2021-05-26T16:41:06.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512290695 0 0) 0x7fcfe4064620 con 0x7fcfe4099db0 2021-05-26T16:41:06.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient(hunting): my global_id is 4222 2021-05-26T16:41:06.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe4064e50 con 0x7fcfe4099db0 2021-05-26T16:41:06.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1578574372 0 0) 0x7fcfcc003270 con 0x7fcfe409a260 2021-05-26T16:41:06.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 >> v1:172.21.15.137:6790/0 conn(0x7fcfe4096ca0 legacy=0x7fcfe4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 >> v1:172.21.15.137:6789/0 conn(0x7fcfe4099db0 legacy=0x7fcfe4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:06.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 monclient: found mon.noname-a 2021-05-26T16:41:06.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:06.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:06.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe409c390 con 0x7fcfe409a260 2021-05-26T16:41:06.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:06.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:06.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 5 monclient: authenticate success, global_id 4293 2021-05-26T16:41:06.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:06.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcfe0001e90 con 0x7fcfe409a260 2021-05-26T16:41:06.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:06.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: dump: 2021-05-26T16:41:06.118 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.119 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.119 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.119 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.119 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.119 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.120 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.120 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.120 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.120 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.120 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.120 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.121 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.121 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.121 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.121 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:06.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcfe0004970 con 0x7fcfe409a260 2021-05-26T16:41:06.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:06.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 1 -- 172.21.15.3:0/349794134 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcfe0004e20 con 0x7fcfe409a260 2021-05-26T16:41:06.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:06.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 4 set_mon_vals no callback set 2021-05-26T16:41:06.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:06.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfd3fff700 10 monclient: dump: 2021-05-26T16:41:06.123 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.124 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.124 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.124 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.124 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.124 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.125 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.125 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.125 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.125 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.126 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.126 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.126 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.126 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.126 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.127 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 10 monclient: shutdown 2021-05-26T16:41:06.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:06.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.094+0000 7fcfeb632700 1 -- 172.21.15.3:0/349794134 >> v1:172.21.15.3:6789/0 conn(0x7fcfe409a260 legacy=0x7fcfe41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 1 -- 172.21.15.3:0/349794134 shutdown_connections 2021-05-26T16:41:06.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 1 -- 172.21.15.3:0/349794134 >> 172.21.15.3:0/349794134 conn(0x7fcfe409cc00 msgr2=0x7fcfe409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:06.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 1 -- 172.21.15.3:0/349794134 shutdown_connections 2021-05-26T16:41:06.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 1 -- 172.21.15.3:0/349794134 wait complete. 2021-05-26T16:41:06.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 10 monclient: build_initial_monmap 2021-05-26T16:41:06.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 10 monclient: monmap: 2021-05-26T16:41:06.129 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:06.129 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:06.129 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:06.129 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:06.130 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:06.130 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.130 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:06.130 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:06.131 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:06.131 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:06.131 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:06.131 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:06.131 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:06.132 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:06.132 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:06.132 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 1 Processor -- start 2021-05-26T16:41:06.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 1 -- start start 2021-05-26T16:41:06.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.095+0000 7fcfeb632700 10 monclient: init 2021-05-26T16:41:06.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:06.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 10 monclient: _add_conns ranks=[5,4,3,0,1,2,8,7,6] 2021-05-26T16:41:06.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 10 monclient(hunting): picked mon.noname-h con 0x7fcfe4096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:06.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 10 monclient(hunting): picked mon.noname-c con 0x7fcfe4099db0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:06.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 10 monclient(hunting): picked mon.noname-g con 0x7fcfe409a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:06.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe409bfb0 con 0x7fcfe409a260 2021-05-26T16:41:06.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe409bce0 con 0x7fcfe4099db0 2021-05-26T16:41:06.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe4116e40 con 0x7fcfe4096ca0 2021-05-26T16:41:06.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:06.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfeb632700 10 monclient(hunting): authenticate will time out at 823.728546s 2021-05-26T16:41:06.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfe8bcd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fcfe4099db0 0x7fcfe41410e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36394/0 (socket says 172.21.15.3:36394) 2021-05-26T16:41:06.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.096+0000 7fcfe8bcd700 1 -- 172.21.15.3:0/1695160658 learned_addr learned my addr 172.21.15.3:0/1695160658 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:06.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfe8bcd700 1 -- 172.21.15.3:0/1695160658 >> v1:172.21.15.3:6791/0 conn(0x7fcfe4099db0 legacy=0x7fcfe41410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfe9bcf700 1 -- 172.21.15.3:0/1695160658 >> v1:172.21.15.137:6790/0 conn(0x7fcfe409a260 legacy=0x7fcfe4144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfe93ce700 1 -- 172.21.15.3:0/1695160658 >> v1:172.21.15.137:6791/0 conn(0x7fcfe4096ca0 legacy=0x7fcfe4129860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849252620 0 0) 0x7fcfe409bce0 con 0x7fcfe4099db0 2021-05-26T16:41:06.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfd17fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfd17fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfd17fa700 10 monclient(hunting): my global_id is 4216 2021-05-26T16:41:06.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.098+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc4003270 con 0x7fcfe4099db0 2021-05-26T16:41:06.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3339514133 0 0) 0x7fcfc4003270 con 0x7fcfe4099db0 2021-05-26T16:41:06.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcfe409bce0 con 0x7fcfe4099db0 2021-05-26T16:41:06.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcfd4001f00 con 0x7fcfe4099db0 2021-05-26T16:41:06.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:06.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): dump: 2021-05-26T16:41:06.138 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.139 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.139 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.139 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.139 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.142 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.142 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.142 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:06.142 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277635478 0 0) 0x7fcfe409bfb0 con 0x7fcfe409a260 2021-05-26T16:41:06.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): my global_id is 4233 2021-05-26T16:41:06.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc4003270 con 0x7fcfe409a260 2021-05-26T16:41:06.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562065307 0 0) 0x7fcfe4116e40 con 0x7fcfe4096ca0 2021-05-26T16:41:06.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient(hunting): my global_id is 4235 2021-05-26T16:41:06.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe409bfb0 con 0x7fcfe4096ca0 2021-05-26T16:41:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2959625203 0 0) 0x7fcfe409bce0 con 0x7fcfe4099db0 2021-05-26T16:41:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 >> v1:172.21.15.137:6791/0 conn(0x7fcfe4096ca0 legacy=0x7fcfe4129860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 >> v1:172.21.15.137:6790/0 conn(0x7fcfe409a260 legacy=0x7fcfe4144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 monclient: found mon.c 2021-05-26T16:41:06.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:06.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:06.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe41170e0 con 0x7fcfe4099db0 2021-05-26T16:41:06.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:06.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:06.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfeb632700 5 monclient: authenticate success, global_id 4216 2021-05-26T16:41:06.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfeb632700 10 monclient: _renew_subs 2021-05-26T16:41:06.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfeb632700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe412f400 con 0x7fcfe4099db0 2021-05-26T16:41:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfeb632700 10 monclient: _renew_subs 2021-05-26T16:41:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfeb632700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe412e8f0 con 0x7fcfe4099db0 2021-05-26T16:41:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcfd4002500 con 0x7fcfe4099db0 2021-05-26T16:41:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcfd4002a30 con 0x7fcfe4099db0 2021-05-26T16:41:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd37fe700 4 set_mon_vals no callback set 2021-05-26T16:41:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:06.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.099+0000 7fcfd17fa700 10 monclient: dump: 2021-05-26T16:41:06.150 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.150 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.150 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.153 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.153 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.153 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.153 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.100+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fcfd4002c50 con 0x7fcfe4099db0 2021-05-26T16:41:06.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.100+0000 7fcfeb632700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.100+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fcfd403da50 con 0x7fcfe4099db0 2021-05-26T16:41:06.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.100+0000 7fcfeb632700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.100+0000 7fcfeb632700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:06.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.100+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc004db0 con 0x7fcfe4099db0 2021-05-26T16:41:06.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.100+0000 7fcfe93ce700 10 monclient: get_auth_request con 0x7fcfc4032b20 auth_method 0 2021-05-26T16:41:06.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.105+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fcfd40136c0 con 0x7fcfe4099db0 2021-05-26T16:41:06.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.105+0000 7fcfd17fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.105+0000 7fcfd17fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.314+0000 7fcfeb632700 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2021-05-26T16:41:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.314+0000 7fcfeb632700 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2021-05-26T16:41:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.314+0000 7fcfeb632700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.314+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcfbc005060 con 0x7fcfe4099db0 2021-05-26T16:41:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.316+0000 7fcfd17fa700 1 -- 172.21.15.3:0/1695160658 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+74371 (unknown 3797009233 0 2314815034) 0x7fcfd40132b0 con 0x7fcfe4099db0 2021-05-26T16:41:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.316+0000 7fcfd17fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2021-05-26T16:41:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.316+0000 7fcfd17fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:06.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:06.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 >> v1:172.21.15.137:6812/30003 conn(0x7fcfc4032b20 legacy=0x7fcfc4034fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 10 monclient: shutdown 2021-05-26T16:41:06.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:06.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 >> v1:172.21.15.3:6791/0 conn(0x7fcfe4099db0 legacy=0x7fcfe41410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 shutdown_connections 2021-05-26T16:41:06.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 >> 172.21.15.3:0/1695160658 conn(0x7fcfe409cc00 msgr2=0x7fcfe409ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:06.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 shutdown_connections 2021-05-26T16:41:06.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.317+0000 7fcfeb632700 1 -- 172.21.15.3:0/1695160658 wait complete. 2021-05-26T16:41:06.332 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":4,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6812","nonce":30003}]},"active_addr":"172.21.15.137:6812/30003","active_change":"2021-05-26T16:40:56.579426+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3498196543}]},{"addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":2444489701}]},{"addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":2768911230}]}]}} 2021-05-26T16:41:06.334 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-05-26T16:41:06.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-05-26T16:41:06.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-05-26T16:41:06.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.447+0000 7f2a7f005700 10 monclient: get_monmap_and_config 2021-05-26T16:41:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.447+0000 7f2a7f005700 10 monclient: build_initial_monmap 2021-05-26T16:41:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.447+0000 7f2a7f005700 10 monclient: monmap: 2021-05-26T16:41:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:06.448669+0000 2021-05-26T16:41:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:06.448669+0000 2021-05-26T16:41:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:06.455 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.447+0000 7f2a7f005700 1 Processor -- start 2021-05-26T16:41:06.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.447+0000 7f2a7f005700 1 -- start start 2021-05-26T16:41:06.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.447+0000 7f2a7f005700 10 monclient: init 2021-05-26T16:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 10 monclient: _add_conns ranks=[8,7,4,2,3,5,0,1,6] 2021-05-26T16:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 10 monclient(hunting): picked mon.noname-e con 0x7f2a78064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 10 monclient(hunting): picked mon.noname-i con 0x7f2a78063e30 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 10 monclient(hunting): picked mon.noname-c con 0x7f2a780642e0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a78059750 con 0x7f2a780642e0 2021-05-26T16:41:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a78064e00 con 0x7f2a78063e30 2021-05-26T16:41:06.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7809c770 con 0x7f2a78064a20 2021-05-26T16:41:06.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:06.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7f005700 10 monclient(hunting): authenticate will time out at 824.080214s 2021-05-26T16:41:06.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7cda1700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f2a78064a20 0x7f2a78099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:51968/0 (socket says 172.21.15.3:51968) 2021-05-26T16:41:06.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.448+0000 7f2a7cda1700 1 -- 172.21.15.3:0/4256063263 learned_addr learned my addr 172.21.15.3:0/4256063263 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:06.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a7d5a2700 1 -- 172.21.15.3:0/4256063263 >> v1:172.21.15.3:6791/0 conn(0x7f2a780642e0 legacy=0x7f2a781357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a7cda1700 1 -- 172.21.15.3:0/4256063263 >> v1:172.21.15.3:6793/0 conn(0x7f2a78064a20 legacy=0x7f2a78099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939166979 0 0) 0x7f2a78059750 con 0x7f2a780642e0 2021-05-26T16:41:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): my global_id is 4225 2021-05-26T16:41:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6ffff700 1 -- 172.21.15.3:0/4256063263 >> v1:172.21.15.137:6792/0 conn(0x7f2a78063e30 legacy=0x7f2a78132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a64003270 con 0x7f2a780642e0 2021-05-26T16:41:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576645877 0 0) 0x7f2a7809c770 con 0x7f2a78064a20 2021-05-26T16:41:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): my global_id is 4220 2021-05-26T16:41:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a78059750 con 0x7f2a78064a20 2021-05-26T16:41:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905684112 0 0) 0x7f2a78064e00 con 0x7f2a78063e30 2021-05-26T16:41:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient(hunting): my global_id is 4201 2021-05-26T16:41:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7809c770 con 0x7f2a78063e30 2021-05-26T16:41:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130757176 0 0) 0x7f2a64003270 con 0x7f2a780642e0 2021-05-26T16:41:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 >> v1:172.21.15.3:6793/0 conn(0x7f2a78064a20 legacy=0x7f2a78099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 >> v1:172.21.15.137:6792/0 conn(0x7f2a78063e30 legacy=0x7f2a78132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:06.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 monclient: found mon.noname-c 2021-05-26T16:41:06.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:06.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:06.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.450+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780977a0 con 0x7f2a780642e0 2021-05-26T16:41:06.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:06.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:06.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 5 monclient: authenticate success, global_id 4225 2021-05-26T16:41:06.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2a74001ef0 con 0x7f2a780642e0 2021-05-26T16:41:06.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:06.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: dump: 2021-05-26T16:41:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.478 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.478 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.478 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.478 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.478 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.480 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.480 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.480 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2a74002280 con 0x7f2a780642e0 2021-05-26T16:41:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 1 -- 172.21.15.3:0/4256063263 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2a74002730 con 0x7f2a780642e0 2021-05-26T16:41:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 4 set_mon_vals no callback set 2021-05-26T16:41:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a6f7fe700 10 monclient: dump: 2021-05-26T16:41:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.484 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.484 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.484 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.485 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.485 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.485 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.485 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.487 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 10 monclient: shutdown 2021-05-26T16:41:06.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:06.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 1 -- 172.21.15.3:0/4256063263 >> v1:172.21.15.3:6791/0 conn(0x7f2a780642e0 legacy=0x7f2a781357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 1 -- 172.21.15.3:0/4256063263 shutdown_connections 2021-05-26T16:41:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 1 -- 172.21.15.3:0/4256063263 >> 172.21.15.3:0/4256063263 conn(0x7f2a780a0db0 msgr2=0x7f2a7809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 1 -- 172.21.15.3:0/4256063263 shutdown_connections 2021-05-26T16:41:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.451+0000 7f2a7f005700 1 -- 172.21.15.3:0/4256063263 wait complete. 2021-05-26T16:41:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.452+0000 7f2a7f005700 10 monclient: build_initial_monmap 2021-05-26T16:41:06.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.452+0000 7f2a7f005700 10 monclient: monmap: 2021-05-26T16:41:06.489 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:06.489 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:06.489 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:06.490 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:06.490 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:06.490 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.490 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:06.490 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:06.493 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.452+0000 7f2a7f005700 1 Processor -- start 2021-05-26T16:41:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.452+0000 7f2a7f005700 1 -- start start 2021-05-26T16:41:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.452+0000 7f2a7f005700 10 monclient: init 2021-05-26T16:41:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:06.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 10 monclient: _add_conns ranks=[5,8,2,0,7,3,6,4,1] 2021-05-26T16:41:06.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 10 monclient(hunting): picked mon.noname-h con 0x7f2a78063e30 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:06.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 10 monclient(hunting): picked mon.noname-e con 0x7f2a780642e0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:06.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 10 monclient(hunting): picked mon.noname-b con 0x7f2a78064a20 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7812ff30 con 0x7f2a78064a20 2021-05-26T16:41:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a78116970 con 0x7f2a78063e30 2021-05-26T16:41:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a78116c10 con 0x7f2a780642e0 2021-05-26T16:41:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7f005700 10 monclient(hunting): authenticate will time out at 824.085130s 2021-05-26T16:41:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a6ffff700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f2a780642e0 0x7f2a781410e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:51978/0 (socket says 172.21.15.3:51978) 2021-05-26T16:41:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a7d5a2700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f2a78064a20 0x7f2a78144810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52938/0 (socket says 172.21.15.3:52938) 2021-05-26T16:41:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.453+0000 7f2a6ffff700 1 -- 172.21.15.3:0/3886732590 learned_addr learned my addr 172.21.15.3:0/3886732590 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6ffff700 1 -- 172.21.15.3:0/3886732590 >> v1:172.21.15.3:6793/0 conn(0x7f2a780642e0 legacy=0x7f2a781410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a7d5a2700 1 -- 172.21.15.3:0/3886732590 >> v1:172.21.15.3:6790/0 conn(0x7f2a78064a20 legacy=0x7f2a78144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a7cda1700 1 -- 172.21.15.3:0/3886732590 >> v1:172.21.15.137:6791/0 conn(0x7f2a78063e30 legacy=0x7f2a78129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89794423 0 0) 0x7f2a78116c10 con 0x7f2a780642e0 2021-05-26T16:41:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): my global_id is 4229 2021-05-26T16:41:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a58003270 con 0x7f2a780642e0 2021-05-26T16:41:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427458329 0 0) 0x7f2a7812ff30 con 0x7f2a78064a20 2021-05-26T16:41:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): my global_id is 4259 2021-05-26T16:41:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a78116c10 con 0x7f2a78064a20 2021-05-26T16:41:06.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868332191 0 0) 0x7f2a78116970 con 0x7f2a78063e30 2021-05-26T16:41:06.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): my global_id is 4244 2021-05-26T16:41:06.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7812ff30 con 0x7f2a78063e30 2021-05-26T16:41:06.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1839832154 0 0) 0x7f2a58003270 con 0x7f2a780642e0 2021-05-26T16:41:06.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2a78116970 con 0x7f2a780642e0 2021-05-26T16:41:06.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2a60001f00 con 0x7f2a780642e0 2021-05-26T16:41:06.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:06.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): dump: 2021-05-26T16:41:06.502 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.503 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.503 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.503 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.503 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.503 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.504 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.504 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.504 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.504 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.504 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.505 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.505 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.505 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.506 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.506 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:06.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1988303464 0 0) 0x7f2a78116c10 con 0x7f2a78064a20 2021-05-26T16:41:06.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2a58003270 con 0x7f2a78064a20 2021-05-26T16:41:06.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2a74001eb0 con 0x7f2a78064a20 2021-05-26T16:41:06.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:06.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 10 monclient(hunting): dump: 2021-05-26T16:41:06.508 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.508 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.508 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.508 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.508 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.509 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.509 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.509 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.509 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.511 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.511 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4109307901 0 0) 0x7f2a78116970 con 0x7f2a780642e0 2021-05-26T16:41:06.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 >> v1:172.21.15.137:6791/0 conn(0x7f2a78063e30 legacy=0x7f2a78129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.455+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 >> v1:172.21.15.3:6790/0 conn(0x7f2a78064a20 legacy=0x7f2a78144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 10 monclient: _finish_hunting 0 2021-05-26T16:41:06.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 1 monclient: found mon.e 2021-05-26T16:41:06.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:06.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78116eb0 con 0x7f2a780642e0 2021-05-26T16:41:06.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 10 monclient: _finish_auth 0 2021-05-26T16:41:06.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:06.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a7f005700 5 monclient: authenticate success, global_id 4229 2021-05-26T16:41:06.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a7f005700 10 monclient: _renew_subs 2021-05-26T16:41:06.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a7f005700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7812f3e0 con 0x7f2a780642e0 2021-05-26T16:41:06.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a7f005700 10 monclient: _renew_subs 2021-05-26T16:41:06.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a7f005700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a78131300 con 0x7f2a780642e0 2021-05-26T16:41:06.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2a600024c0 con 0x7f2a780642e0 2021-05-26T16:41:06.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:06.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2a60002970 con 0x7f2a780642e0 2021-05-26T16:41:06.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:06.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6effd700 4 set_mon_vals no callback set 2021-05-26T16:41:06.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 10 monclient: dump: 2021-05-26T16:41:06.517 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.517 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.517 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.517 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.518 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.518 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.518 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.518 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.518 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.519 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.519 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.519 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.519 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.519 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.520 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.520 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.456+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f2a60002ad0 con 0x7f2a780642e0 2021-05-26T16:41:06.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.457+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f2a6003d8f0 con 0x7f2a780642e0 2021-05-26T16:41:06.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.457+0000 7f2a7f005700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.457+0000 7f2a7f005700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.457+0000 7f2a7f005700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.457+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a50004db0 con 0x7f2a780642e0 2021-05-26T16:41:06.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.457+0000 7f2a7cda1700 10 monclient: get_auth_request con 0x7f2a58032fa0 auth_method 0 2021-05-26T16:41:06.522 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.461+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f2a60013570 con 0x7f2a780642e0 2021-05-26T16:41:06.522 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.461+0000 7f2a6cff9700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.522 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.461+0000 7f2a6cff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:06.623 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.620+0000 7f2a7f005700 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:06.623 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.620+0000 7f2a7f005700 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:06.624 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.620+0000 7f2a7f005700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.624 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.620+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a50005060 con 0x7f2a780642e0 2021-05-26T16:41:06.625 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.620+0000 7f2a6cff9700 1 -- 172.21.15.3:0/3886732590 <== mon.8 v1:172.21.15.3:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9976 (unknown 4221056075 0 4226676142) 0x7f2a60013160 con 0x7f2a780642e0 2021-05-26T16:41:06.625 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.620+0000 7f2a6cff9700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:06.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.620+0000 7f2a6cff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:06.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:06.627 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","created":"2021-05-26T16:40:51.540326+0000","modified":"2021-05-26T16:41:05.316620+0000","last_up_change":"2021-05-26T16:41:01.304218+0000","last_in_change":"2021-05-26T16:40:55.160191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-05-26T16:41:01.359450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-05-26T16:41:03.248067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15008bbc-879f-43a6-bfbc-f16853c84582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6800","nonce":30458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6801","nonce":30458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6803","nonce":30458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6802","nonce":30458}]},"public_addr":"172.21.15.3:6800/30458","cluster_addr":"172.21.15.3:6801/30458","heartbeat_back_addr":"172.21.15.3:6803/30458","heartbeat_front_addr":"172.21.15.3:6802/30458","state":["exists","up"]},{"osd":1,"uuid":"13c28fda-7809-4964-9b17-4c6fb9fff0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6804","nonce":30459}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6805","nonce":30459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6808","nonce":30459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6806","nonce":30459}]},"public_addr":"172.21.15.3:6804/30459","cluster_addr":"172.21.15.3:6805/30459","heartbeat_back_addr":"172.21.15.3:6808/30459","heartbeat_front_addr":"172.21.15.3:6806/30459","state":["exists","up"]},{"osd":2,"uuid":"ca01de00-a5fb-4b03-9412-bca079506190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6807","nonce":30460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6809","nonce":30460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6811","nonce":30460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6810","nonce":30460}]},"public_addr":"172.21.15.3:6807/30460","cluster_addr":"172.21.15.3:6809/30460","heartbeat_back_addr":"172.21.15.3:6811/30460","heartbeat_front_addr":"172.21.15.3:6810/30460","state":["exists","up"]},{"osd":3,"uuid":"ecf54fc5-53a9-4585-a369-03a5d382cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6800","nonce":30479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6801","nonce":30479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6803","nonce":30479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6802","nonce":30479}]},"public_addr":"172.21.15.137:6800/30479","cluster_addr":"172.21.15.137:6801/30479","heartbeat_back_addr":"172.21.15.137:6803/30479","heartbeat_front_addr":"172.21.15.137:6802/30479","state":["exists","up"]},{"osd":4,"uuid":"c2926c74-967a-4c6d-acb7-4a0d32f89e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6804","nonce":30480}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6806","nonce":30480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6811","nonce":30480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6808","nonce":30480}]},"public_addr":"172.21.15.137:6804/30480","cluster_addr":"172.21.15.137:6806/30480","heartbeat_back_addr":"172.21.15.137:6811/30480","heartbeat_front_addr":"172.21.15.137:6808/30480","state":["exists","up"]},{"osd":5,"uuid":"acee8981-3ab2-4bad-b287-217a027a7b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6805","nonce":30481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6807","nonce":30481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6810","nonce":30481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6809","nonce":30481}]},"public_addr":"172.21.15.137:6805/30481","cluster_addr":"172.21.15.137:6807/30481","heartbeat_back_addr":"172.21.15.137:6810/30481","heartbeat_front_addr":"172.21.15.137:6809/30481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.244103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.235066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.269488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.281565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.243717+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.240437+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-05-26T16:41:06.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 >> v1:172.21.15.137:6812/30003 conn(0x7f2a58032fa0 legacy=0x7f2a58035460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 10 monclient: shutdown 2021-05-26T16:41:06.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:06.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 >> v1:172.21.15.3:6793/0 conn(0x7f2a780642e0 legacy=0x7f2a781410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 shutdown_connections 2021-05-26T16:41:06.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 >> 172.21.15.3:0/3886732590 conn(0x7f2a780a0db0 msgr2=0x7f2a78099f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:06.630 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 shutdown_connections 2021-05-26T16:41:06.630 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.622+0000 7f2a7f005700 1 -- 172.21.15.3:0/3886732590 wait complete. 2021-05-26T16:41:06.637 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-05-26T16:41:06.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-05-26T16:41:06.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.749+0000 7f26f76e6700 10 monclient: get_monmap_and_config 2021-05-26T16:41:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.749+0000 7f26f76e6700 10 monclient: build_initial_monmap 2021-05-26T16:41:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.749+0000 7f26f76e6700 10 monclient: monmap: 2021-05-26T16:41:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:06.751549+0000 2021-05-26T16:41:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:06.751549+0000 2021-05-26T16:41:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:06.757 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.750+0000 7f26f76e6700 1 Processor -- start 2021-05-26T16:41:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.750+0000 7f26f76e6700 1 -- start start 2021-05-26T16:41:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.750+0000 7f26f76e6700 10 monclient: init 2021-05-26T16:41:06.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:06.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 10 monclient: _add_conns ranks=[6,7,5,1,4,8,2,0,3] 2021-05-26T16:41:06.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 10 monclient(hunting): picked mon.noname-d con 0x7f26f0064a20 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:06.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 10 monclient(hunting): picked mon.noname-i con 0x7f26f0063e30 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 10 monclient(hunting): picked mon.noname-h con 0x7f26f00642e0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f0059750 con 0x7f26f00642e0 2021-05-26T16:41:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f0064e00 con 0x7f26f0064a20 2021-05-26T16:41:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f009c770 con 0x7f26f0063e30 2021-05-26T16:41:06.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:06.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f76e6700 10 monclient(hunting): authenticate will time out at 824.383186s 2021-05-26T16:41:06.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f5482700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f26f0064a20 0x7f26f0099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56306/0 (socket says 172.21.15.3:56306) 2021-05-26T16:41:06.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.751+0000 7f26f5482700 1 -- 172.21.15.3:0/1617596337 learned_addr learned my addr 172.21.15.3:0/1617596337 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:06.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26f5482700 1 -- 172.21.15.3:0/1617596337 >> v1:172.21.15.3:6792/0 conn(0x7f26f0064a20 legacy=0x7f26f0099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26f5c83700 1 -- 172.21.15.3:0/1617596337 >> v1:172.21.15.137:6791/0 conn(0x7f26f00642e0 legacy=0x7f26f01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26f4c81700 1 -- 172.21.15.3:0/1617596337 >> v1:172.21.15.137:6792/0 conn(0x7f26f0063e30 legacy=0x7f26f0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375946408 0 0) 0x7f26f0064e00 con 0x7f26f0064a20 2021-05-26T16:41:06.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): my global_id is 4209 2021-05-26T16:41:06.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d8003270 con 0x7f26f0064a20 2021-05-26T16:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69320647 0 0) 0x7f26f0059750 con 0x7f26f00642e0 2021-05-26T16:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): my global_id is 4253 2021-05-26T16:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f0064e00 con 0x7f26f00642e0 2021-05-26T16:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400943950 0 0) 0x7f26f009c770 con 0x7f26f0063e30 2021-05-26T16:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient(hunting): my global_id is 4210 2021-05-26T16:41:06.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f0059750 con 0x7f26f0063e30 2021-05-26T16:41:06.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674274558 0 0) 0x7f26d8003270 con 0x7f26f0064a20 2021-05-26T16:41:06.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 >> v1:172.21.15.137:6792/0 conn(0x7f26f0063e30 legacy=0x7f26f0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 >> v1:172.21.15.137:6791/0 conn(0x7f26f00642e0 legacy=0x7f26f01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:06.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 monclient: found mon.noname-d 2021-05-26T16:41:06.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:06.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:06.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f00977a0 con 0x7f26f0064a20 2021-05-26T16:41:06.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient: _finish_auth 0 2021-05-26T16:41:06.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:06.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f26e4001a60 con 0x7f26f0064a20 2021-05-26T16:41:06.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26f76e6700 5 monclient: authenticate success, global_id 4209 2021-05-26T16:41:06.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26f76e6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:06.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:06.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.753+0000 7f26dffff700 10 monclient: dump: 2021-05-26T16:41:06.778 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.779 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.779 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.779 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.779 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.779 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.780 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.780 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.780 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.781 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.781 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.781 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.781 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.782 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.782 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.782 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:06.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f26e4001d70 con 0x7f26f0064a20 2021-05-26T16:41:06.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26dffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:06.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:06.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26dffff700 1 -- 172.21.15.3:0/1617596337 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f26e4004930 con 0x7f26f0064a20 2021-05-26T16:41:06.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26dffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 4 set_mon_vals no callback set 2021-05-26T16:41:06.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26dffff700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:06.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26dffff700 10 monclient: dump: 2021-05-26T16:41:06.784 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.784 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.785 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.785 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.785 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.785 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.785 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.786 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.786 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.786 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.786 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.786 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.787 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.787 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.787 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.787 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 10 monclient: shutdown 2021-05-26T16:41:06.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:06.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 1 -- 172.21.15.3:0/1617596337 >> v1:172.21.15.3:6792/0 conn(0x7f26f0064a20 legacy=0x7f26f0099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 1 -- 172.21.15.3:0/1617596337 shutdown_connections 2021-05-26T16:41:06.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 1 -- 172.21.15.3:0/1617596337 >> 172.21.15.3:0/1617596337 conn(0x7f26f00a0db0 msgr2=0x7f26f009cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 1 -- 172.21.15.3:0/1617596337 shutdown_connections 2021-05-26T16:41:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.754+0000 7f26f76e6700 1 -- 172.21.15.3:0/1617596337 wait complete. 2021-05-26T16:41:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.755+0000 7f26f76e6700 10 monclient: build_initial_monmap 2021-05-26T16:41:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.755+0000 7f26f76e6700 10 monclient: monmap: 2021-05-26T16:41:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.791 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:06.791 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:06.791 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:06.791 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:06.793 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.755+0000 7f26f76e6700 1 Processor -- start 2021-05-26T16:41:06.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.755+0000 7f26f76e6700 1 -- start start 2021-05-26T16:41:06.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.755+0000 7f26f76e6700 10 monclient: init 2021-05-26T16:41:06.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:06.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 10 monclient: _add_conns ranks=[2,7,8,4,0,5,3,6,1] 2021-05-26T16:41:06.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 10 monclient(hunting): picked mon.noname-b con 0x7f26f0063e30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:06.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 10 monclient(hunting): picked mon.noname-i con 0x7f26f00642e0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:06.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 10 monclient(hunting): picked mon.noname-e con 0x7f26f0064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f0129db0 con 0x7f26f0063e30 2021-05-26T16:41:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f012fe50 con 0x7f26f00642e0 2021-05-26T16:41:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f0116900 con 0x7f26f0064a20 2021-05-26T16:41:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f76e6700 10 monclient(hunting): authenticate will time out at 824.388235s 2021-05-26T16:41:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f5482700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f26f0063e30 0x7f26f01296a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52950/0 (socket says 172.21.15.3:52950) 2021-05-26T16:41:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.756+0000 7f26f5482700 1 -- 172.21.15.3:0/1861349966 learned_addr learned my addr 172.21.15.3:0/1861349966 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26f5c83700 1 -- 172.21.15.3:0/1861349966 >> v1:172.21.15.3:6793/0 conn(0x7f26f0064a20 legacy=0x7f26f0144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26f5482700 1 -- 172.21.15.3:0/1861349966 >> v1:172.21.15.3:6790/0 conn(0x7f26f0063e30 legacy=0x7f26f01296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26f4c81700 1 -- 172.21.15.3:0/1861349966 >> v1:172.21.15.137:6792/0 conn(0x7f26f00642e0 legacy=0x7f26f0141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749070071 0 0) 0x7f26f0116900 con 0x7f26f0064a20 2021-05-26T16:41:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): my global_id is 4238 2021-05-26T16:41:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d0003270 con 0x7f26f0064a20 2021-05-26T16:41:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635332693 0 0) 0x7f26f0129db0 con 0x7f26f0063e30 2021-05-26T16:41:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): my global_id is 4268 2021-05-26T16:41:06.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f0116900 con 0x7f26f0063e30 2021-05-26T16:41:06.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3732523091 0 0) 0x7f26d0003270 con 0x7f26f0064a20 2021-05-26T16:41:06.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26f0129db0 con 0x7f26f0064a20 2021-05-26T16:41:06.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f26ec002280 con 0x7f26f0064a20 2021-05-26T16:41:06.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:06.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): dump: 2021-05-26T16:41:06.800 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.800 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.801 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.801 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.801 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.801 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.801 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.802 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.802 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.802 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.802 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.802 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.803 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.803 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.803 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.803 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:06.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2041492311 0 0) 0x7f26f0116900 con 0x7f26f0063e30 2021-05-26T16:41:06.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26d0003270 con 0x7f26f0063e30 2021-05-26T16:41:06.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219998987 0 0) 0x7f26f012fe50 con 0x7f26f00642e0 2021-05-26T16:41:06.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:06.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:06.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): my global_id is 4219 2021-05-26T16:41:06.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f0116900 con 0x7f26f00642e0 2021-05-26T16:41:06.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f26e4001a90 con 0x7f26f0063e30 2021-05-26T16:41:06.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.758+0000 7f26dd7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:06.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient(hunting): dump: 2021-05-26T16:41:06.806 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.810 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.810 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 711215101 0 0) 0x7f26f0129db0 con 0x7f26f0064a20 2021-05-26T16:41:06.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 >> v1:172.21.15.137:6792/0 conn(0x7f26f00642e0 legacy=0x7f26f0141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 >> v1:172.21.15.3:6790/0 conn(0x7f26f0063e30 legacy=0x7f26f01296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 monclient: found mon.e 2021-05-26T16:41:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0116ba0 con 0x7f26f0064a20 2021-05-26T16:41:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26f76e6700 5 monclient: authenticate success, global_id 4238 2021-05-26T16:41:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26f76e6700 10 monclient: _renew_subs 2021-05-26T16:41:06.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26f76e6700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f0116e40 con 0x7f26f0064a20 2021-05-26T16:41:06.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26f76e6700 10 monclient: _renew_subs 2021-05-26T16:41:06.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26f76e6700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f013cc30 con 0x7f26f0064a20 2021-05-26T16:41:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f26ec0027c0 con 0x7f26f0064a20 2021-05-26T16:41:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f26ec002c70 con 0x7f26f0064a20 2021-05-26T16:41:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:06.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26df7fe700 4 set_mon_vals no callback set 2021-05-26T16:41:06.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:06.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 10 monclient: dump: 2021-05-26T16:41:06.815 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:06.815 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:06.818 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.759+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f26ec002dd0 con 0x7f26f0064a20 2021-05-26T16:41:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.760+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f26ec03dbb0 con 0x7f26f0064a20 2021-05-26T16:41:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.760+0000 7f26f76e6700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.760+0000 7f26f76e6700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.760+0000 7f26f76e6700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.760+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c8004db0 con 0x7f26f0064a20 2021-05-26T16:41:06.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.760+0000 7f26f5482700 10 monclient: get_auth_request con 0x7f26d0033110 auth_method 0 2021-05-26T16:41:06.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.764+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f26ec0138a0 con 0x7f26f0064a20 2021-05-26T16:41:06.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.764+0000 7f26dd7fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:06.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.764+0000 7f26dd7fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:06.926 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.922+0000 7f26f76e6700 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:06.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.922+0000 7f26f76e6700 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:06.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.922+0000 7f26f76e6700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:06.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.922+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26c8005060 con 0x7f26f0064a20 2021-05-26T16:41:06.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.923+0000 7f26dd7fa700 1 -- 172.21.15.3:0/1861349966 <== mon.8 v1:172.21.15.3:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9976 (unknown 4221056075 0 4226676142) 0x7f26ec013430 con 0x7f26f0064a20 2021-05-26T16:41:06.928 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.923+0000 7f26dd7fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:06.928 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.923+0000 7f26dd7fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:06.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:06.929 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","created":"2021-05-26T16:40:51.540326+0000","modified":"2021-05-26T16:41:05.316620+0000","last_up_change":"2021-05-26T16:41:01.304218+0000","last_in_change":"2021-05-26T16:40:55.160191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-05-26T16:41:01.359450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-05-26T16:41:03.248067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15008bbc-879f-43a6-bfbc-f16853c84582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6800","nonce":30458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6801","nonce":30458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6803","nonce":30458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6802","nonce":30458}]},"public_addr":"172.21.15.3:6800/30458","cluster_addr":"172.21.15.3:6801/30458","heartbeat_back_addr":"172.21.15.3:6803/30458","heartbeat_front_addr":"172.21.15.3:6802/30458","state":["exists","up"]},{"osd":1,"uuid":"13c28fda-7809-4964-9b17-4c6fb9fff0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6804","nonce":30459}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6805","nonce":30459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6808","nonce":30459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6806","nonce":30459}]},"public_addr":"172.21.15.3:6804/30459","cluster_addr":"172.21.15.3:6805/30459","heartbeat_back_addr":"172.21.15.3:6808/30459","heartbeat_front_addr":"172.21.15.3:6806/30459","state":["exists","up"]},{"osd":2,"uuid":"ca01de00-a5fb-4b03-9412-bca079506190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6807","nonce":30460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6809","nonce":30460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6811","nonce":30460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6810","nonce":30460}]},"public_addr":"172.21.15.3:6807/30460","cluster_addr":"172.21.15.3:6809/30460","heartbeat_back_addr":"172.21.15.3:6811/30460","heartbeat_front_addr":"172.21.15.3:6810/30460","state":["exists","up"]},{"osd":3,"uuid":"ecf54fc5-53a9-4585-a369-03a5d382cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6800","nonce":30479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6801","nonce":30479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6803","nonce":30479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6802","nonce":30479}]},"public_addr":"172.21.15.137:6800/30479","cluster_addr":"172.21.15.137:6801/30479","heartbeat_back_addr":"172.21.15.137:6803/30479","heartbeat_front_addr":"172.21.15.137:6802/30479","state":["exists","up"]},{"osd":4,"uuid":"c2926c74-967a-4c6d-acb7-4a0d32f89e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6804","nonce":30480}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6806","nonce":30480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6811","nonce":30480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6808","nonce":30480}]},"public_addr":"172.21.15.137:6804/30480","cluster_addr":"172.21.15.137:6806/30480","heartbeat_back_addr":"172.21.15.137:6811/30480","heartbeat_front_addr":"172.21.15.137:6808/30480","state":["exists","up"]},{"osd":5,"uuid":"acee8981-3ab2-4bad-b287-217a027a7b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6805","nonce":30481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6807","nonce":30481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6810","nonce":30481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6809","nonce":30481}]},"public_addr":"172.21.15.137:6805/30481","cluster_addr":"172.21.15.137:6807/30481","heartbeat_back_addr":"172.21.15.137:6810/30481","heartbeat_front_addr":"172.21.15.137:6809/30481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.244103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.235066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.269488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.281565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.243717+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.240437+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-05-26T16:41:06.930 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 >> v1:172.21.15.137:6812/30003 conn(0x7f26d0033110 legacy=0x7f26d00355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.930 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 10 monclient: shutdown 2021-05-26T16:41:06.930 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:06.931 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 >> v1:172.21.15.3:6793/0 conn(0x7f26f0064a20 legacy=0x7f26f0144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:06.931 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 shutdown_connections 2021-05-26T16:41:06.931 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 >> 172.21.15.3:0/1861349966 conn(0x7f26f00a0db0 msgr2=0x7f26f0098790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:06.931 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 shutdown_connections 2021-05-26T16:41:06.931 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:06.925+0000 7f26f76e6700 1 -- 172.21.15.3:0/1861349966 wait complete. 2021-05-26T16:41:06.940 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-05-26T16:41:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.052+0000 7ff0de72a700 10 monclient: get_monmap_and_config 2021-05-26T16:41:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.052+0000 7ff0de72a700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.052+0000 7ff0de72a700 10 monclient: monmap: 2021-05-26T16:41:07.057 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.057 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.057 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:07.054552+0000 2021-05-26T16:41:07.057 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:07.054552+0000 2021-05-26T16:41:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.059 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.059 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.059 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.059 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.060 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.053+0000 7ff0de72a700 1 Processor -- start 2021-05-26T16:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.053+0000 7ff0de72a700 1 -- start start 2021-05-26T16:41:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.053+0000 7ff0de72a700 10 monclient: init 2021-05-26T16:41:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 10 monclient: _add_conns ranks=[7,5,6,3,2,8,4,1,0] 2021-05-26T16:41:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 10 monclient(hunting): picked mon.noname-i con 0x7ff0d8096ca0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 10 monclient(hunting): picked mon.noname-h con 0x7ff0d8099cb0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 10 monclient(hunting): picked mon.noname-d con 0x7ff0d809a130 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d8059750 con 0x7ff0d8099cb0 2021-05-26T16:41:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d8064750 con 0x7ff0d809a130 2021-05-26T16:41:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d809c7c0 con 0x7ff0d8096ca0 2021-05-26T16:41:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0de72a700 10 monclient(hunting): authenticate will time out at 824.686241s 2021-05-26T16:41:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0dccc7700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7ff0d809a130 0x7ff0d8135760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56320/0 (socket says 172.21.15.3:56320) 2021-05-26T16:41:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.054+0000 7ff0dccc7700 1 -- 172.21.15.3:0/3401528547 learned_addr learned my addr 172.21.15.3:0/3401528547 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0dccc7700 1 -- 172.21.15.3:0/3401528547 >> v1:172.21.15.3:6792/0 conn(0x7ff0d809a130 legacy=0x7ff0d8135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0d7fff700 1 -- 172.21.15.3:0/3401528547 >> v1:172.21.15.137:6792/0 conn(0x7ff0d8096ca0 legacy=0x7ff0d8064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0d77fe700 1 -- 172.21.15.3:0/3401528547 >> v1:172.21.15.137:6791/0 conn(0x7ff0d8099cb0 legacy=0x7ff0d8132030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180209832 0 0) 0x7ff0d8064750 con 0x7ff0d809a130 2021-05-26T16:41:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0d6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0d6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0d6ffd700 10 monclient(hunting): my global_id is 4218 2021-05-26T16:41:07.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.056+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0bc003270 con 0x7ff0d809a130 2021-05-26T16:41:07.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169714156 0 0) 0x7ff0d809c7c0 con 0x7ff0d8096ca0 2021-05-26T16:41:07.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient(hunting): my global_id is 4228 2021-05-26T16:41:07.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d8064750 con 0x7ff0d8096ca0 2021-05-26T16:41:07.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892636875 0 0) 0x7ff0d8059750 con 0x7ff0d8099cb0 2021-05-26T16:41:07.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient(hunting): my global_id is 4262 2021-05-26T16:41:07.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d809c7c0 con 0x7ff0d8099cb0 2021-05-26T16:41:07.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815981882 0 0) 0x7ff0bc003270 con 0x7ff0d809a130 2021-05-26T16:41:07.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 >> v1:172.21.15.137:6792/0 conn(0x7ff0d8096ca0 legacy=0x7ff0d8064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 >> v1:172.21.15.137:6791/0 conn(0x7ff0d8099cb0 legacy=0x7ff0d8132030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 monclient: found mon.noname-d 2021-05-26T16:41:07.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:07.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8097550 con 0x7ff0d809a130 2021-05-26T16:41:07.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff0cc001de0 con 0x7ff0d809a130 2021-05-26T16:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 5 monclient: authenticate success, global_id 4218 2021-05-26T16:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: dump: 2021-05-26T16:41:07.081 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.081 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.081 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.081 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.082 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.082 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.082 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.082 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.082 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.084 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.084 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:07.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff0cc0020f0 con 0x7ff0d809a130 2021-05-26T16:41:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 1 -- 172.21.15.3:0/3401528547 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff0cc004cb0 con 0x7ff0d809a130 2021-05-26T16:41:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 4 set_mon_vals no callback set 2021-05-26T16:41:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0d6ffd700 10 monclient: dump: 2021-05-26T16:41:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.089 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 10 monclient: shutdown 2021-05-26T16:41:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 1 -- 172.21.15.3:0/3401528547 >> v1:172.21.15.3:6792/0 conn(0x7ff0d809a130 legacy=0x7ff0d8135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 1 -- 172.21.15.3:0/3401528547 shutdown_connections 2021-05-26T16:41:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 1 -- 172.21.15.3:0/3401528547 >> 172.21.15.3:0/3401528547 conn(0x7ff0d809cb30 msgr2=0x7ff0d809cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 1 -- 172.21.15.3:0/3401528547 shutdown_connections 2021-05-26T16:41:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.057+0000 7ff0de72a700 1 -- 172.21.15.3:0/3401528547 wait complete. 2021-05-26T16:41:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.058+0000 7ff0de72a700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.058+0000 7ff0de72a700 10 monclient: monmap: 2021-05-26T16:41:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.095 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.058+0000 7ff0de72a700 1 Processor -- start 2021-05-26T16:41:07.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 1 -- start start 2021-05-26T16:41:07.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient: init 2021-05-26T16:41:07.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient: _add_conns ranks=[1,8,0,4,7,5,6,3,2] 2021-05-26T16:41:07.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient(hunting): picked mon.noname-f con 0x7ff0d8096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:07.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient(hunting): picked mon.noname-e con 0x7ff0d8099cb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:07.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient(hunting): picked mon.noname-a con 0x7ff0d809a130 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:07.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d809bc10 con 0x7ff0d809a130 2021-05-26T16:41:07.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d8117550 con 0x7ff0d8096ca0 2021-05-26T16:41:07.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d8119f20 con 0x7ff0d8099cb0 2021-05-26T16:41:07.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0de72a700 10 monclient(hunting): authenticate will time out at 824.691552s 2021-05-26T16:41:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0d77fe700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7ff0d8099cb0 0x7ff0d8116e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52004/0 (socket says 172.21.15.3:52004) 2021-05-26T16:41:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.059+0000 7ff0d77fe700 1 -- 172.21.15.3:0/1335419298 learned_addr learned my addr 172.21.15.3:0/1335419298 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0dccc7700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.3:6789/0 conn(0x7ff0d809a130 legacy=0x7ff0d81442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0d77fe700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.3:6793/0 conn(0x7ff0d8099cb0 legacy=0x7ff0d8116e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0d7fff700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.137:6789/0 conn(0x7ff0d8096ca0 legacy=0x7ff0d8116730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0dccc7700 1 --1- 172.21.15.3:0/1335419298 >> v1:172.21.15.3:6789/0 conn(0x7ff0d809a130 0x7ff0d81442a0 :-1 s=OPENED pgs=60 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7ff0d809bc10 auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:07.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469330398 0 0) 0x7ff0d8119f20 con 0x7ff0d8099cb0 2021-05-26T16:41:07.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0c3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0c3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0c3fff700 10 monclient(hunting): my global_id is 4247 2021-05-26T16:41:07.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.061+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b8003270 con 0x7ff0d8099cb0 2021-05-26T16:41:07.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692346821 0 0) 0x7ff0d8117550 con 0x7ff0d8096ca0 2021-05-26T16:41:07.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): my global_id is 4231 2021-05-26T16:41:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d8119f20 con 0x7ff0d8096ca0 2021-05-26T16:41:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3522155632 0 0) 0x7ff0b8003270 con 0x7ff0d8099cb0 2021-05-26T16:41:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0d8117550 con 0x7ff0d8099cb0 2021-05-26T16:41:07.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff0c4001d20 con 0x7ff0d8099cb0 2021-05-26T16:41:07.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:07.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): dump: 2021-05-26T16:41:07.103 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.103 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.103 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.103 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.103 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.106 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2935753376 0 0) 0x7ff0d8119f20 con 0x7ff0d8096ca0 2021-05-26T16:41:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0b8003270 con 0x7ff0d8096ca0 2021-05-26T16:41:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff0c8001d80 con 0x7ff0d8096ca0 2021-05-26T16:41:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient(hunting): dump: 2021-05-26T16:41:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.108 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.108 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.108 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.108 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.109 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.109 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.109 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.109 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.109 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.110 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.110 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.110 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.110 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.110 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.111 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2343917350 0 0) 0x7ff0d8117550 con 0x7ff0d8099cb0 2021-05-26T16:41:07.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.137:6789/0 conn(0x7ff0d8096ca0 legacy=0x7ff0d8116730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.3:6789/0 conn(0x7ff0d809a130 legacy=0x7ff0d81442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.111 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 monclient: found mon.e 2021-05-26T16:41:07.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d811a1c0 con 0x7ff0d8099cb0 2021-05-26T16:41:07.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770903528 0 0) 0x7ff0d809bc10 con 0x7ff0d809a130 2021-05-26T16:41:07.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0de72a700 5 monclient: authenticate success, global_id 4247 2021-05-26T16:41:07.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0de72a700 10 monclient: _renew_subs 2021-05-26T16:41:07.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0de72a700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8118040 con 0x7ff0d8099cb0 2021-05-26T16:41:07.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:07.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0de72a700 10 monclient: _renew_subs 2021-05-26T16:41:07.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0de72a700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d8118e40 con 0x7ff0d8099cb0 2021-05-26T16:41:07.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff0c4002400 con 0x7ff0d8099cb0 2021-05-26T16:41:07.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff0c40028b0 con 0x7ff0d8099cb0 2021-05-26T16:41:07.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0d67fc700 4 set_mon_vals no callback set 2021-05-26T16:41:07.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:07.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.062+0000 7ff0c3fff700 10 monclient: dump: 2021-05-26T16:41:07.116 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.116 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.117 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.117 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.117 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.117 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.118 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.118 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.118 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.118 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.118 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.119 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.119 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.119 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.119 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.119 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.063+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7ff0c4002a90 con 0x7ff0d8099cb0 2021-05-26T16:41:07.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.063+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7ff0c403d7e0 con 0x7ff0d8099cb0 2021-05-26T16:41:07.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.063+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.3:6800/30458 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0b0005340 con 0x7ff0b00015d0 2021-05-26T16:41:07.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.063+0000 7ff0dccc7700 10 monclient: get_auth_request con 0x7ff0b00015d0 auth_method 0 2021-05-26T16:41:07.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.063+0000 7ff0d7fff700 10 monclient: get_auth_request con 0x7ff0b8032f30 auth_method 0 2021-05-26T16:41:07.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.068+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== osd.0 v1:172.21.15.3:6800/30458 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23336 (unknown 0 0 3933607479) 0x7ff0b0005340 con 0x7ff0b00015d0 2021-05-26T16:41:07.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.082+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 --> v1:172.21.15.3:6800/30458 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff0b0006c60 con 0x7ff0b00015d0 2021-05-26T16:41:07.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0c3fff700 1 -- 172.21.15.3:0/1335419298 <== osd.0 v1:172.21.15.3:6800/30458 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7ff0b0006c60 con 0x7ff0b00015d0 2021-05-26T16:41:07.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.3:6800/30458 conn(0x7ff0b00015d0 legacy=0x7ff0b0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.137:6812/30003 conn(0x7ff0b8032f30 legacy=0x7ff0b80353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 10 monclient: shutdown 2021-05-26T16:41:07.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 >> v1:172.21.15.3:6793/0 conn(0x7ff0d8099cb0 legacy=0x7ff0d8116e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0dccc7700 1 -- 172.21.15.3:0/1335419298 reap_dead start 2021-05-26T16:41:07.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 shutdown_connections 2021-05-26T16:41:07.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 >> 172.21.15.3:0/1335419298 conn(0x7ff0d809cb30 msgr2=0x7ff0d809ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 shutdown_connections 2021-05-26T16:41:07.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.083+0000 7ff0de72a700 1 -- 172.21.15.3:0/1335419298 wait complete. 2021-05-26T16:41:07.126 INFO:teuthology.orchestra.run.smithi003.stdout:47244640259 2021-05-26T16:41:07.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-05-26T16:41:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.244+0000 7f5826cc4700 10 monclient: get_monmap_and_config 2021-05-26T16:41:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.244+0000 7f5826cc4700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.244+0000 7f5826cc4700 10 monclient: monmap: 2021-05-26T16:41:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:07.246385+0000 2021-05-26T16:41:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:07.246385+0000 2021-05-26T16:41:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.250 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.250 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.250 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.251 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.251 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.251 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.251 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.252 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.252 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.252 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.252 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 1 Processor -- start 2021-05-26T16:41:07.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 1 -- start start 2021-05-26T16:41:07.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient: init 2021-05-26T16:41:07.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient: _add_conns ranks=[6,0,2,1,5,7,4,8,3] 2021-05-26T16:41:07.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient(hunting): picked mon.noname-d con 0x7f5820096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:07.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient(hunting): picked mon.noname-a con 0x7f5820099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:07.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient(hunting): picked mon.noname-b con 0x7f582009a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:07.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5820059750 con 0x7f5820099db0 2021-05-26T16:41:07.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5820064620 con 0x7f582009a260 2021-05-26T16:41:07.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5820064e50 con 0x7f5820096ca0 2021-05-26T16:41:07.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.245+0000 7f5826cc4700 10 monclient(hunting): authenticate will time out at 824.877977s 2021-05-26T16:41:07.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.246+0000 7f5824a60700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f5820096ca0 0x7f5820063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56332/0 (socket says 172.21.15.3:56332) 2021-05-26T16:41:07.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.246+0000 7f5825261700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f582009a260 0x7f58201357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52974/0 (socket says 172.21.15.3:52974) 2021-05-26T16:41:07.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.246+0000 7f5824a60700 1 -- 172.21.15.3:0/187490577 learned_addr learned my addr 172.21.15.3:0/187490577 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f5825261700 1 -- 172.21.15.3:0/187490577 >> v1:172.21.15.3:6790/0 conn(0x7f582009a260 legacy=0x7f58201357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f5824a60700 1 -- 172.21.15.3:0/187490577 >> v1:172.21.15.3:6792/0 conn(0x7f5820096ca0 legacy=0x7f5820063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f5817fff700 1 -- 172.21.15.3:0/187490577 >> v1:172.21.15.3:6789/0 conn(0x7f5820099db0 legacy=0x7f5820132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176036314 0 0) 0x7f5820064e50 con 0x7f5820096ca0 2021-05-26T16:41:07.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): my global_id is 4227 2021-05-26T16:41:07.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f580c003270 con 0x7f5820096ca0 2021-05-26T16:41:07.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520070184 0 0) 0x7f5820064620 con 0x7f582009a260 2021-05-26T16:41:07.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): my global_id is 4277 2021-05-26T16:41:07.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5820064e50 con 0x7f582009a260 2021-05-26T16:41:07.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970547000 0 0) 0x7f5820059750 con 0x7f5820099db0 2021-05-26T16:41:07.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient(hunting): my global_id is 4311 2021-05-26T16:41:07.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5820064620 con 0x7f5820099db0 2021-05-26T16:41:07.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077411322 0 0) 0x7f5820064e50 con 0x7f582009a260 2021-05-26T16:41:07.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 >> v1:172.21.15.3:6792/0 conn(0x7f5820096ca0 legacy=0x7f5820063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 >> v1:172.21.15.3:6789/0 conn(0x7f5820099db0 legacy=0x7f5820132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 monclient: found mon.noname-b 2021-05-26T16:41:07.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:07.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582009c390 con 0x7f582009a260 2021-05-26T16:41:07.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f581c001de0 con 0x7f582009a260 2021-05-26T16:41:07.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:07.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient: dump: 2021-05-26T16:41:07.273 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.273 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.273 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.273 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.274 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.274 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.274 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.274 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.275 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.275 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.275 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.275 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.275 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.276 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.276 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.276 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f5826cc4700 5 monclient: authenticate success, global_id 4277 2021-05-26T16:41:07.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f5826cc4700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:07.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f581c0020f0 con 0x7f582009a260 2021-05-26T16:41:07.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.248+0000 7f58177fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:07.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 4 set_mon_vals no callback set 2021-05-26T16:41:07.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f58177fe700 1 -- 172.21.15.3:0/187490577 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f581c004bf0 con 0x7f582009a260 2021-05-26T16:41:07.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f58177fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f58177fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:07.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f58177fe700 10 monclient: dump: 2021-05-26T16:41:07.279 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.279 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.279 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.279 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.279 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.280 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.280 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.280 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.280 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.280 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.281 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.281 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.281 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.281 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.282 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.282 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 10 monclient: shutdown 2021-05-26T16:41:07.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 1 -- 172.21.15.3:0/187490577 >> v1:172.21.15.3:6790/0 conn(0x7f582009a260 legacy=0x7f58201357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 1 -- 172.21.15.3:0/187490577 shutdown_connections 2021-05-26T16:41:07.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 1 -- 172.21.15.3:0/187490577 >> 172.21.15.3:0/187490577 conn(0x7f582009cc00 msgr2=0x7f582009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 1 -- 172.21.15.3:0/187490577 shutdown_connections 2021-05-26T16:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 1 -- 172.21.15.3:0/187490577 wait complete. 2021-05-26T16:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.249+0000 7f5826cc4700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient: monmap: 2021-05-26T16:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 1 Processor -- start 2021-05-26T16:41:07.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 1 -- start start 2021-05-26T16:41:07.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient: init 2021-05-26T16:41:07.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient: _add_conns ranks=[0,3,1,5,8,7,2,4,6] 2021-05-26T16:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient(hunting): picked mon.noname-a con 0x7f5820096ca0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient(hunting): picked mon.noname-g con 0x7f5820099db0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient(hunting): picked mon.noname-f con 0x7f582009a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58201169a0 con 0x7f5820096ca0 2021-05-26T16:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5820116c40 con 0x7f582009a260 2021-05-26T16:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5820130820 con 0x7f5820099db0 2021-05-26T16:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.250+0000 7f5826cc4700 10 monclient(hunting): authenticate will time out at 824.882998s 2021-05-26T16:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.251+0000 7f5824a60700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5820096ca0 0x7f582013c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50936/0 (socket says 172.21.15.3:50936) 2021-05-26T16:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.251+0000 7f5824a60700 1 -- 172.21.15.3:0/186857639 learned_addr learned my addr 172.21.15.3:0/186857639 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5824a60700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.3:6789/0 conn(0x7f5820096ca0 legacy=0x7f582013c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717332496 0 0) 0x7f58201169a0 con 0x7f5820096ca0 2021-05-26T16:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): my global_id is 4320 2021-05-26T16:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5800003270 con 0x7f5820096ca0 2021-05-26T16:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5824a60700 1 --1- 172.21.15.3:0/186857639 >> v1:172.21.15.3:6789/0 conn(0x7f5820096ca0 0x7f582013c3c0 :-1 s=OPENED pgs=62 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7f5800003270 auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5825261700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.137:6789/0 conn(0x7f582009a260 legacy=0x7f5820144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1212686937 0 0) 0x7f5800003270 con 0x7f5820096ca0 2021-05-26T16:41:07.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58201169a0 con 0x7f5820096ca0 2021-05-26T16:41:07.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5817fff700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.137:6790/0 conn(0x7f5820099db0 legacy=0x7f5820141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5810001d90 con 0x7f5820096ca0 2021-05-26T16:41:07.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:07.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:07.294 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.294 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.294 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.294 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.295 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.295 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.295 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.295 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.295 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.296 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.296 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.296 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.296 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.296 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.297 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.297 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:07.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496023250 0 0) 0x7f5820116c40 con 0x7f582009a260 2021-05-26T16:41:07.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): my global_id is 4240 2021-05-26T16:41:07.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5800003270 con 0x7f582009a260 2021-05-26T16:41:07.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661361388 0 0) 0x7f5820130820 con 0x7f5820099db0 2021-05-26T16:41:07.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 10 monclient(hunting): my global_id is 4242 2021-05-26T16:41:07.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.253+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5820116c40 con 0x7f5820099db0 2021-05-26T16:41:07.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3316445294 0 0) 0x7f5800003270 con 0x7f582009a260 2021-05-26T16:41:07.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5820130820 con 0x7f582009a260 2021-05-26T16:41:07.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f581c001e10 con 0x7f582009a260 2021-05-26T16:41:07.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:07.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:07.301 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.301 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.301 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.301 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.301 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.302 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.302 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.302 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.302 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.302 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.303 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.303 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.303 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.303 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.303 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.304 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3726042422 0 0) 0x7f5820116c40 con 0x7f5820099db0 2021-05-26T16:41:07.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5800003270 con 0x7f5820099db0 2021-05-26T16:41:07.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5808001c70 con 0x7f5820099db0 2021-05-26T16:41:07.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:07.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:07.305 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.305 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.306 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.306 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.306 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.306 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.306 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.307 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.307 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.307 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.307 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.307 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.308 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.308 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.308 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.308 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 246330525 0 0) 0x7f5820130820 con 0x7f582009a260 2021-05-26T16:41:07.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.137:6790/0 conn(0x7f5820099db0 legacy=0x7f5820141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.3:6789/0 conn(0x7f5820096ca0 legacy=0x7f582013c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 monclient: found mon.f 2021-05-26T16:41:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:41:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582012f210 con 0x7f582009a260 2021-05-26T16:41:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5826cc4700 5 monclient: authenticate success, global_id 4240 2021-05-26T16:41:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 596177686 0 0) 0x7f58201169a0 con 0x7f5820096ca0 2021-05-26T16:41:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5826cc4700 10 monclient: _renew_subs 2021-05-26T16:41:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5826cc4700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:41:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5820129a50 con 0x7f582009a260 2021-05-26T16:41:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5826cc4700 10 monclient: _renew_subs 2021-05-26T16:41:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5826cc4700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:41:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f582013cc90 con 0x7f582009a260 2021-05-26T16:41:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f581c0018c0 con 0x7f582009a260 2021-05-26T16:41:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f581c0051e0 con 0x7f582009a260 2021-05-26T16:41:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5816ffd700 4 set_mon_vals no callback set 2021-05-26T16:41:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.254+0000 7f5814ff9700 10 monclient: dump: 2021-05-26T16:41:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.315 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.315 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.315 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.315 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.317 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5826cc4700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:41:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.137:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57f8000f20 con 0x7f582009a260 2021-05-26T16:41:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f581c0053c0 con 0x7f582009a260 2021-05-26T16:41:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f581c03db10 con 0x7f582009a260 2021-05-26T16:41:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.3:6804/30459 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f580003dd90 con 0x7f580003a0c0 2021-05-26T16:41:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== mon.1 v1:172.21.15.137:6789/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f581c03df80 con 0x7f582009a260 2021-05-26T16:41:07.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5814ff9700 10 monclient: handle_get_version_reply finishing 1 version 15 2021-05-26T16:41:07.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5824a60700 10 monclient: get_auth_request con 0x7f58000333a0 auth_method 0 2021-05-26T16:41:07.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.255+0000 7f5817fff700 10 monclient: get_auth_request con 0x7f580003a0c0 auth_method 0 2021-05-26T16:41:07.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.260+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== osd.1 v1:172.21.15.3:6804/30459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23336 (unknown 0 0 3933607479) 0x7f580003dd90 con 0x7f580003a0c0 2021-05-26T16:41:07.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 --> v1:172.21.15.3:6804/30459 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57f80028a0 con 0x7f580003a0c0 2021-05-26T16:41:07.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5814ff9700 1 -- 172.21.15.3:0/186857639 <== osd.1 v1:172.21.15.3:6804/30459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7f57f80028a0 con 0x7f580003a0c0 2021-05-26T16:41:07.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.3:6804/30459 conn(0x7f580003a0c0 legacy=0x7f580003c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.137:6812/30003 conn(0x7f58000333a0 legacy=0x7f5800035860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 10 monclient: shutdown 2021-05-26T16:41:07.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 >> v1:172.21.15.137:6789/0 conn(0x7f582009a260 legacy=0x7f5820144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5825261700 1 -- 172.21.15.3:0/186857639 reap_dead start 2021-05-26T16:41:07.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 shutdown_connections 2021-05-26T16:41:07.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 >> 172.21.15.3:0/186857639 conn(0x7f582009cc00 msgr2=0x7f5820098c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 shutdown_connections 2021-05-26T16:41:07.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.275+0000 7f5826cc4700 1 -- 172.21.15.3:0/186857639 wait complete. 2021-05-26T16:41:07.324 INFO:teuthology.orchestra.run.smithi003.stdout:47244640259 2021-05-26T16:41:07.325 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-05-26T16:41:07.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.437+0000 7fb643038700 10 monclient: get_monmap_and_config 2021-05-26T16:41:07.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.437+0000 7fb643038700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.437+0000 7fb643038700 10 monclient: monmap: 2021-05-26T16:41:07.442 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.442 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.442 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:07.439453+0000 2021-05-26T16:41:07.442 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:07.439453+0000 2021-05-26T16:41:07.442 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.443 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.443 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.443 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.443 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.444 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.444 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.444 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.444 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.444 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.445 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.445 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.438+0000 7fb643038700 1 Processor -- start 2021-05-26T16:41:07.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.438+0000 7fb643038700 1 -- start start 2021-05-26T16:41:07.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.438+0000 7fb643038700 10 monclient: init 2021-05-26T16:41:07.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 10 monclient: _add_conns ranks=[3,2,5,7,0,8,6,1,4] 2021-05-26T16:41:07.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 10 monclient(hunting): picked mon.noname-g con 0x7fb63c096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:07.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 10 monclient(hunting): picked mon.noname-b con 0x7fb63c099db0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:07.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 10 monclient(hunting): picked mon.noname-h con 0x7fb63c09a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:07.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c059750 con 0x7fb63c099db0 2021-05-26T16:41:07.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c064620 con 0x7fb63c096ca0 2021-05-26T16:41:07.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c064e50 con 0x7fb63c09a260 2021-05-26T16:41:07.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb643038700 10 monclient(hunting): authenticate will time out at 825.071213s 2021-05-26T16:41:07.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb633fff700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fb63c099db0 0x7fb63c132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52988/0 (socket says 172.21.15.3:52988) 2021-05-26T16:41:07.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.439+0000 7fb633fff700 1 -- 172.21.15.3:0/850287607 learned_addr learned my addr 172.21.15.3:0/850287607 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb633fff700 1 -- 172.21.15.3:0/850287607 >> v1:172.21.15.3:6790/0 conn(0x7fb63c099db0 legacy=0x7fb63c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474700993 0 0) 0x7fb63c059750 con 0x7fb63c099db0 2021-05-26T16:41:07.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient(hunting): my global_id is 4286 2021-05-26T16:41:07.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb628003270 con 0x7fb63c099db0 2021-05-26T16:41:07.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6415d5700 1 -- 172.21.15.3:0/850287607 >> v1:172.21.15.137:6791/0 conn(0x7fb63c09a260 legacy=0x7fb63c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb640dd4700 1 -- 172.21.15.3:0/850287607 >> v1:172.21.15.137:6790/0 conn(0x7fb63c096ca0 legacy=0x7fb63c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2213093217 0 0) 0x7fb628003270 con 0x7fb63c099db0 2021-05-26T16:41:07.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 >> v1:172.21.15.137:6791/0 conn(0x7fb63c09a260 legacy=0x7fb63c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 >> v1:172.21.15.137:6790/0 conn(0x7fb63c096ca0 legacy=0x7fb63c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 monclient: found mon.noname-b 2021-05-26T16:41:07.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:07.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c09c390 con 0x7fb63c099db0 2021-05-26T16:41:07.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb643038700 5 monclient: authenticate success, global_id 4286 2021-05-26T16:41:07.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb624001a50 con 0x7fb63c099db0 2021-05-26T16:41:07.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:07.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.441+0000 7fb6337fe700 10 monclient: dump: 2021-05-26T16:41:07.463 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.463 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.464 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.464 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.464 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.464 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.464 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.466 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:07.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb624001d60 con 0x7fb63c099db0 2021-05-26T16:41:07.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb6337fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb6337fe700 1 -- 172.21.15.3:0/850287607 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb624004930 con 0x7fb63c099db0 2021-05-26T16:41:07.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:07.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 4 set_mon_vals no callback set 2021-05-26T16:41:07.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb6337fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb6337fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:07.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb6337fe700 10 monclient: dump: 2021-05-26T16:41:07.469 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.469 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.469 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.469 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.469 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.470 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.470 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.470 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.470 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.472 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 10 monclient: shutdown 2021-05-26T16:41:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 1 -- 172.21.15.3:0/850287607 >> v1:172.21.15.3:6790/0 conn(0x7fb63c099db0 legacy=0x7fb63c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 1 -- 172.21.15.3:0/850287607 shutdown_connections 2021-05-26T16:41:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 1 -- 172.21.15.3:0/850287607 >> 172.21.15.3:0/850287607 conn(0x7fb63c09cc00 msgr2=0x7fb63c09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 1 -- 172.21.15.3:0/850287607 shutdown_connections 2021-05-26T16:41:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.442+0000 7fb643038700 1 -- 172.21.15.3:0/850287607 wait complete. 2021-05-26T16:41:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.443+0000 7fb643038700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.443+0000 7fb643038700 10 monclient: monmap: 2021-05-26T16:41:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.477 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.477 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.477 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.477 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.443+0000 7fb643038700 1 Processor -- start 2021-05-26T16:41:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.443+0000 7fb643038700 1 -- start start 2021-05-26T16:41:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.443+0000 7fb643038700 10 monclient: init 2021-05-26T16:41:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 10 monclient: _add_conns ranks=[7,8,2,5,1,4,3,6,0] 2021-05-26T16:41:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 10 monclient(hunting): picked mon.noname-i con 0x7fb63c096ca0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 10 monclient(hunting): picked mon.noname-e con 0x7fb63c099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 10 monclient(hunting): picked mon.noname-b con 0x7fb63c09a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c116930 con 0x7fb63c09a260 2021-05-26T16:41:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c116bd0 con 0x7fb63c096ca0 2021-05-26T16:41:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c116e70 con 0x7fb63c099db0 2021-05-26T16:41:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb643038700 10 monclient(hunting): authenticate will time out at 825.076222s 2021-05-26T16:41:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb6415d5700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fb63c09a260 0x7fb63c144d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:52998/0 (socket says 172.21.15.3:52998) 2021-05-26T16:41:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.444+0000 7fb6415d5700 1 -- 172.21.15.3:0/3580293941 learned_addr learned my addr 172.21.15.3:0/3580293941 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb633fff700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.3:6793/0 conn(0x7fb63c099db0 legacy=0x7fb63c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb6415d5700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.3:6790/0 conn(0x7fb63c09a260 legacy=0x7fb63c144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130046804 0 0) 0x7fb63c116e70 con 0x7fb63c099db0 2021-05-26T16:41:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): my global_id is 4256 2021-05-26T16:41:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb61c003270 con 0x7fb63c099db0 2021-05-26T16:41:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184086896 0 0) 0x7fb63c116930 con 0x7fb63c09a260 2021-05-26T16:41:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): my global_id is 4295 2021-05-26T16:41:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb63c116e70 con 0x7fb63c09a260 2021-05-26T16:41:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb640dd4700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.137:6792/0 conn(0x7fb63c096ca0 legacy=0x7fb63c1296d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2407752430 0 0) 0x7fb61c003270 con 0x7fb63c099db0 2021-05-26T16:41:07.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb63c116930 con 0x7fb63c099db0 2021-05-26T16:41:07.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 738985677 0 0) 0x7fb63c116e70 con 0x7fb63c09a260 2021-05-26T16:41:07.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb61c003270 con 0x7fb63c09a260 2021-05-26T16:41:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322820908 0 0) 0x7fb63c116bd0 con 0x7fb63c096ca0 2021-05-26T16:41:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 10 monclient(hunting): my global_id is 4237 2021-05-26T16:41:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.446+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb63c116e70 con 0x7fb63c096ca0 2021-05-26T16:41:07.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb624004870 con 0x7fb63c099db0 2021-05-26T16:41:07.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:07.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:07.486 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.490 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb638002020 con 0x7fb63c09a260 2021-05-26T16:41:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:07.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:07.491 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.491 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.491 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.494 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.494 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.494 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 553598313 0 0) 0x7fb63c116930 con 0x7fb63c099db0 2021-05-26T16:41:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.137:6792/0 conn(0x7fb63c096ca0 legacy=0x7fb63c1296d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.3:6790/0 conn(0x7fb63c09a260 legacy=0x7fb63c144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 monclient: found mon.e 2021-05-26T16:41:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c117110 con 0x7fb63c099db0 2021-05-26T16:41:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb643038700 5 monclient: authenticate success, global_id 4256 2021-05-26T16:41:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb643038700 10 monclient: _renew_subs 2021-05-26T16:41:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb643038700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c095380 con 0x7fb63c099db0 2021-05-26T16:41:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb643038700 10 monclient: _renew_subs 2021-05-26T16:41:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb643038700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c12a020 con 0x7fb63c099db0 2021-05-26T16:41:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb624001d60 con 0x7fb63c099db0 2021-05-26T16:41:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb6240049d0 con 0x7fb63c099db0 2021-05-26T16:41:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb632ffd700 4 set_mon_vals no callback set 2021-05-26T16:41:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 10 monclient: dump: 2021-05-26T16:41:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.501 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.501 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.501 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.501 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.503 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.447+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fb62400e630 con 0x7fb63c099db0 2021-05-26T16:41:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb643038700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6793/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb614000f20 con 0x7fb63c099db0 2021-05-26T16:41:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fb62403d810 con 0x7fb63c099db0 2021-05-26T16:41:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6807/30460 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb61c03dc20 con 0x7fb61c039f50 2021-05-26T16:41:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7fb6240132c0 con 0x7fb63c099db0 2021-05-26T16:41:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb630ff9700 10 monclient: handle_get_version_reply finishing 1 version 15 2021-05-26T16:41:07.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb640dd4700 10 monclient: get_auth_request con 0x7fb61c033090 auth_method 0 2021-05-26T16:41:07.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.448+0000 7fb6415d5700 10 monclient: get_auth_request con 0x7fb61c039f50 auth_method 0 2021-05-26T16:41:07.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.453+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== osd.2 v1:172.21.15.3:6807/30460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23336 (unknown 0 0 3933607479) 0x7fb61c03dc20 con 0x7fb61c039f50 2021-05-26T16:41:07.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.467+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 --> v1:172.21.15.3:6807/30460 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6140028a0 con 0x7fb61c039f50 2021-05-26T16:41:07.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb630ff9700 1 -- 172.21.15.3:0/3580293941 <== osd.2 v1:172.21.15.3:6807/30460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 654699149) 0x7fb6140028a0 con 0x7fb61c039f50 2021-05-26T16:41:07.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.3:6807/30460 conn(0x7fb61c039f50 legacy=0x7fb61c03c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.137:6812/30003 conn(0x7fb61c033090 legacy=0x7fb61c035550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 10 monclient: shutdown 2021-05-26T16:41:07.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 >> v1:172.21.15.3:6793/0 conn(0x7fb63c099db0 legacy=0x7fb63c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb6415d5700 1 -- 172.21.15.3:0/3580293941 reap_dead start 2021-05-26T16:41:07.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 shutdown_connections 2021-05-26T16:41:07.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 >> 172.21.15.3:0/3580293941 conn(0x7fb63c09cc00 msgr2=0x7fb63c098c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 shutdown_connections 2021-05-26T16:41:07.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.468+0000 7fb643038700 1 -- 172.21.15.3:0/3580293941 wait complete. 2021-05-26T16:41:07.510 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:07.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-05-26T16:41:07.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.624+0000 7f7f55547700 10 monclient: get_monmap_and_config 2021-05-26T16:41:07.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.624+0000 7f7f55547700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.624+0000 7f7f55547700 10 monclient: monmap: 2021-05-26T16:41:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:07.625796+0000 2021-05-26T16:41:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:07.625796+0000 2021-05-26T16:41:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.631 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.631 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.631 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.631 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.632 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.632 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.632 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.624+0000 7f7f55547700 1 Processor -- start 2021-05-26T16:41:07.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.624+0000 7f7f55547700 1 -- start start 2021-05-26T16:41:07.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.624+0000 7f7f55547700 10 monclient: init 2021-05-26T16:41:07.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 10 monclient: _add_conns ranks=[8,3,6,5,7,0,4,1,2] 2021-05-26T16:41:07.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 10 monclient(hunting): picked mon.noname-e con 0x7f7f50064aa0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:07.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 10 monclient(hunting): picked mon.noname-g con 0x7f7f50099c40 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:07.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 10 monclient(hunting): picked mon.noname-d con 0x7f7f5009a0c0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:07.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f50059750 con 0x7f7f50099c40 2021-05-26T16:41:07.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5009a530 con 0x7f7f5009a0c0 2021-05-26T16:41:07.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5009c4e0 con 0x7f7f50064aa0 2021-05-26T16:41:07.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f55547700 10 monclient(hunting): authenticate will time out at 825.257280s 2021-05-26T16:41:07.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f4f7fe700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f7f5009a0c0 0x7f7f501357a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56374/0 (socket says 172.21.15.3:56374) 2021-05-26T16:41:07.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f4f7fe700 1 -- 172.21.15.3:0/301989707 learned_addr learned my addr 172.21.15.3:0/301989707 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.625+0000 7f7f4effd700 1 --1- 172.21.15.3:0/301989707 >> v1:172.21.15.3:6793/0 conn(0x7f7f50064aa0 0x7f7f50063f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52050/0 (socket says 172.21.15.3:52050) 2021-05-26T16:41:07.646 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4effd700 1 -- 172.21.15.3:0/301989707 >> v1:172.21.15.3:6793/0 conn(0x7f7f50064aa0 legacy=0x7f7f50063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.646 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4f7fe700 1 -- 172.21.15.3:0/301989707 >> v1:172.21.15.3:6792/0 conn(0x7f7f5009a0c0 legacy=0x7f7f501357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.646 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164335378 0 0) 0x7f7f5009c4e0 con 0x7f7f50064aa0 2021-05-26T16:41:07.646 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): my global_id is 4265 2021-05-26T16:41:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f3c003270 con 0x7f7f50064aa0 2021-05-26T16:41:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4e7fc700 1 -- 172.21.15.3:0/301989707 >> v1:172.21.15.137:6790/0 conn(0x7f7f50099c40 legacy=0x7f7f50132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991309471 0 0) 0x7f7f400017d0 con 0x7f7f5009a0c0 2021-05-26T16:41:07.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): my global_id is 4236 2021-05-26T16:41:07.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f5009c4e0 con 0x7f7f5009a0c0 2021-05-26T16:41:07.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607730862 0 0) 0x7f7f50059750 con 0x7f7f50099c40 2021-05-26T16:41:07.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 10 monclient(hunting): my global_id is 4260 2021-05-26T16:41:07.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f400017d0 con 0x7f7f50099c40 2021-05-26T16:41:07.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.627+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1498774724 0 0) 0x7f7f3c003270 con 0x7f7f50064aa0 2021-05-26T16:41:07.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 >> v1:172.21.15.3:6792/0 conn(0x7f7f5009a0c0 legacy=0x7f7f501357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 >> v1:172.21.15.137:6790/0 conn(0x7f7f50099c40 legacy=0x7f7f50132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 1 monclient: found mon.noname-e 2021-05-26T16:41:07.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:07.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5009c780 con 0x7f7f50064aa0 2021-05-26T16:41:07.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 5 monclient: authenticate success, global_id 4265 2021-05-26T16:41:07.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7f38001a60 con 0x7f7f50064aa0 2021-05-26T16:41:07.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:07.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: dump: 2021-05-26T16:41:07.653 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.653 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.654 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.654 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.654 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.654 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.654 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.655 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.655 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.655 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.655 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.656 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.656 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.656 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.656 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.656 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:07.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7f38001d70 con 0x7f7f50064aa0 2021-05-26T16:41:07.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:07.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 1 -- 172.21.15.3:0/301989707 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7f38004870 con 0x7f7f50064aa0 2021-05-26T16:41:07.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 4 set_mon_vals no callback set 2021-05-26T16:41:07.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:07.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f4dffb700 10 monclient: dump: 2021-05-26T16:41:07.659 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.659 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.659 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.659 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.660 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.660 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.660 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.660 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.660 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.661 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.661 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.661 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.661 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.661 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.662 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.662 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 10 monclient: shutdown 2021-05-26T16:41:07.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 1 -- 172.21.15.3:0/301989707 >> v1:172.21.15.3:6793/0 conn(0x7f7f50064aa0 legacy=0x7f7f50063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 1 -- 172.21.15.3:0/301989707 shutdown_connections 2021-05-26T16:41:07.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 1 -- 172.21.15.3:0/301989707 >> 172.21.15.3:0/301989707 conn(0x7f7f5005e1e0 msgr2=0x7f7f5009cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 1 -- 172.21.15.3:0/301989707 shutdown_connections 2021-05-26T16:41:07.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.628+0000 7f7f55547700 1 -- 172.21.15.3:0/301989707 wait complete. 2021-05-26T16:41:07.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.629+0000 7f7f55547700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.629+0000 7f7f55547700 10 monclient: monmap: 2021-05-26T16:41:07.664 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.664 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:07.665 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:07.665 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:07.665 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.665 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.666 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.666 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.666 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.666 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.666 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.667 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.667 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.667 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.667 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.668 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.629+0000 7f7f55547700 1 Processor -- start 2021-05-26T16:41:07.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.629+0000 7f7f55547700 1 -- start start 2021-05-26T16:41:07.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.629+0000 7f7f55547700 10 monclient: init 2021-05-26T16:41:07.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 10 monclient: _add_conns ranks=[6,5,0,4,8,2,7,1,3] 2021-05-26T16:41:07.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 10 monclient(hunting): picked mon.noname-d con 0x7f7f50099c40 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:07.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 10 monclient(hunting): picked mon.noname-h con 0x7f7f5009a0c0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:07.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 10 monclient(hunting): picked mon.noname-a con 0x7f7f50117920 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:07.670 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f50116a70 con 0x7f7f50117920 2021-05-26T16:41:07.670 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f50116d10 con 0x7f7f5009a0c0 2021-05-26T16:41:07.670 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f50116fb0 con 0x7f7f50099c40 2021-05-26T16:41:07.670 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.670 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f55547700 10 monclient(hunting): authenticate will time out at 825.262375s 2021-05-26T16:41:07.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f4effd700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f7f50099c40 0x7f7f501294e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56376/0 (socket says 172.21.15.3:56376) 2021-05-26T16:41:07.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.630+0000 7f7f4effd700 1 -- 172.21.15.3:0/3993816965 learned_addr learned my addr 172.21.15.3:0/3993816965 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f4effd700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.3:6792/0 conn(0x7f7f50099c40 legacy=0x7f7f501294e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f4f7fe700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.3:6789/0 conn(0x7f7f50117920 legacy=0x7f7f501445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f4e7fc700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.137:6791/0 conn(0x7f7f5009a0c0 legacy=0x7f7f50140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90966493 0 0) 0x7f7f50116fb0 con 0x7f7f50099c40 2021-05-26T16:41:07.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): my global_id is 4245 2021-05-26T16:41:07.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f30003270 con 0x7f7f50099c40 2021-05-26T16:41:07.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402555326 0 0) 0x7f7f50116a70 con 0x7f7f50117920 2021-05-26T16:41:07.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): my global_id is 4329 2021-05-26T16:41:07.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f50116fb0 con 0x7f7f50117920 2021-05-26T16:41:07.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455579160 0 0) 0x7f7f50116d10 con 0x7f7f5009a0c0 2021-05-26T16:41:07.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 10 monclient(hunting): my global_id is 4280 2021-05-26T16:41:07.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.632+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f50116a70 con 0x7f7f5009a0c0 2021-05-26T16:41:07.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1145272302 0 0) 0x7f7f30003270 con 0x7f7f50099c40 2021-05-26T16:41:07.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f50116d10 con 0x7f7f50099c40 2021-05-26T16:41:07.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1867088825 0 0) 0x7f7f50116fb0 con 0x7f7f50117920 2021-05-26T16:41:07.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f30003270 con 0x7f7f50117920 2021-05-26T16:41:07.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7f38004870 con 0x7f7f50099c40 2021-05-26T16:41:07.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:07.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient(hunting): dump: 2021-05-26T16:41:07.677 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.677 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.677 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.677 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.678 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.678 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.678 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.678 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.678 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.679 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.679 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.679 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.679 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.680 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.680 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.680 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:07.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7f400048b0 con 0x7f7f50117920 2021-05-26T16:41:07.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:07.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient(hunting): dump: 2021-05-26T16:41:07.681 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.681 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.682 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.682 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.682 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.682 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.683 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.683 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.683 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.683 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.683 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.684 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.684 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.684 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.684 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.684 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1432208194 0 0) 0x7f7f50116a70 con 0x7f7f5009a0c0 2021-05-26T16:41:07.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f50116fb0 con 0x7f7f5009a0c0 2021-05-26T16:41:07.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1589688677 0 0) 0x7f7f50116d10 con 0x7f7f50099c40 2021-05-26T16:41:07.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.137:6791/0 conn(0x7f7f5009a0c0 legacy=0x7f7f50140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.3:6789/0 conn(0x7f7f50117920 legacy=0x7f7f501445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 monclient: found mon.d 2021-05-26T16:41:07.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:07.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50129bf0 con 0x7f7f50099c40 2021-05-26T16:41:07.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f55547700 5 monclient: authenticate success, global_id 4245 2021-05-26T16:41:07.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f55547700 10 monclient: _renew_subs 2021-05-26T16:41:07.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f55547700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:07.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5012f290 con 0x7f7f50099c40 2021-05-26T16:41:07.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f55547700 10 monclient: _renew_subs 2021-05-26T16:41:07.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f55547700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:07.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5012e890 con 0x7f7f50099c40 2021-05-26T16:41:07.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7f38004e20 con 0x7f7f50099c40 2021-05-26T16:41:07.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7f380052d0 con 0x7f7f50099c40 2021-05-26T16:41:07.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f4d7fa700 4 set_mon_vals no callback set 2021-05-26T16:41:07.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:07.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.633+0000 7f7f36ffd700 10 monclient: dump: 2021-05-26T16:41:07.690 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.690 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.690 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.691 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.691 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.691 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.691 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.692 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.692 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.692 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.692 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.692 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.693 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.693 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.693 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.693 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f55547700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:07.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.3:6792/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f28000f20 con 0x7f7f50099c40 2021-05-26T16:41:07.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f7f3800e840 con 0x7f7f50099c40 2021-05-26T16:41:07.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f7f3803d980 con 0x7f7f50099c40 2021-05-26T16:41:07.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.137:6800/30479 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f3003df30 con 0x7f7f3003a260 2021-05-26T16:41:07.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f7f3803ddf0 con 0x7f7f50099c40 2021-05-26T16:41:07.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f36ffd700 10 monclient: handle_get_version_reply finishing 1 version 15 2021-05-26T16:41:07.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f4e7fc700 10 monclient: get_auth_request con 0x7f7f30033320 auth_method 0 2021-05-26T16:41:07.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.634+0000 7f7f4f7fe700 10 monclient: get_auth_request con 0x7f7f3003a260 auth_method 0 2021-05-26T16:41:07.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.640+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== osd.3 v1:172.21.15.137:6800/30479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23336 (unknown 0 0 3933607479) 0x7f7f3003df30 con 0x7f7f3003a260 2021-05-26T16:41:07.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.654+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 --> v1:172.21.15.137:6800/30479 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f280028a0 con 0x7f7f3003a260 2021-05-26T16:41:07.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f36ffd700 1 -- 172.21.15.3:0/3993816965 <== osd.3 v1:172.21.15.137:6800/30479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 654699149) 0x7f7f280028a0 con 0x7f7f3003a260 2021-05-26T16:41:07.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.137:6800/30479 conn(0x7f7f3003a260 legacy=0x7f7f3003c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.137:6812/30003 conn(0x7f7f30033320 legacy=0x7f7f300357e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 10 monclient: shutdown 2021-05-26T16:41:07.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 >> v1:172.21.15.3:6792/0 conn(0x7f7f50099c40 legacy=0x7f7f501294e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f4f7fe700 1 -- 172.21.15.3:0/3993816965 reap_dead start 2021-05-26T16:41:07.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 shutdown_connections 2021-05-26T16:41:07.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 >> 172.21.15.3:0/3993816965 conn(0x7f7f50064aa0 msgr2=0x7f7f5009f610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 shutdown_connections 2021-05-26T16:41:07.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.655+0000 7f7f55547700 1 -- 172.21.15.3:0/3993816965 wait complete. 2021-05-26T16:41:07.700 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:07.701 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-05-26T16:41:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.813+0000 7fef7e02c700 10 monclient: get_monmap_and_config 2021-05-26T16:41:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.813+0000 7fef7e02c700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.813+0000 7fef7e02c700 10 monclient: monmap: 2021-05-26T16:41:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.818 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.818 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:07.815345+0000 2021-05-26T16:41:07.818 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:07.815345+0000 2021-05-26T16:41:07.818 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.820 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.820 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.820 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.820 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.820 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.821 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 1 Processor -- start 2021-05-26T16:41:07.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 1 -- start start 2021-05-26T16:41:07.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient: init 2021-05-26T16:41:07.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient: _add_conns ranks=[4,5,3,7,1,6,0,2,8] 2021-05-26T16:41:07.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient(hunting): picked mon.noname-c con 0x7fef78096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:07.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient(hunting): picked mon.noname-h con 0x7fef78099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:07.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient(hunting): picked mon.noname-g con 0x7fef7809a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:07.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef78059750 con 0x7fef7809a260 2021-05-26T16:41:07.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef78064620 con 0x7fef78096ca0 2021-05-26T16:41:07.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef78064e50 con 0x7fef78099db0 2021-05-26T16:41:07.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.814+0000 7fef7e02c700 10 monclient(hunting): authenticate will time out at 825.446991s 2021-05-26T16:41:07.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.815+0000 7fef777fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fef78096ca0 0x7fef78063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36498/0 (socket says 172.21.15.3:36498) 2021-05-26T16:41:07.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.815+0000 7fef777fe700 1 -- 172.21.15.3:0/1906334257 learned_addr learned my addr 172.21.15.3:0/1906334257 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef777fe700 1 -- 172.21.15.3:0/1906334257 >> v1:172.21.15.3:6791/0 conn(0x7fef78096ca0 legacy=0x7fef78063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef77fff700 1 -- 172.21.15.3:0/1906334257 >> v1:172.21.15.137:6790/0 conn(0x7fef7809a260 legacy=0x7fef781357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef76ffd700 1 -- 172.21.15.3:0/1906334257 >> v1:172.21.15.137:6791/0 conn(0x7fef78099db0 legacy=0x7fef78132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435714667 0 0) 0x7fef78064620 con 0x7fef78096ca0 2021-05-26T16:41:07.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): my global_id is 4234 2021-05-26T16:41:07.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef5c003270 con 0x7fef78096ca0 2021-05-26T16:41:07.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975083902 0 0) 0x7fef78059750 con 0x7fef7809a260 2021-05-26T16:41:07.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): my global_id is 4269 2021-05-26T16:41:07.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78064620 con 0x7fef7809a260 2021-05-26T16:41:07.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431998750 0 0) 0x7fef78064e50 con 0x7fef78099db0 2021-05-26T16:41:07.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient(hunting): my global_id is 4289 2021-05-26T16:41:07.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78059750 con 0x7fef78099db0 2021-05-26T16:41:07.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690383567 0 0) 0x7fef5c003270 con 0x7fef78096ca0 2021-05-26T16:41:07.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 >> v1:172.21.15.137:6791/0 conn(0x7fef78099db0 legacy=0x7fef78132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 >> v1:172.21.15.137:6790/0 conn(0x7fef7809a260 legacy=0x7fef781357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 monclient: found mon.noname-c 2021-05-26T16:41:07.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:07.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7809c390 con 0x7fef78096ca0 2021-05-26T16:41:07.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef64001a60 con 0x7fef78096ca0 2021-05-26T16:41:07.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef7e02c700 5 monclient: authenticate success, global_id 4234 2021-05-26T16:41:07.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef7e02c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:07.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:07.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: dump: 2021-05-26T16:41:07.841 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.842 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.842 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.842 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.842 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.845 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef7e02c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:07.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fef64001d70 con 0x7fef78096ca0 2021-05-26T16:41:07.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef7e02c700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:07.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 1 -- 172.21.15.3:0/1906334257 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef64004930 con 0x7fef78096ca0 2021-05-26T16:41:07.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef7e02c700 4 set_mon_vals no callback set 2021-05-26T16:41:07.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:07.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.817+0000 7fef767fc700 10 monclient: dump: 2021-05-26T16:41:07.847 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.847 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.847 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.847 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.847 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.848 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.848 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.848 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.848 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.849 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.849 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.849 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.849 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.849 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.850 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.850 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 10 monclient: shutdown 2021-05-26T16:41:07.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 1 -- 172.21.15.3:0/1906334257 >> v1:172.21.15.3:6791/0 conn(0x7fef78096ca0 legacy=0x7fef78063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 1 -- 172.21.15.3:0/1906334257 shutdown_connections 2021-05-26T16:41:07.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 1 -- 172.21.15.3:0/1906334257 >> 172.21.15.3:0/1906334257 conn(0x7fef7809cc00 msgr2=0x7fef7809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 1 -- 172.21.15.3:0/1906334257 shutdown_connections 2021-05-26T16:41:07.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 1 -- 172.21.15.3:0/1906334257 wait complete. 2021-05-26T16:41:07.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 10 monclient: build_initial_monmap 2021-05-26T16:41:07.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.818+0000 7fef7e02c700 10 monclient: monmap: 2021-05-26T16:41:07.852 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:07.852 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:07.852 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:07.853 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:07.853 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:07.853 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.853 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:07.853 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:07.854 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:07.854 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:07.854 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:07.854 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:07.854 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:07.855 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:07.855 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:07.855 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 1 Processor -- start 2021-05-26T16:41:07.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 1 -- start start 2021-05-26T16:41:07.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient: init 2021-05-26T16:41:07.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:07.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient: _add_conns ranks=[2,4,5,0,1,8,6,7,3] 2021-05-26T16:41:07.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient(hunting): picked mon.noname-b con 0x7fef78096ca0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:07.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient(hunting): picked mon.noname-c con 0x7fef78099db0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:07.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient(hunting): picked mon.noname-h con 0x7fef7809a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:07.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef78116af0 con 0x7fef78096ca0 2021-05-26T16:41:07.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef78116d20 con 0x7fef78099db0 2021-05-26T16:41:07.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef78116fc0 con 0x7fef7809a260 2021-05-26T16:41:07.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:07.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.819+0000 7fef7e02c700 10 monclient(hunting): authenticate will time out at 825.451939s 2021-05-26T16:41:07.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.820+0000 7fef76ffd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fef78099db0 0x7fef78141450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36506/0 (socket says 172.21.15.3:36506) 2021-05-26T16:41:07.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.820+0000 7fef76ffd700 1 -- 172.21.15.3:0/392295920 learned_addr learned my addr 172.21.15.3:0/392295920 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:07.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef76ffd700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.3:6791/0 conn(0x7fef78099db0 legacy=0x7fef78141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef777fe700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.3:6790/0 conn(0x7fef78096ca0 legacy=0x7fef7813c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652399474 0 0) 0x7fef78116d20 con 0x7fef78099db0 2021-05-26T16:41:07.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef77fff700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.137:6791/0 conn(0x7fef7809a260 legacy=0x7fef78144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:07.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): my global_id is 4243 2021-05-26T16:41:07.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef58003270 con 0x7fef78099db0 2021-05-26T16:41:07.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456564688 0 0) 0x7fef78116af0 con 0x7fef78096ca0 2021-05-26T16:41:07.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): my global_id is 4304 2021-05-26T16:41:07.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78116d20 con 0x7fef78096ca0 2021-05-26T16:41:07.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172528125 0 0) 0x7fef78116fc0 con 0x7fef7809a260 2021-05-26T16:41:07.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:07.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:07.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): my global_id is 4298 2021-05-26T16:41:07.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78116af0 con 0x7fef7809a260 2021-05-26T16:41:07.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2850855528 0 0) 0x7fef58003270 con 0x7fef78099db0 2021-05-26T16:41:07.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef78116fc0 con 0x7fef78099db0 2021-05-26T16:41:07.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef68001f00 con 0x7fef78099db0 2021-05-26T16:41:07.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:07.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): dump: 2021-05-26T16:41:07.864 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.864 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.864 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.865 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.865 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.865 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.865 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.865 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.866 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.866 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.866 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.866 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.866 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.867 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.867 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.867 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:07.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3074968823 0 0) 0x7fef78116d20 con 0x7fef78096ca0 2021-05-26T16:41:07.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef58003270 con 0x7fef78096ca0 2021-05-26T16:41:07.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef64004870 con 0x7fef78096ca0 2021-05-26T16:41:07.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:07.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient(hunting): dump: 2021-05-26T16:41:07.869 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.869 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.869 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.869 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.870 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.870 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.870 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.870 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.870 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.872 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 80343230 0 0) 0x7fef78116fc0 con 0x7fef78099db0 2021-05-26T16:41:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.137:6791/0 conn(0x7fef7809a260 legacy=0x7fef78144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.3:6790/0 conn(0x7fef78096ca0 legacy=0x7fef7813c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:07.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 monclient: found mon.c 2021-05-26T16:41:07.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:07.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7809bfb0 con 0x7fef78099db0 2021-05-26T16:41:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef7e02c700 5 monclient: authenticate success, global_id 4243 2021-05-26T16:41:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef7e02c700 10 monclient: _renew_subs 2021-05-26T16:41:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3320665775 0 0) 0x7fef58003270 con 0x7fef78096ca0 2021-05-26T16:41:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef7e02c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.822+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef78094e10 con 0x7fef78099db0 2021-05-26T16:41:07.876 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.823+0000 7fef7e02c700 10 monclient: _renew_subs 2021-05-26T16:41:07.876 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.823+0000 7fef7e02c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:07.876 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.823+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7813cdc0 con 0x7fef78099db0 2021-05-26T16:41:07.876 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.823+0000 7fef637fe700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.823+0000 7fef7e02c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.823+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.3:6791/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef7813d0b0 con 0x7fef78099db0 2021-05-26T16:41:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fef7813d0b0 con 0x7fef78099db0 2021-05-26T16:41:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef68002810 con 0x7fef78099db0 2021-05-26T16:41:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef75ffb700 4 set_mon_vals no callback set 2021-05-26T16:41:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 10 monclient: dump: 2021-05-26T16:41:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:07.880 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:07.880 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:07.880 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:07.880 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:07.881 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:07.881 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:07.881 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:07.881 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:07.881 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:07.882 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:07.882 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:07.882 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:07.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fef68002970 con 0x7fef78099db0 2021-05-26T16:41:07.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fef6803d6c0 con 0x7fef78099db0 2021-05-26T16:41:07.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.137:6804/30480 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef5803dc00 con 0x7fef58039f30 2021-05-26T16:41:07.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7fef6803da40 con 0x7fef78099db0 2021-05-26T16:41:07.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef637fe700 10 monclient: handle_get_version_reply finishing 1 version 15 2021-05-26T16:41:07.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef777fe700 10 monclient: get_auth_request con 0x7fef58032f70 auth_method 0 2021-05-26T16:41:07.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.824+0000 7fef77fff700 10 monclient: get_auth_request con 0x7fef58039f30 auth_method 0 2021-05-26T16:41:07.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.830+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== osd.4 v1:172.21.15.137:6804/30480 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23336 (unknown 0 0 3933607479) 0x7fef5803dc00 con 0x7fef58039f30 2021-05-26T16:41:07.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.844+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 --> v1:172.21.15.137:6804/30480 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef7806c030 con 0x7fef58039f30 2021-05-26T16:41:07.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef637fe700 1 -- 172.21.15.3:0/392295920 <== osd.4 v1:172.21.15.137:6804/30480 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 654699149) 0x7fef7806c030 con 0x7fef58039f30 2021-05-26T16:41:07.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.137:6804/30480 conn(0x7fef58039f30 legacy=0x7fef5803c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.137:6812/30003 conn(0x7fef58032f70 legacy=0x7fef58035430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 10 monclient: shutdown 2021-05-26T16:41:07.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:07.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 >> v1:172.21.15.3:6791/0 conn(0x7fef78099db0 legacy=0x7fef78141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:07.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef77fff700 1 -- 172.21.15.3:0/392295920 reap_dead start 2021-05-26T16:41:07.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 shutdown_connections 2021-05-26T16:41:07.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 >> 172.21.15.3:0/392295920 conn(0x7fef7809cc00 msgr2=0x7fef7809ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:07.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 shutdown_connections 2021-05-26T16:41:07.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:07.845+0000 7fef7e02c700 1 -- 172.21.15.3:0/392295920 wait complete. 2021-05-26T16:41:07.889 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:07.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-05-26T16:41:08.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.003+0000 7fcde334c700 10 monclient: get_monmap_and_config 2021-05-26T16:41:08.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.003+0000 7fcde334c700 10 monclient: build_initial_monmap 2021-05-26T16:41:08.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.003+0000 7fcde334c700 10 monclient: monmap: 2021-05-26T16:41:08.007 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:08.008 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.008 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:08.004854+0000 2021-05-26T16:41:08.008 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:08.004854+0000 2021-05-26T16:41:08.008 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:08.009 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.009 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:08.009 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:08.009 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:08.009 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:08.010 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:08.010 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:08.010 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:08.010 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:08.010 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:08.011 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.003+0000 7fcde334c700 1 Processor -- start 2021-05-26T16:41:08.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 1 -- start start 2021-05-26T16:41:08.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient: init 2021-05-26T16:41:08.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:08.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient: _add_conns ranks=[2,0,1,7,3,6,8,5,4] 2021-05-26T16:41:08.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient(hunting): picked mon.noname-b con 0x7fcddc096ca0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:08.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient(hunting): picked mon.noname-a con 0x7fcddc099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:08.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient(hunting): picked mon.noname-f con 0x7fcddc09a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:08.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc059750 con 0x7fcddc099db0 2021-05-26T16:41:08.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc064620 con 0x7fcddc09a260 2021-05-26T16:41:08.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc064e50 con 0x7fcddc096ca0 2021-05-26T16:41:08.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:08.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde334c700 10 monclient(hunting): authenticate will time out at 825.636585s 2021-05-26T16:41:08.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde08e7700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcddc099db0 0x7fcddc132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51002/0 (socket says 172.21.15.3:51002) 2021-05-26T16:41:08.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.004+0000 7fcde08e7700 1 -- 172.21.15.3:0/882543970 learned_addr learned my addr 172.21.15.3:0/882543970 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:08.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.006+0000 7fcde08e7700 1 -- 172.21.15.3:0/882543970 >> v1:172.21.15.3:6789/0 conn(0x7fcddc099db0 legacy=0x7fcddc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.006+0000 7fcde10e8700 1 -- 172.21.15.3:0/882543970 >> v1:172.21.15.3:6790/0 conn(0x7fcddc096ca0 legacy=0x7fcddc063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.006+0000 7fcde18e9700 1 -- 172.21.15.3:0/882543970 >> v1:172.21.15.137:6789/0 conn(0x7fcddc09a260 legacy=0x7fcddc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809913061 0 0) 0x7fcddc059750 con 0x7fcddc099db0 2021-05-26T16:41:08.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): my global_id is 4338 2021-05-26T16:41:08.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdc4003270 con 0x7fcddc099db0 2021-05-26T16:41:08.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094002034 0 0) 0x7fcddc064e50 con 0x7fcddc096ca0 2021-05-26T16:41:08.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): my global_id is 4313 2021-05-26T16:41:08.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcddc059750 con 0x7fcddc096ca0 2021-05-26T16:41:08.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786430933 0 0) 0x7fcddc064620 con 0x7fcddc09a260 2021-05-26T16:41:08.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient(hunting): my global_id is 4249 2021-05-26T16:41:08.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcddc064e50 con 0x7fcddc09a260 2021-05-26T16:41:08.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2327377656 0 0) 0x7fcdc4003270 con 0x7fcddc099db0 2021-05-26T16:41:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 >> v1:172.21.15.3:6790/0 conn(0x7fcddc096ca0 legacy=0x7fcddc063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 >> v1:172.21.15.137:6789/0 conn(0x7fcddc09a260 legacy=0x7fcddc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 monclient: found mon.noname-a 2021-05-26T16:41:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc09c390 con 0x7fcddc099db0 2021-05-26T16:41:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient: _finish_auth 0 2021-05-26T16:41:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdcc001a50 con 0x7fcddc099db0 2021-05-26T16:41:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcde334c700 5 monclient: authenticate success, global_id 4338 2021-05-26T16:41:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcde334c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient: dump: 2021-05-26T16:41:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.033 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:08.033 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.033 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:08.033 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:08.033 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:08.035 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:08.035 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcde334c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:08.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcde08e7700 1 --1- 172.21.15.3:0/882543970 >> v1:172.21.15.3:6789/0 conn(0x7fcddc099db0 0x7fcddc132080 :-1 s=OPENED pgs=64 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7fcdcc001d60 config(0 keys) v1 2021-05-26T16:41:08.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcdcc001d60 con 0x7fcddc099db0 2021-05-26T16:41:08.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcdcbfff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:08.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcde334c700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:08.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.007+0000 7fcde334c700 4 set_mon_vals no callback set 2021-05-26T16:41:08.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 10 monclient: shutdown 2021-05-26T16:41:08.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:08.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 1 -- 172.21.15.3:0/882543970 >> v1:172.21.15.3:6789/0 conn(0x7fcddc099db0 legacy=0x7fcddc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcdcbfff700 1 -- 172.21.15.3:0/882543970 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdcc004930 con 0x7fcddc099db0 2021-05-26T16:41:08.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcdcbfff700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:41:08.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 1 -- 172.21.15.3:0/882543970 shutdown_connections 2021-05-26T16:41:08.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 1 -- 172.21.15.3:0/882543970 >> 172.21.15.3:0/882543970 conn(0x7fcddc09cc00 msgr2=0x7fcddc09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:08.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 1 -- 172.21.15.3:0/882543970 shutdown_connections 2021-05-26T16:41:08.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 1 -- 172.21.15.3:0/882543970 wait complete. 2021-05-26T16:41:08.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 10 monclient: build_initial_monmap 2021-05-26T16:41:08.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 10 monclient: monmap: 2021-05-26T16:41:08.039 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:08.039 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:08.039 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:08.039 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:08.039 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:08.040 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.040 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:08.040 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:08.040 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:08.041 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:08.041 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:08.041 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:08.041 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:08.041 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:08.042 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:08.042 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.008+0000 7fcde334c700 1 Processor -- start 2021-05-26T16:41:08.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 1 -- start start 2021-05-26T16:41:08.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient: init 2021-05-26T16:41:08.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:08.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient: _add_conns ranks=[4,5,7,6,8,3,1,0,2] 2021-05-26T16:41:08.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient(hunting): picked mon.noname-c con 0x7fcddc096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:08.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient(hunting): picked mon.noname-h con 0x7fcddc099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:08.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient(hunting): picked mon.noname-i con 0x7fcddc09a260 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:08.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc116af0 con 0x7fcddc096ca0 2021-05-26T16:41:08.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc116d90 con 0x7fcddc099db0 2021-05-26T16:41:08.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc117030 con 0x7fcddc09a260 2021-05-26T16:41:08.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:08.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde334c700 10 monclient(hunting): authenticate will time out at 825.641606s 2021-05-26T16:41:08.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde10e8700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fcddc096ca0 0x7fcddc13c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36518/0 (socket says 172.21.15.3:36518) 2021-05-26T16:41:08.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.009+0000 7fcde10e8700 1 -- 172.21.15.3:0/1859064290 learned_addr learned my addr 172.21.15.3:0/1859064290 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:08.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.011+0000 7fcde10e8700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.3:6791/0 conn(0x7fcddc096ca0 legacy=0x7fcddc13c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764538471 0 0) 0x7fcddc116af0 con 0x7fcddc096ca0 2021-05-26T16:41:08.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): my global_id is 4252 2021-05-26T16:41:08.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdbc003270 con 0x7fcddc096ca0 2021-05-26T16:41:08.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde18e9700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.137:6792/0 conn(0x7fcddc09a260 legacy=0x7fcddc144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde08e7700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.137:6791/0 conn(0x7fcddc099db0 legacy=0x7fcddc141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2410437793 0 0) 0x7fcdbc003270 con 0x7fcddc096ca0 2021-05-26T16:41:08.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcddc116af0 con 0x7fcddc096ca0 2021-05-26T16:41:08.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdd0002240 con 0x7fcddc096ca0 2021-05-26T16:41:08.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:08.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:08.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): dump: 2021-05-26T16:41:08.048 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:08.048 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.049 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.049 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.049 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:08.049 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.050 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:08.050 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:08.050 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:08.050 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:08.050 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:08.051 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:08.051 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:08.051 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:08.051 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:08.051 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:08.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322402565 0 0) 0x7fcddc117030 con 0x7fcddc09a260 2021-05-26T16:41:08.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): my global_id is 4246 2021-05-26T16:41:08.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdbc003270 con 0x7fcddc09a260 2021-05-26T16:41:08.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204050968 0 0) 0x7fcddc116d90 con 0x7fcddc099db0 2021-05-26T16:41:08.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient(hunting): my global_id is 4307 2021-05-26T16:41:08.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcddc117030 con 0x7fcddc099db0 2021-05-26T16:41:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3903908424 0 0) 0x7fcddc116af0 con 0x7fcddc096ca0 2021-05-26T16:41:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.137:6792/0 conn(0x7fcddc09a260 legacy=0x7fcddc144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.137:6791/0 conn(0x7fcddc099db0 legacy=0x7fcddc141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 monclient: found mon.c 2021-05-26T16:41:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc094e60 con 0x7fcddc096ca0 2021-05-26T16:41:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:08.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:08.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde334c700 5 monclient: authenticate success, global_id 4252 2021-05-26T16:41:08.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde334c700 10 monclient: _renew_subs 2021-05-26T16:41:08.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde334c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:08.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcddc095b60 con 0x7fcddc096ca0 2021-05-26T16:41:08.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde334c700 10 monclient: _renew_subs 2021-05-26T16:41:08.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde334c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:08.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcddc13cf30 con 0x7fcddc096ca0 2021-05-26T16:41:08.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcdd0001a60 con 0x7fcddc096ca0 2021-05-26T16:41:08.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:08.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdd0002ba0 con 0x7fcddc096ca0 2021-05-26T16:41:08.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:08.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdcb7fe700 4 set_mon_vals no callback set 2021-05-26T16:41:08.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:08.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.012+0000 7fcdc97fa700 10 monclient: dump: 2021-05-26T16:41:08.059 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:08.059 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.059 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.059 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.060 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:08.060 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.060 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:08.060 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:08.060 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:08.061 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:08.061 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:08.061 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:08.061 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:08.061 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:08.062 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:08.062 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.013+0000 7fcde334c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:08.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.013+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.3:6791/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdb4000f20 con 0x7fcddc096ca0 2021-05-26T16:41:08.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.013+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fcdd000e920 con 0x7fcddc096ca0 2021-05-26T16:41:08.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.013+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fcdd003da30 con 0x7fcddc096ca0 2021-05-26T16:41:08.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.013+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.137:6805/30481 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdbc03d750 con 0x7fcdbc039a80 2021-05-26T16:41:08.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.013+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7fcdd003dea0 con 0x7fcddc096ca0 2021-05-26T16:41:08.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.013+0000 7fcdc97fa700 10 monclient: handle_get_version_reply finishing 1 version 15 2021-05-26T16:41:08.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.014+0000 7fcde08e7700 10 monclient: get_auth_request con 0x7fcdbc032ac0 auth_method 0 2021-05-26T16:41:08.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.014+0000 7fcde18e9700 10 monclient: get_auth_request con 0x7fcdbc039a80 auth_method 0 2021-05-26T16:41:08.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.019+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== osd.5 v1:172.21.15.137:6805/30481 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23336 (unknown 0 0 3933607479) 0x7fcdbc03d750 con 0x7fcdbc039a80 2021-05-26T16:41:08.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.034+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 --> v1:172.21.15.137:6805/30481 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdb40028a0 con 0x7fcdbc039a80 2021-05-26T16:41:08.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.034+0000 7fcdc97fa700 1 -- 172.21.15.3:0/1859064290 <== osd.5 v1:172.21.15.137:6805/30481 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7fcdb40028a0 con 0x7fcdbc039a80 2021-05-26T16:41:08.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.137:6805/30481 conn(0x7fcdbc039a80 legacy=0x7fcdbc03bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.137:6812/30003 conn(0x7fcdbc032ac0 legacy=0x7fcdbc034f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 10 monclient: shutdown 2021-05-26T16:41:08.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:08.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 >> v1:172.21.15.3:6791/0 conn(0x7fcddc096ca0 legacy=0x7fcddc13c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde18e9700 1 -- 172.21.15.3:0/1859064290 reap_dead start 2021-05-26T16:41:08.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 shutdown_connections 2021-05-26T16:41:08.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 >> 172.21.15.3:0/1859064290 conn(0x7fcddc09cc00 msgr2=0x7fcddc09dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:08.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 shutdown_connections 2021-05-26T16:41:08.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.035+0000 7fcde334c700 1 -- 172.21.15.3:0/1859064290 wait complete. 2021-05-26T16:41:08.069 INFO:teuthology.orchestra.run.smithi003.stdout:47244640259 2021-05-26T16:41:08.069 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-05-26T16:41:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.182+0000 7fa642ab9700 10 monclient: get_monmap_and_config 2021-05-26T16:41:08.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.182+0000 7fa642ab9700 10 monclient: build_initial_monmap 2021-05-26T16:41:08.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.182+0000 7fa642ab9700 10 monclient: monmap: 2021-05-26T16:41:08.186 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:08.186 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:08.184072+0000 2021-05-26T16:41:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:08.184072+0000 2021-05-26T16:41:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:08.189 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:08.189 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:08.189 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:08.189 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:08.190 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 1 Processor -- start 2021-05-26T16:41:08.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 1 -- start start 2021-05-26T16:41:08.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient: init 2021-05-26T16:41:08.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:08.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient: _add_conns ranks=[4,1,6,3,5,2,8,0,7] 2021-05-26T16:41:08.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient(hunting): picked mon.noname-c con 0x7fa63c12cbd0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:08.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient(hunting): picked mon.noname-f con 0x7fa63c099a30 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:08.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient(hunting): picked mon.noname-d con 0x7fa63c099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:08.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c046600 con 0x7fa63c099a30 2021-05-26T16:41:08.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c09b5e0 con 0x7fa63c12cbd0 2021-05-26T16:41:08.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c12d8f0 con 0x7fa63c099eb0 2021-05-26T16:41:08.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:08.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa642ab9700 10 monclient(hunting): authenticate will time out at 825.815810s 2021-05-26T16:41:08.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa641ab7700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fa63c12cbd0 0x7fa63c12d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36528/0 (socket says 172.21.15.3:36528) 2021-05-26T16:41:08.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa641ab7700 1 -- 172.21.15.3:0/1423278203 learned_addr learned my addr 172.21.15.3:0/1423278203 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:08.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.183+0000 7fa6422b8700 1 --1- 172.21.15.3:0/1423278203 >> v1:172.21.15.3:6792/0 conn(0x7fa63c099eb0 0x7fa63c135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56420/0 (socket says 172.21.15.3:56420) 2021-05-26T16:41:08.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa641ab7700 1 -- 172.21.15.3:0/1423278203 >> v1:172.21.15.3:6791/0 conn(0x7fa63c12cbd0 legacy=0x7fa63c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa6422b8700 1 -- 172.21.15.3:0/1423278203 >> v1:172.21.15.3:6792/0 conn(0x7fa63c099eb0 legacy=0x7fa63c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138247404 0 0) 0x7fa63c12d8f0 con 0x7fa63c099eb0 2021-05-26T16:41:08.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient(hunting): my global_id is 4254 2021-05-26T16:41:08.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa624003270 con 0x7fa63c099eb0 2021-05-26T16:41:08.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881535627 0 0) 0x7fa63c09b5e0 con 0x7fa63c12cbd0 2021-05-26T16:41:08.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient(hunting): my global_id is 4261 2021-05-26T16:41:08.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c12d8f0 con 0x7fa63c12cbd0 2021-05-26T16:41:08.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa6412b6700 1 -- 172.21.15.3:0/1423278203 >> v1:172.21.15.137:6789/0 conn(0x7fa63c099a30 legacy=0x7fa63c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164389037 0 0) 0x7fa624003270 con 0x7fa63c099eb0 2021-05-26T16:41:08.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 >> v1:172.21.15.3:6791/0 conn(0x7fa63c12cbd0 legacy=0x7fa63c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 >> v1:172.21.15.137:6789/0 conn(0x7fa63c099a30 legacy=0x7fa63c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient: _finish_hunting 0 2021-05-26T16:41:08.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 monclient: found mon.noname-d 2021-05-26T16:41:08.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:08.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:08.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c09c2b0 con 0x7fa63c099eb0 2021-05-26T16:41:08.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient: _finish_auth 0 2021-05-26T16:41:08.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:08.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa638001de0 con 0x7fa63c099eb0 2021-05-26T16:41:08.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa642ab9700 5 monclient: authenticate success, global_id 4254 2021-05-26T16:41:08.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa642ab9700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:08.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:08.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:08.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient: dump: 2021-05-26T16:41:08.210 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:08.211 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.211 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.211 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.211 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:08.211 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.212 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:08.212 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:08.212 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:08.212 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:08.212 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:08.213 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:08.213 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:08.213 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:08.213 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:08.213 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa642ab9700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:08.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa6422b8700 1 --1- 172.21.15.3:0/1423278203 >> v1:172.21.15.3:6792/0 conn(0x7fa63c099eb0 0x7fa63c135650 :-1 s=OPENED pgs=65 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7fa638004bf0 mon_map magic: 0 v1 2021-05-26T16:41:08.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa6380020f0 con 0x7fa63c099eb0 2021-05-26T16:41:08.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa640ab5700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:08.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa642ab9700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:08.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.186+0000 7fa642ab9700 4 set_mon_vals no callback set 2021-05-26T16:41:08.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 10 monclient: shutdown 2021-05-26T16:41:08.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:08.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 1 -- 172.21.15.3:0/1423278203 >> v1:172.21.15.3:6792/0 conn(0x7fa63c099eb0 legacy=0x7fa63c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa640ab5700 1 -- 172.21.15.3:0/1423278203 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa638004bf0 con 0x7fa63c099eb0 2021-05-26T16:41:08.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa640ab5700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:41:08.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 1 -- 172.21.15.3:0/1423278203 shutdown_connections 2021-05-26T16:41:08.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 1 -- 172.21.15.3:0/1423278203 >> 172.21.15.3:0/1423278203 conn(0x7fa63c0a00c0 msgr2=0x7fa63c0a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:08.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 1 -- 172.21.15.3:0/1423278203 shutdown_connections 2021-05-26T16:41:08.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 1 -- 172.21.15.3:0/1423278203 wait complete. 2021-05-26T16:41:08.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 10 monclient: build_initial_monmap 2021-05-26T16:41:08.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.187+0000 7fa642ab9700 10 monclient: monmap: 2021-05-26T16:41:08.217 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:08.218 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:08.218 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:08.218 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:08.218 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:08.218 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.221 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:08.221 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:08.221 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:08.221 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:08.221 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:08.222 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:08.222 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:08.222 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:08.222 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:08.223 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.223 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 1 Processor -- start 2021-05-26T16:41:08.223 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 1 -- start start 2021-05-26T16:41:08.223 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient: init 2021-05-26T16:41:08.223 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:08.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient: _add_conns ranks=[3,6,0,1,5,7,2,4,8] 2021-05-26T16:41:08.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient(hunting): picked mon.noname-g con 0x7fa63c099a30 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:08.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient(hunting): picked mon.noname-d con 0x7fa63c099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:08.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient(hunting): picked mon.noname-a con 0x7fa63c12cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:08.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c11a8d0 con 0x7fa63c12cbd0 2021-05-26T16:41:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c11ab70 con 0x7fa63c099a30 2021-05-26T16:41:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c12a550 con 0x7fa63c099eb0 2021-05-26T16:41:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa642ab9700 10 monclient(hunting): authenticate will time out at 825.820659s 2021-05-26T16:41:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa6412b6700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fa63c099eb0 0x7fa63c117560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56424/0 (socket says 172.21.15.3:56424) 2021-05-26T16:41:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.188+0000 7fa6412b6700 1 -- 172.21.15.3:0/1277601785 learned_addr learned my addr 172.21.15.3:0/1277601785 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.190+0000 7fa6412b6700 1 -- 172.21.15.3:0/1277601785 >> v1:172.21.15.3:6792/0 conn(0x7fa63c099eb0 legacy=0x7fa63c117560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.190+0000 7fa6422b8700 1 -- 172.21.15.3:0/1277601785 >> v1:172.21.15.3:6789/0 conn(0x7fa63c12cbd0 legacy=0x7fa63c144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667518278 0 0) 0x7fa63c12a550 con 0x7fa63c099eb0 2021-05-26T16:41:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): my global_id is 4263 2021-05-26T16:41:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa61c003270 con 0x7fa63c099eb0 2021-05-26T16:41:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444303718 0 0) 0x7fa63c11a8d0 con 0x7fa63c12cbd0 2021-05-26T16:41:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): my global_id is 4347 2021-05-26T16:41:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c12a550 con 0x7fa63c12cbd0 2021-05-26T16:41:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa641ab7700 1 -- 172.21.15.3:0/1277601785 >> v1:172.21.15.137:6790/0 conn(0x7fa63c099a30 legacy=0x7fa63c116e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:08.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 524363843 0 0) 0x7fa61c003270 con 0x7fa63c099eb0 2021-05-26T16:41:08.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa63c11a8d0 con 0x7fa63c099eb0 2021-05-26T16:41:08.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa62c001d80 con 0x7fa63c099eb0 2021-05-26T16:41:08.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:08.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:08.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:08.233 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:08.233 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.233 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.234 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.234 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:08.234 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.234 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:08.235 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:08.235 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:08.235 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:08.235 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:08.235 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:08.236 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:08.236 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:08.236 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:08.236 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1322649126 0 0) 0x7fa63c12a550 con 0x7fa63c12cbd0 2021-05-26T16:41:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa61c003270 con 0x7fa63c12cbd0 2021-05-26T16:41:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934153681 0 0) 0x7fa63c11ab70 con 0x7fa63c099a30 2021-05-26T16:41:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): my global_id is 4278 2021-05-26T16:41:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c12a550 con 0x7fa63c099a30 2021-05-26T16:41:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa638001da0 con 0x7fa63c12cbd0 2021-05-26T16:41:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:08.242 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3963710177 0 0) 0x7fa63c11a8d0 con 0x7fa63c099eb0 2021-05-26T16:41:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 >> v1:172.21.15.137:6790/0 conn(0x7fa63c099a30 legacy=0x7fa63c116e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 >> v1:172.21.15.3:6789/0 conn(0x7fa63c12cbd0 legacy=0x7fa63c144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 monclient: found mon.d 2021-05-26T16:41:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c11a010 con 0x7fa63c099eb0 2021-05-26T16:41:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa642ab9700 5 monclient: authenticate success, global_id 4263 2021-05-26T16:41:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa642ab9700 10 monclient: _renew_subs 2021-05-26T16:41:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa642ab9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c118a00 con 0x7fa63c099eb0 2021-05-26T16:41:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa62c002420 con 0x7fa63c099eb0 2021-05-26T16:41:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:08.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa62c0028d0 con 0x7fa63c099eb0 2021-05-26T16:41:08.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:08.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:08.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa629ffb700 10 monclient: dump: 2021-05-26T16:41:08.247 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:08.247 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:08.247 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.247 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:08.247 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:08.250 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa62bfff700 4 set_mon_vals no callback set 2021-05-26T16:41:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa642ab9700 10 monclient: _renew_subs 2021-05-26T16:41:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa642ab9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.191+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c119860 con 0x7fa63c099eb0 2021-05-26T16:41:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.192+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fa62c002a30 con 0x7fa63c099eb0 2021-05-26T16:41:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.192+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fa62c03d8c0 con 0x7fa63c099eb0 2021-05-26T16:41:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.192+0000 7fa641ab7700 10 monclient: get_auth_request con 0x7fa61c0331d0 auth_method 0 2021-05-26T16:41:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.192+0000 7fa642ab9700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.192+0000 7fa642ab9700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.192+0000 7fa642ab9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.192+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c06cab0 con 0x7fa63c099eb0 2021-05-26T16:41:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.197+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fa62c013530 con 0x7fa63c099eb0 2021-05-26T16:41:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.197+0000 7fa629ffb700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.197+0000 7fa629ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:08.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.358+0000 7fa642ab9700 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2021-05-26T16:41:08.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.358+0000 7fa642ab9700 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2021-05-26T16:41:08.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.358+0000 7fa642ab9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:08.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.358+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa63c06c030 con 0x7fa63c099eb0 2021-05-26T16:41:08.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.358+0000 7fa629ffb700 1 -- 172.21.15.3:0/1277601785 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 555833778) 0x7fa62c013120 con 0x7fa63c099eb0 2021-05-26T16:41:08.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.358+0000 7fa629ffb700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2021-05-26T16:41:08.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.358+0000 7fa629ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:08.363 INFO:teuthology.orchestra.run.smithi003.stdout:47244640258 2021-05-26T16:41:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 >> v1:172.21.15.137:6812/30003 conn(0x7fa61c0331d0 legacy=0x7fa61c035690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 10 monclient: shutdown 2021-05-26T16:41:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 >> v1:172.21.15.3:6792/0 conn(0x7fa63c099eb0 legacy=0x7fa63c117560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:08.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 shutdown_connections 2021-05-26T16:41:08.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 >> 172.21.15.3:0/1277601785 conn(0x7fa63c0a00c0 msgr2=0x7fa63c12bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:08.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 shutdown_connections 2021-05-26T16:41:08.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:08.360+0000 7fa642ab9700 1 -- 172.21.15.3:0/1277601785 wait complete. 2021-05-26T16:41:08.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2021-05-26T16:41:09.376 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-05-26T16:41:09.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.506+0000 7f776d847700 10 monclient: get_monmap_and_config 2021-05-26T16:41:09.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.506+0000 7f776d847700 10 monclient: build_initial_monmap 2021-05-26T16:41:09.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.506+0000 7f776d847700 10 monclient: monmap: 2021-05-26T16:41:09.510 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:09.510 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:09.507961+0000 2021-05-26T16:41:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:09.507961+0000 2021-05-26T16:41:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:09.513 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:09.513 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:09.513 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:09.513 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.506+0000 7f776d847700 1 Processor -- start 2021-05-26T16:41:09.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.506+0000 7f776d847700 1 -- start start 2021-05-26T16:41:09.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.506+0000 7f776d847700 10 monclient: init 2021-05-26T16:41:09.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:09.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 10 monclient: _add_conns ranks=[4,0,2,6,1,3,5,8,7] 2021-05-26T16:41:09.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 10 monclient(hunting): picked mon.noname-c con 0x7f7768096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:09.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 10 monclient(hunting): picked mon.noname-a con 0x7f7768099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:09.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 10 monclient(hunting): picked mon.noname-b con 0x7f776809a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:09.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7768059750 con 0x7f7768099db0 2021-05-26T16:41:09.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7768064620 con 0x7f776809a260 2021-05-26T16:41:09.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7768064e50 con 0x7f7768096ca0 2021-05-26T16:41:09.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:09.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f776d847700 10 monclient(hunting): authenticate will time out at 827.139517s 2021-05-26T16:41:09.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f7766ffd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f7768096ca0 0x7f7768063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36542/0 (socket says 172.21.15.3:36542) 2021-05-26T16:41:09.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f77677fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f776809a260 0x7f77681357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53076/0 (socket says 172.21.15.3:53076) 2021-05-26T16:41:09.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.507+0000 7f7766ffd700 1 -- 172.21.15.3:0/169701507 learned_addr learned my addr 172.21.15.3:0/169701507 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:09.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.509+0000 7f77667fc700 1 -- 172.21.15.3:0/169701507 >> v1:172.21.15.3:6789/0 conn(0x7f7768099db0 legacy=0x7f7768132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.509+0000 7f77677fe700 1 -- 172.21.15.3:0/169701507 >> v1:172.21.15.3:6790/0 conn(0x7f776809a260 legacy=0x7f77681357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.509+0000 7f7766ffd700 1 -- 172.21.15.3:0/169701507 >> v1:172.21.15.3:6791/0 conn(0x7f7768096ca0 legacy=0x7f7768063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113539116 0 0) 0x7f7768064620 con 0x7f776809a260 2021-05-26T16:41:09.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): my global_id is 4322 2021-05-26T16:41:09.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7754003270 con 0x7f776809a260 2021-05-26T16:41:09.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729945568 0 0) 0x7f7768059750 con 0x7f7768099db0 2021-05-26T16:41:09.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): my global_id is 4356 2021-05-26T16:41:09.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7768064620 con 0x7f7768099db0 2021-05-26T16:41:09.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042491288 0 0) 0x7f7768064e50 con 0x7f7768096ca0 2021-05-26T16:41:09.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient(hunting): my global_id is 4270 2021-05-26T16:41:09.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7768059750 con 0x7f7768096ca0 2021-05-26T16:41:09.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 532809542 0 0) 0x7f7768059750 con 0x7f7768096ca0 2021-05-26T16:41:09.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 >> v1:172.21.15.3:6790/0 conn(0x7f776809a260 legacy=0x7f77681357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 >> v1:172.21.15.3:6789/0 conn(0x7f7768099db0 legacy=0x7f7768132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:09.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 monclient: found mon.noname-c 2021-05-26T16:41:09.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:09.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776809c390 con 0x7f7768096ca0 2021-05-26T16:41:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f77500018b0 con 0x7f7768096ca0 2021-05-26T16:41:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f776d847700 5 monclient: authenticate success, global_id 4270 2021-05-26T16:41:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:09.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: dump: 2021-05-26T16:41:09.534 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.534 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.535 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.535 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.535 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.536 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.536 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.537 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.537 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.537 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.538 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.538 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.538 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.539 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.539 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.539 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f776d847700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:09.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7750001bc0 con 0x7f7768096ca0 2021-05-26T16:41:09.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:09.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 1 -- 172.21.15.3:0/169701507 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7750004930 con 0x7f7768096ca0 2021-05-26T16:41:09.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f776d847700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:09.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f776d847700 4 set_mon_vals no callback set 2021-05-26T16:41:09.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:09.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.510+0000 7f7765ffb700 10 monclient: dump: 2021-05-26T16:41:09.543 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.543 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.543 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.543 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.544 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.544 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.545 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.545 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.545 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.546 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.546 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.546 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.546 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.546 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.547 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.547 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 10 monclient: shutdown 2021-05-26T16:41:09.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 1 -- 172.21.15.3:0/169701507 >> v1:172.21.15.3:6791/0 conn(0x7f7768096ca0 legacy=0x7f7768063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 1 -- 172.21.15.3:0/169701507 shutdown_connections 2021-05-26T16:41:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 1 -- 172.21.15.3:0/169701507 >> 172.21.15.3:0/169701507 conn(0x7f776809cc00 msgr2=0x7f776809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 1 -- 172.21.15.3:0/169701507 shutdown_connections 2021-05-26T16:41:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 1 -- 172.21.15.3:0/169701507 wait complete. 2021-05-26T16:41:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 10 monclient: build_initial_monmap 2021-05-26T16:41:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.511+0000 7f776d847700 10 monclient: monmap: 2021-05-26T16:41:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:09.550 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:09.550 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:09.550 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:09.550 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.550 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:09.551 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:09.551 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:09.551 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:09.551 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:09.551 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:09.552 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:09.552 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:09.552 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:09.552 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 1 Processor -- start 2021-05-26T16:41:09.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 1 -- start start 2021-05-26T16:41:09.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient: init 2021-05-26T16:41:09.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:09.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient: _add_conns ranks=[4,3,5,7,6,1,2,0,8] 2021-05-26T16:41:09.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient(hunting): picked mon.noname-c con 0x7f7768096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:09.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient(hunting): picked mon.noname-g con 0x7f7768099db0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:09.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient(hunting): picked mon.noname-h con 0x7f776809a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:09.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776809bfb0 con 0x7f7768099db0 2021-05-26T16:41:09.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776809bce0 con 0x7f7768096ca0 2021-05-26T16:41:09.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776812e3e0 con 0x7f776809a260 2021-05-26T16:41:09.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:09.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f7766ffd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f7768096ca0 0x7f776812d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36548/0 (socket says 172.21.15.3:36548) 2021-05-26T16:41:09.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f7766ffd700 1 -- 172.21.15.3:0/730328608 learned_addr learned my addr 172.21.15.3:0/730328608 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:09.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.512+0000 7f776d847700 10 monclient(hunting): authenticate will time out at 827.144925s 2021-05-26T16:41:09.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f7766ffd700 1 -- 172.21.15.3:0/730328608 >> v1:172.21.15.3:6791/0 conn(0x7f7768096ca0 legacy=0x7f776812d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793254991 0 0) 0x7f776809bce0 con 0x7f7768096ca0 2021-05-26T16:41:09.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient(hunting): my global_id is 4279 2021-05-26T16:41:09.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7748003270 con 0x7f7768096ca0 2021-05-26T16:41:09.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f77677fe700 1 -- 172.21.15.3:0/730328608 >> v1:172.21.15.137:6791/0 conn(0x7f776809a260 legacy=0x7f7768144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f77667fc700 1 -- 172.21.15.3:0/730328608 >> v1:172.21.15.137:6790/0 conn(0x7f7768099db0 legacy=0x7f776812dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4052211743 0 0) 0x7f7748003270 con 0x7f7768096ca0 2021-05-26T16:41:09.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f776809bce0 con 0x7f7768096ca0 2021-05-26T16:41:09.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7750004870 con 0x7f7768096ca0 2021-05-26T16:41:09.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:09.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient(hunting): dump: 2021-05-26T16:41:09.559 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.559 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.559 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.560 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.560 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.560 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.560 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.560 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.561 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.561 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.561 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.561 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.561 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.562 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.562 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.562 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:09.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1525901203 0 0) 0x7f776809bce0 con 0x7f7768096ca0 2021-05-26T16:41:09.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 >> v1:172.21.15.137:6791/0 conn(0x7f776809a260 legacy=0x7f7768144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 >> v1:172.21.15.137:6790/0 conn(0x7f7768099db0 legacy=0x7f776812dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:09.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 monclient: found mon.c 2021-05-26T16:41:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768116b60 con 0x7f7768096ca0 2021-05-26T16:41:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient: _finish_auth 0 2021-05-26T16:41:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f776d847700 5 monclient: authenticate success, global_id 4279 2021-05-26T16:41:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f776d847700 10 monclient: _renew_subs 2021-05-26T16:41:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f776d847700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7768116e60 con 0x7f7768096ca0 2021-05-26T16:41:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f776d847700 10 monclient: _renew_subs 2021-05-26T16:41:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f776d847700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f776812fda0 con 0x7f7768096ca0 2021-05-26T16:41:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7750001d30 con 0x7f7768096ca0 2021-05-26T16:41:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f77500051e0 con 0x7f7768096ca0 2021-05-26T16:41:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f77657fa700 4 set_mon_vals no callback set 2021-05-26T16:41:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.515+0000 7f774effd700 10 monclient: dump: 2021-05-26T16:41:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.568 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.568 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.568 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.568 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.571 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.516+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f775000e750 con 0x7f7768096ca0 2021-05-26T16:41:09.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.516+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f775003d7c0 con 0x7f7768096ca0 2021-05-26T16:41:09.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.516+0000 7f77667fc700 10 monclient: get_auth_request con 0x7f7748032970 auth_method 0 2021-05-26T16:41:09.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.516+0000 7f776d847700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:09.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.516+0000 7f776d847700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:09.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.516+0000 7f776d847700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:09.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.516+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7740004db0 con 0x7f7768096ca0 2021-05-26T16:41:09.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.521+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f7750013490 con 0x7f7768096ca0 2021-05-26T16:41:09.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.521+0000 7f774effd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:09.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.521+0000 7f774effd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.681+0000 7f776d847700 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2021-05-26T16:41:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.681+0000 7f776d847700 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2021-05-26T16:41:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.681+0000 7f776d847700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.681+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7740005060 con 0x7f7768096ca0 2021-05-26T16:41:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.682+0000 7f774effd700 1 -- 172.21.15.3:0/730328608 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 1444633209) 0x7f7750013080 con 0x7f7768096ca0 2021-05-26T16:41:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.682+0000 7f774effd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2021-05-26T16:41:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.682+0000 7f774effd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:09.687 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 >> v1:172.21.15.137:6812/30003 conn(0x7f7748032970 legacy=0x7f7748034e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 10 monclient: shutdown 2021-05-26T16:41:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:09.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 >> v1:172.21.15.3:6791/0 conn(0x7f7768096ca0 legacy=0x7f776812d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 shutdown_connections 2021-05-26T16:41:09.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 >> 172.21.15.3:0/730328608 conn(0x7f776809cc00 msgr2=0x7f7768097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:09.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 shutdown_connections 2021-05-26T16:41:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.683+0000 7f776d847700 1 -- 172.21.15.3:0/730328608 wait complete. 2021-05-26T16:41:09.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.0 2021-05-26T16:41:09.698 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-05-26T16:41:09.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.811+0000 7f2144041700 10 monclient: get_monmap_and_config 2021-05-26T16:41:09.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.811+0000 7f2144041700 10 monclient: build_initial_monmap 2021-05-26T16:41:09.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.811+0000 7f2144041700 10 monclient: monmap: 2021-05-26T16:41:09.816 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:09.816 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.817 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:09.812615+0000 2021-05-26T16:41:09.817 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:09.812615+0000 2021-05-26T16:41:09.817 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:09.817 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.817 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:09.818 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:09.818 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:09.818 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:09.818 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:09.819 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:09.819 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:09.819 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:09.819 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:09.819 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.811+0000 7f2144041700 1 Processor -- start 2021-05-26T16:41:09.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.811+0000 7f2144041700 1 -- start start 2021-05-26T16:41:09.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.811+0000 7f2144041700 10 monclient: init 2021-05-26T16:41:09.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:09.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 10 monclient: _add_conns ranks=[0,7,5,3,1,6,8,2,4] 2021-05-26T16:41:09.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 10 monclient(hunting): picked mon.noname-a con 0x7f213c096ca0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:09.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 10 monclient(hunting): picked mon.noname-i con 0x7f213c099db0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 10 monclient(hunting): picked mon.noname-h con 0x7f213c09a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c059750 con 0x7f213c096ca0 2021-05-26T16:41:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c064620 con 0x7f213c09a260 2021-05-26T16:41:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c064e50 con 0x7f213c099db0 2021-05-26T16:41:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:09.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2144041700 10 monclient(hunting): authenticate will time out at 827.444233s 2021-05-26T16:41:09.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2141ddd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f213c096ca0 0x7f213c063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51044/0 (socket says 172.21.15.3:51044) 2021-05-26T16:41:09.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.812+0000 7f2141ddd700 1 -- 172.21.15.3:0/1508808197 learned_addr learned my addr 172.21.15.3:0/1508808197 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:09.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2141ddd700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.3:6789/0 conn(0x7f213c096ca0 legacy=0x7f213c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f21415dc700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6792/0 conn(0x7f213c099db0 legacy=0x7f213c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758122053 0 0) 0x7f213c059750 con 0x7f213c096ca0 2021-05-26T16:41:09.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient(hunting): my global_id is 4365 2021-05-26T16:41:09.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2124003270 con 0x7f213c096ca0 2021-05-26T16:41:09.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f21425de700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6791/0 conn(0x7f213c09a260 legacy=0x7f213c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f21415dc700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6792/0 conn(0x7f213c099db0 legacy=0x7f213c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2021-05-26T16:41:09.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f21415dc700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6792/0 conn(0x7f213c099db0 legacy=0x7f213c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:41:09.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f21415dc700 1 --1- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6792/0 conn(0x7f213c099db0 0x7f213c132080 :-1 s=OPENED pgs=57 cs=1 l=1).handle_message read tag failed 2021-05-26T16:41:09.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f21415dc700 1 --1- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6792/0 conn(0x7f213c099db0 0x7f213c132080 :-1 s=OPENED pgs=57 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:41:09.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.137:6792/0 2021-05-26T16:41:09.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944142964 0 0) 0x7f213c064620 con 0x7f213c09a260 2021-05-26T16:41:09.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient(hunting): my global_id is 4325 2021-05-26T16:41:09.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f213c059750 con 0x7f213c09a260 2021-05-26T16:41:09.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938620015 0 0) 0x7f2124003270 con 0x7f213c096ca0 2021-05-26T16:41:09.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6792/0 conn(0x7f213c099db0 legacy=0x7f213c132080 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:09.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.137:6791/0 conn(0x7f213c09a260 legacy=0x7f213c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:09.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 monclient: found mon.noname-a 2021-05-26T16:41:09.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:09.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:09.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.814+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c09c390 con 0x7f213c096ca0 2021-05-26T16:41:09.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: _finish_auth 0 2021-05-26T16:41:09.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:09.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 5 monclient: authenticate success, global_id 4365 2021-05-26T16:41:09.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2130001a50 con 0x7f213c096ca0 2021-05-26T16:41:09.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:09.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: dump: 2021-05-26T16:41:09.840 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.840 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.840 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.841 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.841 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.841 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.841 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.842 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.842 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.842 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.842 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.842 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.843 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.843 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.843 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.843 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:09.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2130001d60 con 0x7f213c096ca0 2021-05-26T16:41:09.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:09.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 1 -- 172.21.15.3:0/1508808197 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2130004930 con 0x7f213c096ca0 2021-05-26T16:41:09.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:09.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 4 set_mon_vals no callback set 2021-05-26T16:41:09.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:09.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2140ddb700 10 monclient: dump: 2021-05-26T16:41:09.846 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.846 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.846 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.847 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.847 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.847 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.847 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.847 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.848 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.848 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.848 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.848 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.848 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.849 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.849 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.849 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 10 monclient: shutdown 2021-05-26T16:41:09.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:09.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 1 -- 172.21.15.3:0/1508808197 >> v1:172.21.15.3:6789/0 conn(0x7f213c096ca0 legacy=0x7f213c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 1 -- 172.21.15.3:0/1508808197 shutdown_connections 2021-05-26T16:41:09.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 1 -- 172.21.15.3:0/1508808197 >> 172.21.15.3:0/1508808197 conn(0x7f213c09cc00 msgr2=0x7f213c09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:09.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 1 -- 172.21.15.3:0/1508808197 shutdown_connections 2021-05-26T16:41:09.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.815+0000 7f2144041700 1 -- 172.21.15.3:0/1508808197 wait complete. 2021-05-26T16:41:09.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.816+0000 7f2144041700 10 monclient: build_initial_monmap 2021-05-26T16:41:09.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.816+0000 7f2144041700 10 monclient: monmap: 2021-05-26T16:41:09.852 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:09.852 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:09.853 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:09.853 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:09.853 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:09.854 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.854 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:09.854 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:09.855 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:09.855 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:09.855 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:09.856 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:09.856 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:09.856 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:09.856 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:09.857 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.816+0000 7f2144041700 1 Processor -- start 2021-05-26T16:41:09.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.816+0000 7f2144041700 1 -- start start 2021-05-26T16:41:09.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.816+0000 7f2144041700 10 monclient: init 2021-05-26T16:41:09.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:09.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 10 monclient: _add_conns ranks=[7,8,4,1,3,6,0,2,5] 2021-05-26T16:41:09.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 10 monclient(hunting): picked mon.noname-i con 0x7f213c096ca0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:09.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 10 monclient(hunting): picked mon.noname-e con 0x7f213c099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:09.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 10 monclient(hunting): picked mon.noname-c con 0x7f213c09a260 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:09.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c116c00 con 0x7f213c09a260 2021-05-26T16:41:09.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c116e30 con 0x7f213c096ca0 2021-05-26T16:41:09.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c1170d0 con 0x7f213c099db0 2021-05-26T16:41:09.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:09.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f2144041700 10 monclient(hunting): authenticate will time out at 827.449188s 2021-05-26T16:41:09.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f21415dc700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f213c099db0 0x7f213c129930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52132/0 (socket says 172.21.15.3:52132) 2021-05-26T16:41:09.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.817+0000 7f21415dc700 1 -- 172.21.15.3:0/1198030030 learned_addr learned my addr 172.21.15.3:0/1198030030 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:09.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f21415dc700 1 -- 172.21.15.3:0/1198030030 >> v1:172.21.15.3:6793/0 conn(0x7f213c099db0 legacy=0x7f213c129930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f21425de700 1 -- 172.21.15.3:0/1198030030 >> v1:172.21.15.3:6791/0 conn(0x7f213c09a260 legacy=0x7f213c1443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338811443 0 0) 0x7f213c1170d0 con 0x7f213c099db0 2021-05-26T16:41:09.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): my global_id is 4274 2021-05-26T16:41:09.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f211c003270 con 0x7f213c099db0 2021-05-26T16:41:09.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2141ddd700 1 -- 172.21.15.3:0/1198030030 >> v1:172.21.15.137:6792/0 conn(0x7f213c096ca0 legacy=0x7f213c13c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:09.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937172994 0 0) 0x7f213c116c00 con 0x7f213c09a260 2021-05-26T16:41:09.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): my global_id is 4288 2021-05-26T16:41:09.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f213c1170d0 con 0x7f213c09a260 2021-05-26T16:41:09.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3060803803 0 0) 0x7f211c003270 con 0x7f213c099db0 2021-05-26T16:41:09.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f213c116c00 con 0x7f213c099db0 2021-05-26T16:41:09.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f212c002240 con 0x7f213c099db0 2021-05-26T16:41:09.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:09.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:09.865 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.865 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.865 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.866 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.866 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.866 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.867 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.867 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.867 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.867 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.868 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.868 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.868 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.868 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.869 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.869 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484553139 0 0) 0x7f213c116e30 con 0x7f213c096ca0 2021-05-26T16:41:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 10 monclient(hunting): my global_id is 4255 2021-05-26T16:41:09.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.819+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f211c003270 con 0x7f213c096ca0 2021-05-26T16:41:09.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2275234483 0 0) 0x7f213c1170d0 con 0x7f213c09a260 2021-05-26T16:41:09.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f213c116e30 con 0x7f213c09a260 2021-05-26T16:41:09.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2138001f70 con 0x7f213c09a260 2021-05-26T16:41:09.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:09.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:09.872 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.872 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.873 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.873 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.873 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.874 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.874 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.874 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.874 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.875 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.875 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.875 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.876 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.876 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.877 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.877 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1777544136 0 0) 0x7f213c116c00 con 0x7f213c099db0 2021-05-26T16:41:09.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 >> v1:172.21.15.137:6792/0 conn(0x7f213c096ca0 legacy=0x7f213c13c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 >> v1:172.21.15.3:6791/0 conn(0x7f213c09a260 legacy=0x7f213c1443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:09.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 monclient: found mon.e 2021-05-26T16:41:09.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:09.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:09.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c117370 con 0x7f213c099db0 2021-05-26T16:41:09.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:09.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:09.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2144041700 5 monclient: authenticate success, global_id 4274 2021-05-26T16:41:09.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2144041700 10 monclient: _renew_subs 2021-05-26T16:41:09.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2144041700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:09.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c12f6b0 con 0x7f213c099db0 2021-05-26T16:41:09.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f212c001d20 con 0x7f213c099db0 2021-05-26T16:41:09.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:09.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f212c002b40 con 0x7f213c099db0 2021-05-26T16:41:09.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:09.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:09.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2129ffb700 10 monclient: dump: 2021-05-26T16:41:09.882 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:09.883 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:09.883 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.883 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:09.883 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:09.884 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:09.884 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:09.884 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:09.884 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:09.885 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:09.885 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:09.885 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:09.885 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:09.885 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:09.886 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:09.886 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:09.886 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f212bfff700 4 set_mon_vals no callback set 2021-05-26T16:41:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2144041700 10 monclient: _renew_subs 2021-05-26T16:41:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2144041700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.820+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c12a040 con 0x7f213c099db0 2021-05-26T16:41:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.821+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f212c00e920 con 0x7f213c099db0 2021-05-26T16:41:09.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.821+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f212c03db30 con 0x7f213c099db0 2021-05-26T16:41:09.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.821+0000 7f2144041700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:09.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.821+0000 7f2144041700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:09.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.821+0000 7f2144041700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:09.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.821+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c06c030 con 0x7f213c099db0 2021-05-26T16:41:09.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.821+0000 7f2141ddd700 10 monclient: get_auth_request con 0x7f211c033000 auth_method 0 2021-05-26T16:41:09.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.825+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f212c0137b0 con 0x7f213c099db0 2021-05-26T16:41:09.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.825+0000 7f2129ffb700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:09.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.825+0000 7f2129ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:09.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.982+0000 7f2144041700 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2021-05-26T16:41:09.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.982+0000 7f2144041700 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2021-05-26T16:41:09.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.982+0000 7f2144041700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:09.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.982+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f213c06b460 con 0x7f213c099db0 2021-05-26T16:41:09.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.982+0000 7f2129ffb700 1 -- 172.21.15.3:0/1198030030 <== mon.8 v1:172.21.15.3:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 1444633209) 0x7f212c0133a0 con 0x7f213c099db0 2021-05-26T16:41:09.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.982+0000 7f2129ffb700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2021-05-26T16:41:09.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.982+0000 7f2129ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:09.988 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:09.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 >> v1:172.21.15.137:6812/30003 conn(0x7f211c033000 legacy=0x7f211c0354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 10 monclient: shutdown 2021-05-26T16:41:09.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:09.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 >> v1:172.21.15.3:6793/0 conn(0x7f213c099db0 legacy=0x7f213c129930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:09.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 shutdown_connections 2021-05-26T16:41:09.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 >> 172.21.15.3:0/1198030030 conn(0x7f213c09cc00 msgr2=0x7f213c097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:09.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 shutdown_connections 2021-05-26T16:41:09.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:09.984+0000 7f2144041700 1 -- 172.21.15.3:0/1198030030 wait complete. 2021-05-26T16:41:09.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.1 2021-05-26T16:41:09.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-05-26T16:41:10.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.111+0000 7f1788be9700 10 monclient: get_monmap_and_config 2021-05-26T16:41:10.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.111+0000 7f1788be9700 10 monclient: build_initial_monmap 2021-05-26T16:41:10.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.111+0000 7f1788be9700 10 monclient: monmap: 2021-05-26T16:41:10.115 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:10.116 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.116 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:10.113159+0000 2021-05-26T16:41:10.116 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:10.113159+0000 2021-05-26T16:41:10.116 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:10.116 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.117 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:10.117 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:10.117 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:10.117 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:10.117 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:10.118 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:10.118 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:10.118 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:10.118 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:10.119 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 1 Processor -- start 2021-05-26T16:41:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 1 -- start start 2021-05-26T16:41:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 10 monclient: init 2021-05-26T16:41:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 10 monclient: _add_conns ranks=[5,0,7,2,4,8,6,3,1] 2021-05-26T16:41:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 10 monclient(hunting): picked mon.noname-h con 0x7f17840695c0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 10 monclient(hunting): picked mon.noname-a con 0x7f17840931f0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 10 monclient(hunting): picked mon.noname-i con 0x7f17840936a0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1784046600 con 0x7f17840931f0 2021-05-26T16:41:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.112+0000 7f1788be9700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178412d380 con 0x7f17840695c0 2021-05-26T16:41:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.113+0000 7f1788be9700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1784093cc0 con 0x7f17840936a0 2021-05-26T16:41:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.113+0000 7f1788be9700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.113+0000 7f1782ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f17840931f0 0x7f1784131f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51058/0 (socket says 172.21.15.3:51058) 2021-05-26T16:41:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.113+0000 7f1788be9700 10 monclient(hunting): authenticate will time out at 827.745057s 2021-05-26T16:41:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.113+0000 7f1782ffd700 1 -- 172.21.15.3:0/2535599901 learned_addr learned my addr 172.21.15.3:0/2535599901 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:10.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f1782ffd700 1 -- 172.21.15.3:0/2535599901 >> v1:172.21.15.3:6789/0 conn(0x7f17840931f0 legacy=0x7f1784131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f1783fff700 1 -- 172.21.15.3:0/2535599901 >> v1:172.21.15.137:6792/0 conn(0x7f17840936a0 legacy=0x7f1784135660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17837fe700 1 -- 172.21.15.3:0/2535599901 >> v1:172.21.15.137:6791/0 conn(0x7f17840695c0 legacy=0x7f178412cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652095948 0 0) 0x7f1784046600 con 0x7f17840931f0 2021-05-26T16:41:10.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): my global_id is 4374 2021-05-26T16:41:10.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1768003270 con 0x7f17840931f0 2021-05-26T16:41:10.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165628023 0 0) 0x7f1784093cc0 con 0x7f17840936a0 2021-05-26T16:41:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): my global_id is 4264 2021-05-26T16:41:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1784046600 con 0x7f17840936a0 2021-05-26T16:41:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460522821 0 0) 0x7f178412d380 con 0x7f17840695c0 2021-05-26T16:41:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient(hunting): my global_id is 4334 2021-05-26T16:41:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1784093cc0 con 0x7f17840695c0 2021-05-26T16:41:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537732686 0 0) 0x7f1768003270 con 0x7f17840931f0 2021-05-26T16:41:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 >> v1:172.21.15.137:6792/0 conn(0x7f17840936a0 legacy=0x7f1784135660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 >> v1:172.21.15.137:6791/0 conn(0x7f17840695c0 legacy=0x7f178412cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 monclient: found mon.noname-a 2021-05-26T16:41:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784099380 con 0x7f17840931f0 2021-05-26T16:41:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:10.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:10.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f1788be9700 5 monclient: authenticate success, global_id 4374 2021-05-26T16:41:10.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1770001a60 con 0x7f17840931f0 2021-05-26T16:41:10.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f1788be9700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:10.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: dump: 2021-05-26T16:41:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.141 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.141 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.141 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.141 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.141 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.142 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.142 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.142 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.142 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.142 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.143 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.143 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.143 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f1788be9700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:10.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1770001d70 con 0x7f17840931f0 2021-05-26T16:41:10.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:10.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 1 -- 172.21.15.3:0/2535599901 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1770004930 con 0x7f17840931f0 2021-05-26T16:41:10.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f1788be9700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:10.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f1788be9700 4 set_mon_vals no callback set 2021-05-26T16:41:10.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:10.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.115+0000 7f17827fc700 10 monclient: dump: 2021-05-26T16:41:10.145 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.145 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.146 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.146 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.146 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.146 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.146 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.147 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.147 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.147 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.147 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.147 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.148 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.148 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.148 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.148 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 10 monclient: shutdown 2021-05-26T16:41:10.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:10.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 1 -- 172.21.15.3:0/2535599901 >> v1:172.21.15.3:6789/0 conn(0x7f17840931f0 legacy=0x7f1784131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 1 -- 172.21.15.3:0/2535599901 shutdown_connections 2021-05-26T16:41:10.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 1 -- 172.21.15.3:0/2535599901 >> 172.21.15.3:0/2535599901 conn(0x7f178409cdb0 msgr2=0x7f178409d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:10.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 1 -- 172.21.15.3:0/2535599901 shutdown_connections 2021-05-26T16:41:10.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 1 -- 172.21.15.3:0/2535599901 wait complete. 2021-05-26T16:41:10.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 10 monclient: build_initial_monmap 2021-05-26T16:41:10.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.116+0000 7f1788be9700 10 monclient: monmap: 2021-05-26T16:41:10.150 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:10.151 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:10.151 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:10.151 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:10.151 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:10.152 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.152 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:10.152 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:10.152 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:10.152 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:10.153 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:10.153 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:10.153 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:10.153 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:10.153 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:10.154 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 1 Processor -- start 2021-05-26T16:41:10.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 1 -- start start 2021-05-26T16:41:10.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient: init 2021-05-26T16:41:10.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:10.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient: _add_conns ranks=[4,3,7,2,1,5,0,8,6] 2021-05-26T16:41:10.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient(hunting): picked mon.noname-c con 0x7f17840695c0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:10.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient(hunting): picked mon.noname-g con 0x7f17840931f0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:10.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient(hunting): picked mon.noname-i con 0x7f17840936a0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:10.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1784116b30 con 0x7f17840931f0 2021-05-26T16:41:10.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1784116dd0 con 0x7f17840695c0 2021-05-26T16:41:10.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1784117070 con 0x7f17840936a0 2021-05-26T16:41:10.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:10.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.117+0000 7f1788be9700 10 monclient(hunting): authenticate will time out at 827.749923s 2021-05-26T16:41:10.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.118+0000 7f17837fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f17840695c0 0x7f1784129630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36574/0 (socket says 172.21.15.3:36574) 2021-05-26T16:41:10.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.118+0000 7f17837fe700 1 -- 172.21.15.3:0/1806336147 learned_addr learned my addr 172.21.15.3:0/1806336147 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:10.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f17837fe700 1 -- 172.21.15.3:0/1806336147 >> v1:172.21.15.3:6791/0 conn(0x7f17840695c0 legacy=0x7f1784129630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f1783fff700 1 -- 172.21.15.3:0/1806336147 >> v1:172.21.15.137:6792/0 conn(0x7f17840936a0 legacy=0x7f17841446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f1782ffd700 1 -- 172.21.15.3:0/1806336147 >> v1:172.21.15.137:6790/0 conn(0x7f17840931f0 legacy=0x7f1784140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888606668 0 0) 0x7f1784116dd0 con 0x7f17840695c0 2021-05-26T16:41:10.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): my global_id is 4297 2021-05-26T16:41:10.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1764003270 con 0x7f17840695c0 2021-05-26T16:41:10.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459912459 0 0) 0x7f1784117070 con 0x7f17840936a0 2021-05-26T16:41:10.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): my global_id is 4273 2021-05-26T16:41:10.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1784116dd0 con 0x7f17840936a0 2021-05-26T16:41:10.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379973360 0 0) 0x7f1784116b30 con 0x7f17840931f0 2021-05-26T16:41:10.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): my global_id is 4296 2021-05-26T16:41:10.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1784117070 con 0x7f17840931f0 2021-05-26T16:41:10.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 16865269 0 0) 0x7f1764003270 con 0x7f17840695c0 2021-05-26T16:41:10.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1784116b30 con 0x7f17840695c0 2021-05-26T16:41:10.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1774002240 con 0x7f17840695c0 2021-05-26T16:41:10.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:10.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): dump: 2021-05-26T16:41:10.162 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.162 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.162 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.163 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.163 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.163 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.163 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.163 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.164 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.164 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.164 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.164 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.164 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.165 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.165 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.165 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:10.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 159436379 0 0) 0x7f1784116dd0 con 0x7f17840936a0 2021-05-26T16:41:10.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1764003270 con 0x7f17840936a0 2021-05-26T16:41:10.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1778002040 con 0x7f17840936a0 2021-05-26T16:41:10.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2021-05-26T16:41:10.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): dump: 2021-05-26T16:41:10.167 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.167 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.167 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.167 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.168 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.168 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.168 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.168 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.168 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.169 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.169 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.169 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.169 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.169 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.170 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.170 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3716776526 0 0) 0x7f1784117070 con 0x7f17840931f0 2021-05-26T16:41:10.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1784116dd0 con 0x7f17840931f0 2021-05-26T16:41:10.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1770004870 con 0x7f17840931f0 2021-05-26T16:41:10.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:10.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient(hunting): dump: 2021-05-26T16:41:10.171 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.171 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.172 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.172 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.172 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.172 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.172 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.173 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.173 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.173 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.173 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.173 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.174 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.174 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.174 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.174 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1775110337 0 0) 0x7f1784116b30 con 0x7f17840695c0 2021-05-26T16:41:10.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 >> v1:172.21.15.137:6792/0 conn(0x7f17840936a0 legacy=0x7f17841446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 >> v1:172.21.15.137:6790/0 conn(0x7f17840931f0 legacy=0x7f1784140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:10.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 monclient: found mon.c 2021-05-26T16:41:10.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:10.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784114f00 con 0x7f17840695c0 2021-05-26T16:41:10.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:10.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f176f7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:10.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f1788be9700 5 monclient: authenticate success, global_id 4297 2021-05-26T16:41:10.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f1788be9700 10 monclient: _renew_subs 2021-05-26T16:41:10.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f1788be9700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.120+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784131120 con 0x7f17840695c0 2021-05-26T16:41:10.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f1788be9700 10 monclient: _renew_subs 2021-05-26T16:41:10.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f1788be9700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784129f00 con 0x7f17840695c0 2021-05-26T16:41:10.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1774001cf0 con 0x7f17840695c0 2021-05-26T16:41:10.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:10.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1774002a50 con 0x7f17840695c0 2021-05-26T16:41:10.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:10.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f1781ffb700 4 set_mon_vals no callback set 2021-05-26T16:41:10.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 10 monclient: dump: 2021-05-26T16:41:10.179 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.180 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.180 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.180 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.180 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.180 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.181 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.181 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.181 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.181 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.181 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.182 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.182 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.182 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.182 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.183 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f1774002be0 con 0x7f17840695c0 2021-05-26T16:41:10.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.121+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f177403d930 con 0x7f17840695c0 2021-05-26T16:41:10.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.122+0000 7f1782ffd700 10 monclient: get_auth_request con 0x7f17640332f0 auth_method 0 2021-05-26T16:41:10.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.122+0000 7f1788be9700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.122+0000 7f1788be9700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.122+0000 7f1788be9700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.122+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c004db0 con 0x7f17840695c0 2021-05-26T16:41:10.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.126+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f1774013600 con 0x7f17840695c0 2021-05-26T16:41:10.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.126+0000 7f176f7fe700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.126+0000 7f176f7fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:10.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.288+0000 7f1788be9700 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2021-05-26T16:41:10.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.288+0000 7f1788be9700 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2021-05-26T16:41:10.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.288+0000 7f1788be9700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.288+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f175c005060 con 0x7f17840695c0 2021-05-26T16:41:10.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.289+0000 7f176f7fe700 1 -- 172.21.15.3:0/1806336147 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 1444633209) 0x7f17740131f0 con 0x7f17840695c0 2021-05-26T16:41:10.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.289+0000 7f176f7fe700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2021-05-26T16:41:10.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.289+0000 7f176f7fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:10.294 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:10.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.290+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 >> v1:172.21.15.137:6812/30003 conn(0x7f17640332f0 legacy=0x7f17640357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.290+0000 7f1788be9700 10 monclient: shutdown 2021-05-26T16:41:10.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.290+0000 7f1788be9700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:10.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.290+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 >> v1:172.21.15.3:6791/0 conn(0x7f17840695c0 legacy=0x7f1784129630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.290+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 shutdown_connections 2021-05-26T16:41:10.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.290+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 >> 172.21.15.3:0/1806336147 conn(0x7f178409cdb0 msgr2=0x7f1784092160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:10.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.291+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 shutdown_connections 2021-05-26T16:41:10.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.291+0000 7f1788be9700 1 -- 172.21.15.3:0/1806336147 wait complete. 2021-05-26T16:41:10.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.2 2021-05-26T16:41:10.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-05-26T16:41:10.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.419+0000 7f0a25624700 10 monclient: get_monmap_and_config 2021-05-26T16:41:10.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.419+0000 7f0a25624700 10 monclient: build_initial_monmap 2021-05-26T16:41:10.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.419+0000 7f0a25624700 10 monclient: monmap: 2021-05-26T16:41:10.423 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:10.423 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.424 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:10.420653+0000 2021-05-26T16:41:10.424 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:10.420653+0000 2021-05-26T16:41:10.424 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:10.424 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.425 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:10.425 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:10.425 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:10.425 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:10.425 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:10.426 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:10.426 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:10.426 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:10.426 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:10.426 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.419+0000 7f0a25624700 1 Processor -- start 2021-05-26T16:41:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.419+0000 7f0a25624700 1 -- start start 2021-05-26T16:41:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.419+0000 7f0a25624700 10 monclient: init 2021-05-26T16:41:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 10 monclient: _add_conns ranks=[1,3,5,2,8,0,6,4,7] 2021-05-26T16:41:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 10 monclient(hunting): picked mon.noname-f con 0x7f0a20096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 10 monclient(hunting): picked mon.noname-g con 0x7f0a20099db0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 10 monclient(hunting): picked mon.noname-h con 0x7f0a2009a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a20059750 con 0x7f0a20096ca0 2021-05-26T16:41:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a20064620 con 0x7f0a20099db0 2021-05-26T16:41:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a20064e50 con 0x7f0a2009a260 2021-05-26T16:41:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a25624700 10 monclient(hunting): authenticate will time out at 828.052139s 2021-05-26T16:41:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a1effd700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0a20096ca0 0x7f0a20063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.3:46108/0 (socket says 172.21.15.3:46108) 2021-05-26T16:41:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a1e7fc700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f0a20099db0 0x7f0a20132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.3:33452/0 (socket says 172.21.15.3:33452) 2021-05-26T16:41:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a1f7fe700 1 --1- >> v1:172.21.15.137:6791/0 conn(0x7f0a2009a260 0x7f0a201357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6791/0 says I am v1:172.21.15.3:55926/0 (socket says 172.21.15.3:55926) 2021-05-26T16:41:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.420+0000 7f0a1effd700 1 -- 172.21.15.3:0/4132151054 learned_addr learned my addr 172.21.15.3:0/4132151054 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1f7fe700 1 -- 172.21.15.3:0/4132151054 >> v1:172.21.15.137:6791/0 conn(0x7f0a2009a260 legacy=0x7f0a201357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1effd700 1 -- 172.21.15.3:0/4132151054 >> v1:172.21.15.137:6789/0 conn(0x7f0a20096ca0 legacy=0x7f0a20063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1e7fc700 1 -- 172.21.15.3:0/4132151054 >> v1:172.21.15.137:6790/0 conn(0x7f0a20099db0 legacy=0x7f0a20132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788867608 0 0) 0x7f0a20064620 con 0x7f0a20099db0 2021-05-26T16:41:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): my global_id is 4305 2021-05-26T16:41:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a0c003270 con 0x7f0a20099db0 2021-05-26T16:41:10.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526904899 0 0) 0x7f0a20064e50 con 0x7f0a2009a260 2021-05-26T16:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): my global_id is 4343 2021-05-26T16:41:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a20064620 con 0x7f0a2009a260 2021-05-26T16:41:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680898324 0 0) 0x7f0a20059750 con 0x7f0a20096ca0 2021-05-26T16:41:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 10 monclient(hunting): my global_id is 4267 2021-05-26T16:41:10.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.422+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a20064e50 con 0x7f0a20096ca0 2021-05-26T16:41:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045662972 0 0) 0x7f0a0c003270 con 0x7f0a20099db0 2021-05-26T16:41:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 >> v1:172.21.15.137:6791/0 conn(0x7f0a2009a260 legacy=0x7f0a201357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.453 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 >> v1:172.21.15.137:6789/0 conn(0x7f0a20096ca0 legacy=0x7f0a20063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.453 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:10.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 monclient: found mon.noname-g 2021-05-26T16:41:10.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.137:6790/0 2021-05-26T16:41:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2009c390 con 0x7f0a20099db0 2021-05-26T16:41:10.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:10.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0a14001b20 con 0x7f0a20099db0 2021-05-26T16:41:10.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 5 monclient: authenticate success, global_id 4305 2021-05-26T16:41:10.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:41:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: dump: 2021-05-26T16:41:10.460 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.462 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.462 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.464 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.465 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.465 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.466 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.466 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.467 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.467 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.468 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.469 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:10.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 <== mon.3 v1:172.21.15.137:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0a14004530 con 0x7f0a20099db0 2021-05-26T16:41:10.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 1 -- 172.21.15.3:0/4132151054 <== mon.3 v1:172.21.15.137:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0a14004a60 con 0x7f0a20099db0 2021-05-26T16:41:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 4 set_mon_vals no callback set 2021-05-26T16:41:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:10.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a1dffb700 10 monclient: dump: 2021-05-26T16:41:10.474 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.480 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.480 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 10 monclient: shutdown 2021-05-26T16:41:10.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 1 -- 172.21.15.3:0/4132151054 >> v1:172.21.15.137:6790/0 conn(0x7f0a20099db0 legacy=0x7f0a20132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 1 -- 172.21.15.3:0/4132151054 shutdown_connections 2021-05-26T16:41:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.423+0000 7f0a25624700 1 -- 172.21.15.3:0/4132151054 >> 172.21.15.3:0/4132151054 conn(0x7f0a2009cc00 msgr2=0x7f0a2009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.424+0000 7f0a25624700 1 -- 172.21.15.3:0/4132151054 shutdown_connections 2021-05-26T16:41:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.424+0000 7f0a25624700 1 -- 172.21.15.3:0/4132151054 wait complete. 2021-05-26T16:41:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.424+0000 7f0a25624700 10 monclient: build_initial_monmap 2021-05-26T16:41:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.424+0000 7f0a25624700 10 monclient: monmap: 2021-05-26T16:41:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:10.483 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:10.483 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:10.483 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:10.483 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.483 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:10.484 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:10.484 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:10.484 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:10.484 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:10.484 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:10.485 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:10.485 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:10.485 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:10.485 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 1 Processor -- start 2021-05-26T16:41:10.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 1 -- start start 2021-05-26T16:41:10.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient: init 2021-05-26T16:41:10.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:10.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient: _add_conns ranks=[4,5,7,3,2,8,6,0,1] 2021-05-26T16:41:10.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient(hunting): picked mon.noname-c con 0x7f0a20096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:10.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient(hunting): picked mon.noname-h con 0x7f0a20099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:10.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient(hunting): picked mon.noname-i con 0x7f0a2009a260 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:10.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2011ca70 con 0x7f0a20096ca0 2021-05-26T16:41:10.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2011cd10 con 0x7f0a20099db0 2021-05-26T16:41:10.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2011cfb0 con 0x7f0a2009a260 2021-05-26T16:41:10.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:10.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a25624700 10 monclient(hunting): authenticate will time out at 828.057649s 2021-05-26T16:41:10.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a1effd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f0a20096ca0 0x7f0a2013bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36590/0 (socket says 172.21.15.3:36590) 2021-05-26T16:41:10.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.425+0000 7f0a1effd700 1 -- 172.21.15.3:0/3207900028 learned_addr learned my addr 172.21.15.3:0/3207900028 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:10.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.427+0000 7f0a1effd700 1 -- 172.21.15.3:0/3207900028 >> v1:172.21.15.3:6791/0 conn(0x7f0a20096ca0 legacy=0x7f0a2013bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.428+0000 7f0a1e7fc700 1 -- 172.21.15.3:0/3207900028 >> v1:172.21.15.137:6791/0 conn(0x7f0a20099db0 legacy=0x7f0a2013c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.428+0000 7f0a1f7fe700 1 -- 172.21.15.3:0/3207900028 >> v1:172.21.15.137:6792/0 conn(0x7f0a2009a260 legacy=0x7f0a20143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106710011 0 0) 0x7f0a2011ca70 con 0x7f0a20096ca0 2021-05-26T16:41:10.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 10 monclient(hunting): my global_id is 4306 2021-05-26T16:41:10.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00003270 con 0x7f0a20096ca0 2021-05-26T16:41:10.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 382962845 0 0) 0x7f0a00003270 con 0x7f0a20096ca0 2021-05-26T16:41:10.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a2011ca70 con 0x7f0a20096ca0 2021-05-26T16:41:10.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0a08001c00 con 0x7f0a20096ca0 2021-05-26T16:41:10.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:10.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 10 monclient(hunting): dump: 2021-05-26T16:41:10.492 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.493 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.493 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.493 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.493 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.493 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.494 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.494 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.494 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.494 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.494 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.495 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.495 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.495 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.495 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.495 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.429+0000 7f0a06ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:10.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1525218185 0 0) 0x7f0a2011ca70 con 0x7f0a20096ca0 2021-05-26T16:41:10.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 >> v1:172.21.15.137:6792/0 conn(0x7f0a2009a260 legacy=0x7f0a20143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 >> v1:172.21.15.137:6791/0 conn(0x7f0a20099db0 legacy=0x7f0a2013c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:10.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 monclient: found mon.c 2021-05-26T16:41:10.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:10.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2011b0e0 con 0x7f0a20096ca0 2021-05-26T16:41:10.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:10.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:10.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a25624700 5 monclient: authenticate success, global_id 4306 2021-05-26T16:41:10.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a25624700 10 monclient: _renew_subs 2021-05-26T16:41:10.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a25624700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2011a540 con 0x7f0a20096ca0 2021-05-26T16:41:10.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a25624700 10 monclient: _renew_subs 2021-05-26T16:41:10.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a25624700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2011dac0 con 0x7f0a20096ca0 2021-05-26T16:41:10.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0a080048e0 con 0x7f0a20096ca0 2021-05-26T16:41:10.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:10.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0a08004e10 con 0x7f0a20096ca0 2021-05-26T16:41:10.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a1d7fa700 4 set_mon_vals no callback set 2021-05-26T16:41:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 10 monclient: dump: 2021-05-26T16:41:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.503 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.503 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.503 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.503 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.503 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.504 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.504 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.504 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.504 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.430+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f0a08004ff0 con 0x7f0a20096ca0 2021-05-26T16:41:10.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.431+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f0a0803d8f0 con 0x7f0a20096ca0 2021-05-26T16:41:10.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.431+0000 7f0a25624700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.431+0000 7f0a25624700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.431+0000 7f0a25624700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.431+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8004db0 con 0x7f0a20096ca0 2021-05-26T16:41:10.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.431+0000 7f0a1e7fc700 10 monclient: get_auth_request con 0x7f0a00032a40 auth_method 0 2021-05-26T16:41:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.435+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f0a080135c0 con 0x7f0a20096ca0 2021-05-26T16:41:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.435+0000 7f0a06ffd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.435+0000 7f0a06ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:10.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.593+0000 7f0a25624700 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2021-05-26T16:41:10.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.594+0000 7f0a25624700 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2021-05-26T16:41:10.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.594+0000 7f0a25624700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:10.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.594+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09f8005060 con 0x7f0a20096ca0 2021-05-26T16:41:10.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.594+0000 7f0a06ffd700 1 -- 172.21.15.3:0/3207900028 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 1444633209) 0x7f0a080131b0 con 0x7f0a20096ca0 2021-05-26T16:41:10.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.594+0000 7f0a06ffd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2021-05-26T16:41:10.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.594+0000 7f0a06ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:10.599 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:10.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 >> v1:172.21.15.137:6812/30003 conn(0x7f0a00032a40 legacy=0x7f0a00034f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 10 monclient: shutdown 2021-05-26T16:41:10.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:10.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 >> v1:172.21.15.3:6791/0 conn(0x7f0a20096ca0 legacy=0x7f0a2013bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 shutdown_connections 2021-05-26T16:41:10.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 >> 172.21.15.3:0/3207900028 conn(0x7f0a2009cc00 msgr2=0x7f0a20097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:10.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 shutdown_connections 2021-05-26T16:41:10.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.596+0000 7f0a25624700 1 -- 172.21.15.3:0/3207900028 wait complete. 2021-05-26T16:41:10.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2021-05-26T16:41:10.611 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-05-26T16:41:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.723+0000 7fdfbf1d1700 10 monclient: get_monmap_and_config 2021-05-26T16:41:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.723+0000 7fdfbf1d1700 10 monclient: build_initial_monmap 2021-05-26T16:41:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.723+0000 7fdfbf1d1700 10 monclient: monmap: 2021-05-26T16:41:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:10.725414+0000 2021-05-26T16:41:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:10.725414+0000 2021-05-26T16:41:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:10.729 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.729 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:10.729 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:10.729 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:10.731 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:10.731 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.724+0000 7fdfbf1d1700 1 Processor -- start 2021-05-26T16:41:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.724+0000 7fdfbf1d1700 1 -- start start 2021-05-26T16:41:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.724+0000 7fdfbf1d1700 10 monclient: init 2021-05-26T16:41:10.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:10.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 10 monclient: _add_conns ranks=[6,8,5,4,3,7,1,0,2] 2021-05-26T16:41:10.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 10 monclient(hunting): picked mon.noname-d con 0x7fdfb8096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:10.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 10 monclient(hunting): picked mon.noname-e con 0x7fdfb812d460 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 10 monclient(hunting): picked mon.noname-h con 0x7fdfb812d910 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb8059750 con 0x7fdfb812d910 2021-05-26T16:41:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb809c760 con 0x7fdfb8096ca0 2021-05-26T16:41:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb809ca00 con 0x7fdfb812d460 2021-05-26T16:41:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbf1d1700 10 monclient(hunting): authenticate will time out at 828.357154s 2021-05-26T16:41:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbcf6d700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fdfb8096ca0 0x7fdfb812cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56490/0 (socket says 172.21.15.3:56490) 2021-05-26T16:41:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfbcf6d700 1 -- 172.21.15.3:0/413557232 learned_addr learned my addr 172.21.15.3:0/413557232 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.725+0000 7fdfaffff700 1 --1- 172.21.15.3:0/413557232 >> v1:172.21.15.3:6793/0 conn(0x7fdfb812d460 0x7fdfb81320e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52172/0 (socket says 172.21.15.3:52172) 2021-05-26T16:41:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfbcf6d700 1 -- 172.21.15.3:0/413557232 >> v1:172.21.15.3:6792/0 conn(0x7fdfb8096ca0 legacy=0x7fdfb812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaffff700 1 -- 172.21.15.3:0/413557232 >> v1:172.21.15.3:6793/0 conn(0x7fdfb812d460 legacy=0x7fdfb81320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262794801 0 0) 0x7fdfb809ca00 con 0x7fdfb812d460 2021-05-26T16:41:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient(hunting): my global_id is 4283 2021-05-26T16:41:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa4003270 con 0x7fdfb812d460 2021-05-26T16:41:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457161050 0 0) 0x7fdfb809c760 con 0x7fdfb8096ca0 2021-05-26T16:41:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient(hunting): my global_id is 4272 2021-05-26T16:41:10.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb809ca00 con 0x7fdfb8096ca0 2021-05-26T16:41:10.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfbd76e700 1 -- 172.21.15.3:0/413557232 >> v1:172.21.15.137:6791/0 conn(0x7fdfb812d910 legacy=0x7fdfb8135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2888923453 0 0) 0x7fdfa4003270 con 0x7fdfb812d460 2021-05-26T16:41:10.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 >> v1:172.21.15.3:6792/0 conn(0x7fdfb8096ca0 legacy=0x7fdfb812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 >> v1:172.21.15.137:6791/0 conn(0x7fdfb812d910 legacy=0x7fdfb8135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 monclient: found mon.noname-e 2021-05-26T16:41:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:10.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:10.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8097730 con 0x7fdfb812d460 2021-05-26T16:41:10.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:10.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:10.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fdfa0001a60 con 0x7fdfb812d460 2021-05-26T16:41:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfbf1d1700 5 monclient: authenticate success, global_id 4283 2021-05-26T16:41:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfbf1d1700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfaf7fe700 10 monclient: dump: 2021-05-26T16:41:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.753 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.753 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.753 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.753 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.753 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.754 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.727+0000 7fdfbf1d1700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfaffff700 1 --1- 172.21.15.3:0/413557232 >> v1:172.21.15.3:6793/0 conn(0x7fdfb812d460 0x7fdfb81320e0 :-1 s=OPENED pgs=70 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7fdfa0004870 mon_map magic: 0 v1 2021-05-26T16:41:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdfa0001d70 con 0x7fdfb812d460 2021-05-26T16:41:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfaf7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:10.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:10.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 4 set_mon_vals no callback set 2021-05-26T16:41:10.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 10 monclient: shutdown 2021-05-26T16:41:10.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:10.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/413557232 >> v1:172.21.15.3:6793/0 conn(0x7fdfb812d460 legacy=0x7fdfb81320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfaf7fe700 1 -- 172.21.15.3:0/413557232 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fdfa0004870 con 0x7fdfb812d460 2021-05-26T16:41:10.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfaf7fe700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:41:10.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/413557232 shutdown_connections 2021-05-26T16:41:10.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/413557232 >> 172.21.15.3:0/413557232 conn(0x7fdfb80a00e0 msgr2=0x7fdfb80a04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/413557232 shutdown_connections 2021-05-26T16:41:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/413557232 wait complete. 2021-05-26T16:41:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 10 monclient: build_initial_monmap 2021-05-26T16:41:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.728+0000 7fdfbf1d1700 10 monclient: monmap: 2021-05-26T16:41:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:10.760 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:10.760 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:10.760 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:10.760 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:10.761 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 1 Processor -- start 2021-05-26T16:41:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 1 -- start start 2021-05-26T16:41:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient: init 2021-05-26T16:41:10.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:10.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient: _add_conns ranks=[4,2,6,8,3,5,1,7,0] 2021-05-26T16:41:10.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient(hunting): picked mon.noname-c con 0x7fdfb8096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:10.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient(hunting): picked mon.noname-b con 0x7fdfb812d460 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:10.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient(hunting): picked mon.noname-d con 0x7fdfb812d910 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:10.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb8116c10 con 0x7fdfb812d460 2021-05-26T16:41:10.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb8116eb0 con 0x7fdfb8096ca0 2021-05-26T16:41:10.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb8117150 con 0x7fdfb812d910 2021-05-26T16:41:10.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:10.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.729+0000 7fdfbf1d1700 10 monclient(hunting): authenticate will time out at 828.361961s 2021-05-26T16:41:10.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.730+0000 7fdfbcf6d700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fdfb8096ca0 0x7fdfb8129710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36608/0 (socket says 172.21.15.3:36608) 2021-05-26T16:41:10.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.730+0000 7fdfbd76e700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fdfb812d910 0x7fdfb81449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56500/0 (socket says 172.21.15.3:56500) 2021-05-26T16:41:10.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.730+0000 7fdfbcf6d700 1 -- 172.21.15.3:0/2046490919 learned_addr learned my addr 172.21.15.3:0/2046490919 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:10.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfbd76e700 1 -- 172.21.15.3:0/2046490919 >> v1:172.21.15.3:6792/0 conn(0x7fdfb812d910 legacy=0x7fdfb81449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfaffff700 1 -- 172.21.15.3:0/2046490919 >> v1:172.21.15.3:6790/0 conn(0x7fdfb812d460 legacy=0x7fdfb8141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfbcf6d700 1 -- 172.21.15.3:0/2046490919 >> v1:172.21.15.3:6791/0 conn(0x7fdfb8096ca0 legacy=0x7fdfb8129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:10.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659291904 0 0) 0x7fdfb8117150 con 0x7fdfb812d910 2021-05-26T16:41:10.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): my global_id is 4281 2021-05-26T16:41:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf98003270 con 0x7fdfb812d910 2021-05-26T16:41:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423845855 0 0) 0x7fdfb8116c10 con 0x7fdfb812d460 2021-05-26T16:41:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): my global_id is 4331 2021-05-26T16:41:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb8117150 con 0x7fdfb812d460 2021-05-26T16:41:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885617578 0 0) 0x7fdfb8116eb0 con 0x7fdfb8096ca0 2021-05-26T16:41:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): my global_id is 4315 2021-05-26T16:41:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb8116c10 con 0x7fdfb8096ca0 2021-05-26T16:41:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1480835360 0 0) 0x7fdf98003270 con 0x7fdfb812d910 2021-05-26T16:41:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdfb8116eb0 con 0x7fdfb812d910 2021-05-26T16:41:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fdfb4001f60 con 0x7fdfb812d910 2021-05-26T16:41:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:10.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): dump: 2021-05-26T16:41:10.770 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.771 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.771 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.771 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.771 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.771 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.772 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.772 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.772 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.772 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.772 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.773 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.773 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.773 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.773 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.774 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:10.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2469296151 0 0) 0x7fdfb8117150 con 0x7fdfb812d460 2021-05-26T16:41:10.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf98003270 con 0x7fdfb812d460 2021-05-26T16:41:10.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3503748449 0 0) 0x7fdfb8116c10 con 0x7fdfb8096ca0 2021-05-26T16:41:10.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdfb8117150 con 0x7fdfb8096ca0 2021-05-26T16:41:10.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fdfa0001a20 con 0x7fdfb812d460 2021-05-26T16:41:10.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): dump: 2021-05-26T16:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.778 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.778 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.778 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.778 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.779 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.779 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.779 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fdfa8001320 con 0x7fdfb8096ca0 2021-05-26T16:41:10.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:10.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient(hunting): dump: 2021-05-26T16:41:10.780 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.780 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.781 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.781 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.781 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.781 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.781 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.782 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.782 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.782 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.782 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.783 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2158595150 0 0) 0x7fdfb8116eb0 con 0x7fdfb812d910 2021-05-26T16:41:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 >> v1:172.21.15.3:6791/0 conn(0x7fdfb8096ca0 legacy=0x7fdfb8129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 >> v1:172.21.15.3:6790/0 conn(0x7fdfb812d460 legacy=0x7fdfb8141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient: _finish_hunting 0 2021-05-26T16:41:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 monclient: found mon.d 2021-05-26T16:41:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.732+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb813ce40 con 0x7fdfb812d910 2021-05-26T16:41:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 10 monclient: _finish_auth 0 2021-05-26T16:41:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfbf1d1700 5 monclient: authenticate success, global_id 4281 2021-05-26T16:41:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfbf1d1700 10 monclient: _renew_subs 2021-05-26T16:41:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfbf1d1700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:10.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb8095e50 con 0x7fdfb812d910 2021-05-26T16:41:10.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfbf1d1700 10 monclient: _renew_subs 2021-05-26T16:41:10.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfbf1d1700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:10.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb8131470 con 0x7fdfb812d910 2021-05-26T16:41:10.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdfb40025f0 con 0x7fdfb812d910 2021-05-26T16:41:10.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:10.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fdfb4002aa0 con 0x7fdfb812d910 2021-05-26T16:41:10.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:10.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfaeffd700 4 set_mon_vals no callback set 2021-05-26T16:41:10.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 10 monclient: dump: 2021-05-26T16:41:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:10.792 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:10.792 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:10.792 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:10.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.733+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fdfb4002c00 con 0x7fdfb812d910 2021-05-26T16:41:10.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.734+0000 7fdfbf1d1700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.734+0000 7fdfbf1d1700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.734+0000 7fdfbf1d1700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:10.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.734+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf90004db0 con 0x7fdfb812d910 2021-05-26T16:41:10.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.734+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fdfb403db10 con 0x7fdfb812d910 2021-05-26T16:41:10.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.734+0000 7fdfbcf6d700 10 monclient: get_auth_request con 0x7fdf980333e0 auth_method 0 2021-05-26T16:41:10.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.738+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fdfb4013550 con 0x7fdfb812d910 2021-05-26T16:41:10.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.738+0000 7fdfacff9700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:10.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.738+0000 7fdfacff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:10.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.898+0000 7fdfbf1d1700 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2021-05-26T16:41:10.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.898+0000 7fdfbf1d1700 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2021-05-26T16:41:10.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.898+0000 7fdfbf1d1700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:10.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.898+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdf90005060 con 0x7fdfb812d910 2021-05-26T16:41:10.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.898+0000 7fdfacff9700 1 -- 172.21.15.3:0/2046490919 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (unknown 1823589948 0 1444633209) 0x7fdfb4013370 con 0x7fdfb812d910 2021-05-26T16:41:10.903 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.898+0000 7fdfacff9700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2021-05-26T16:41:10.903 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.898+0000 7fdfacff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:10.903 INFO:teuthology.orchestra.run.smithi003.stdout:47244640260 2021-05-26T16:41:10.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.899+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 >> v1:172.21.15.137:6812/30003 conn(0x7fdf980333e0 legacy=0x7fdf980358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.900+0000 7fdfbf1d1700 10 monclient: shutdown 2021-05-26T16:41:10.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.900+0000 7fdfbf1d1700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:10.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.900+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 >> v1:172.21.15.3:6792/0 conn(0x7fdfb812d910 legacy=0x7fdfb81449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:10.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.900+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 shutdown_connections 2021-05-26T16:41:10.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.900+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 >> 172.21.15.3:0/2046490919 conn(0x7fdfb80a00e0 msgr2=0x7fdfb8099050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:10.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.900+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 shutdown_connections 2021-05-26T16:41:10.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:10.900+0000 7fdfbf1d1700 1 -- 172.21.15.3:0/2046490919 wait complete. 2021-05-26T16:41:10.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.4 2021-05-26T16:41:10.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-05-26T16:41:11.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.027+0000 7fcd20bb9700 10 monclient: get_monmap_and_config 2021-05-26T16:41:11.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.027+0000 7fcd20bb9700 10 monclient: build_initial_monmap 2021-05-26T16:41:11.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.027+0000 7fcd20bb9700 10 monclient: monmap: 2021-05-26T16:41:11.032 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:11.032 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.032 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:11.028934+0000 2021-05-26T16:41:11.032 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:11.028934+0000 2021-05-26T16:41:11.033 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:11.033 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.033 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:11.033 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:11.034 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:11.034 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:11.034 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:11.034 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:11.035 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:11.035 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:11.035 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:11.035 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.027+0000 7fcd20bb9700 1 Processor -- start 2021-05-26T16:41:11.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.027+0000 7fcd20bb9700 1 -- start start 2021-05-26T16:41:11.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.027+0000 7fcd20bb9700 10 monclient: init 2021-05-26T16:41:11.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 10 monclient: _add_conns ranks=[4,0,1,8,3,2,6,7,5] 2021-05-26T16:41:11.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 10 monclient(hunting): picked mon.noname-c con 0x7fcd1c096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:11.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 10 monclient(hunting): picked mon.noname-a con 0x7fcd1c099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:11.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 10 monclient(hunting): picked mon.noname-f con 0x7fcd1c09a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:11.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c059750 con 0x7fcd1c099db0 2021-05-26T16:41:11.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c064620 con 0x7fcd1c09a260 2021-05-26T16:41:11.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c064e50 con 0x7fcd1c096ca0 2021-05-26T16:41:11.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd20bb9700 10 monclient(hunting): authenticate will time out at 828.660658s 2021-05-26T16:41:11.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd1a59c700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fcd1c096ca0 0x7fcd1c063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36616/0 (socket says 172.21.15.3:36616) 2021-05-26T16:41:11.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd19d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcd1c099db0 0x7fcd1c132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51106/0 (socket says 172.21.15.3:51106) 2021-05-26T16:41:11.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.028+0000 7fcd1a59c700 1 -- 172.21.15.3:0/1863962325 learned_addr learned my addr 172.21.15.3:0/1863962325 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:11.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.030+0000 7fcd1a59c700 1 -- 172.21.15.3:0/1863962325 >> v1:172.21.15.3:6791/0 conn(0x7fcd1c096ca0 legacy=0x7fcd1c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.030+0000 7fcd19d9b700 1 -- 172.21.15.3:0/1863962325 >> v1:172.21.15.3:6789/0 conn(0x7fcd1c099db0 legacy=0x7fcd1c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1ad9d700 1 -- 172.21.15.3:0/1863962325 >> v1:172.21.15.137:6789/0 conn(0x7fcd1c09a260 legacy=0x7fcd1c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877405403 0 0) 0x7fcd1c064e50 con 0x7fcd1c096ca0 2021-05-26T16:41:11.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): my global_id is 4324 2021-05-26T16:41:11.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd00003270 con 0x7fcd1c096ca0 2021-05-26T16:41:11.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787167523 0 0) 0x7fcd1c059750 con 0x7fcd1c099db0 2021-05-26T16:41:11.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): my global_id is 4383 2021-05-26T16:41:11.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c064e50 con 0x7fcd1c099db0 2021-05-26T16:41:11.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340039564 0 0) 0x7fcd1c064620 con 0x7fcd1c09a260 2021-05-26T16:41:11.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient(hunting): my global_id is 4276 2021-05-26T16:41:11.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c059750 con 0x7fcd1c09a260 2021-05-26T16:41:11.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1451510196 0 0) 0x7fcd00003270 con 0x7fcd1c096ca0 2021-05-26T16:41:11.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 >> v1:172.21.15.137:6789/0 conn(0x7fcd1c09a260 legacy=0x7fcd1c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 >> v1:172.21.15.3:6789/0 conn(0x7fcd1c099db0 legacy=0x7fcd1c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 monclient: found mon.noname-c 2021-05-26T16:41:11.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:11.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c09c390 con 0x7fcd1c096ca0 2021-05-26T16:41:11.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd04001a60 con 0x7fcd1c096ca0 2021-05-26T16:41:11.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:11.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: dump: 2021-05-26T16:41:11.057 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.057 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.057 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.057 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.058 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.058 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.058 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.058 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.058 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.059 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.059 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.059 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.059 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.059 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.060 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.060 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd20bb9700 5 monclient: authenticate success, global_id 4324 2021-05-26T16:41:11.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd20bb9700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:11.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcd04001d70 con 0x7fcd1c096ca0 2021-05-26T16:41:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd20bb9700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 1 -- 172.21.15.3:0/1863962325 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd04004930 con 0x7fcd1c096ca0 2021-05-26T16:41:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd20bb9700 4 set_mon_vals no callback set 2021-05-26T16:41:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.031+0000 7fcd1959a700 10 monclient: dump: 2021-05-26T16:41:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.064 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.064 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.064 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.064 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.064 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.065 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.065 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.065 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 10 monclient: shutdown 2021-05-26T16:41:11.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:11.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1863962325 >> v1:172.21.15.3:6791/0 conn(0x7fcd1c096ca0 legacy=0x7fcd1c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1863962325 shutdown_connections 2021-05-26T16:41:11.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1863962325 >> 172.21.15.3:0/1863962325 conn(0x7fcd1c09cc00 msgr2=0x7fcd1c09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:11.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1863962325 shutdown_connections 2021-05-26T16:41:11.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1863962325 wait complete. 2021-05-26T16:41:11.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 10 monclient: build_initial_monmap 2021-05-26T16:41:11.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 10 monclient: monmap: 2021-05-26T16:41:11.067 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:11.067 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:11.067 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:11.068 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:11.068 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:11.068 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.068 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:11.068 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:11.069 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:11.069 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:11.069 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:11.069 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:11.069 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:11.070 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:11.070 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:11.070 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 1 Processor -- start 2021-05-26T16:41:11.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.032+0000 7fcd20bb9700 1 -- start start 2021-05-26T16:41:11.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient: init 2021-05-26T16:41:11.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient: _add_conns ranks=[5,6,8,3,4,0,1,2,7] 2021-05-26T16:41:11.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient(hunting): picked mon.noname-h con 0x7fcd1c096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:11.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient(hunting): picked mon.noname-d con 0x7fcd1c099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient(hunting): picked mon.noname-e con 0x7fcd1c09a260 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c12d500 con 0x7fcd1c096ca0 2021-05-26T16:41:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c116970 con 0x7fcd1c099db0 2021-05-26T16:41:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c116c10 con 0x7fcd1c09a260 2021-05-26T16:41:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd20bb9700 10 monclient(hunting): authenticate will time out at 828.665452s 2021-05-26T16:41:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd19d9b700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fcd1c099db0 0x7fcd1c12cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56512/0 (socket says 172.21.15.3:56512) 2021-05-26T16:41:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.033+0000 7fcd19d9b700 1 -- 172.21.15.3:0/1352522984 learned_addr learned my addr 172.21.15.3:0/1352522984 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd1ad9d700 1 -- 172.21.15.3:0/1352522984 >> v1:172.21.15.3:6793/0 conn(0x7fcd1c09a260 legacy=0x7fcd1c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd19d9b700 1 -- 172.21.15.3:0/1352522984 >> v1:172.21.15.3:6792/0 conn(0x7fcd1c099db0 legacy=0x7fcd1c12cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd1a59c700 1 -- 172.21.15.3:0/1352522984 >> v1:172.21.15.137:6791/0 conn(0x7fcd1c096ca0 legacy=0x7fcd1c12c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142840644 0 0) 0x7fcd1c116c10 con 0x7fcd1c09a260 2021-05-26T16:41:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 10 monclient(hunting): my global_id is 4292 2021-05-26T16:41:11.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf8003270 con 0x7fcd1c09a260 2021-05-26T16:41:11.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312781193 0 0) 0x7fcd1c116970 con 0x7fcd1c099db0 2021-05-26T16:41:11.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 10 monclient(hunting): my global_id is 4290 2021-05-26T16:41:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.035+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c116c10 con 0x7fcd1c099db0 2021-05-26T16:41:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073626473 0 0) 0x7fcd1c12d500 con 0x7fcd1c096ca0 2021-05-26T16:41:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): my global_id is 4370 2021-05-26T16:41:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c116970 con 0x7fcd1c096ca0 2021-05-26T16:41:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3116145160 0 0) 0x7fccf8003270 con 0x7fcd1c09a260 2021-05-26T16:41:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd1c12d500 con 0x7fcd1c09a260 2021-05-26T16:41:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd0c002080 con 0x7fcd1c09a260 2021-05-26T16:41:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.081 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 367938245 0 0) 0x7fcd1c116c10 con 0x7fcd1c099db0 2021-05-26T16:41:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fccf8003270 con 0x7fcd1c099db0 2021-05-26T16:41:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd10001900 con 0x7fcd1c099db0 2021-05-26T16:41:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.086 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.086 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.086 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.086 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4222354173 0 0) 0x7fcd1c12d500 con 0x7fcd1c09a260 2021-05-26T16:41:11.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 >> v1:172.21.15.3:6792/0 conn(0x7fcd1c099db0 legacy=0x7fcd1c12cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 >> v1:172.21.15.137:6791/0 conn(0x7fcd1c096ca0 legacy=0x7fcd1c12c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 monclient: found mon.e 2021-05-26T16:41:11.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:11.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c116eb0 con 0x7fcd1c09a260 2021-05-26T16:41:11.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd20bb9700 5 monclient: authenticate success, global_id 4292 2021-05-26T16:41:11.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd20bb9700 10 monclient: _renew_subs 2021-05-26T16:41:11.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd20bb9700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:11.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c12e240 con 0x7fcd1c09a260 2021-05-26T16:41:11.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd20bb9700 10 monclient: _renew_subs 2021-05-26T16:41:11.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd20bb9700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:11.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c12f0a0 con 0x7fcd1c09a260 2021-05-26T16:41:11.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcd0c002690 con 0x7fcd1c09a260 2021-05-26T16:41:11.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:11.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd0c002b40 con 0x7fcd1c09a260 2021-05-26T16:41:11.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd18d99700 4 set_mon_vals no callback set 2021-05-26T16:41:11.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:11.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.036+0000 7fcd0a7fc700 10 monclient: dump: 2021-05-26T16:41:11.092 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.092 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.092 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.093 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.093 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.093 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.093 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.094 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.094 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.094 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.094 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.094 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.095 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.095 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.095 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.095 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.037+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fcd0c002cd0 con 0x7fcd1c09a260 2021-05-26T16:41:11.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.037+0000 7fcd20bb9700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.037+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fcd0c03db50 con 0x7fcd1c09a260 2021-05-26T16:41:11.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.037+0000 7fcd20bb9700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.037+0000 7fcd20bb9700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:11.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.037+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc004db0 con 0x7fcd1c09a260 2021-05-26T16:41:11.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.037+0000 7fcd1a59c700 10 monclient: get_auth_request con 0x7fccf8033010 auth_method 0 2021-05-26T16:41:11.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.041+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fcd0c002f60 con 0x7fcd1c09a260 2021-05-26T16:41:11.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.041+0000 7fcd0a7fc700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.041+0000 7fcd0a7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:11.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.203+0000 7fcd20bb9700 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2021-05-26T16:41:11.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.203+0000 7fcd20bb9700 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2021-05-26T16:41:11.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.203+0000 7fcd20bb9700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:11.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.203+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fccfc005060 con 0x7fcd1c09a260 2021-05-26T16:41:11.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.203+0000 7fcd0a7fc700 1 -- 172.21.15.3:0/1352522984 <== mon.8 v1:172.21.15.3:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (unknown 2131975755 0 847495621) 0x7fcd0c0133c0 con 0x7fcd1c09a260 2021-05-26T16:41:11.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.203+0000 7fcd0a7fc700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2021-05-26T16:41:11.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.203+0000 7fcd0a7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:11.209 INFO:teuthology.orchestra.run.smithi003.stdout:47244640259 2021-05-26T16:41:11.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 >> v1:172.21.15.137:6812/30003 conn(0x7fccf8033010 legacy=0x7fccf80354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 10 monclient: shutdown 2021-05-26T16:41:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 >> v1:172.21.15.3:6793/0 conn(0x7fcd1c09a260 legacy=0x7fcd1c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 shutdown_connections 2021-05-26T16:41:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 >> 172.21.15.3:0/1352522984 conn(0x7fcd1c09cc00 msgr2=0x7fcd1c09f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 shutdown_connections 2021-05-26T16:41:11.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.205+0000 7fcd20bb9700 1 -- 172.21.15.3:0/1352522984 wait complete. 2021-05-26T16:41:11.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2021-05-26T16:41:11.221 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-05-26T16:41:11.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-05-26T16:41:11.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.334+0000 7f73d37bc700 10 monclient: get_monmap_and_config 2021-05-26T16:41:11.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.334+0000 7f73d37bc700 10 monclient: build_initial_monmap 2021-05-26T16:41:11.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.334+0000 7f73d37bc700 10 monclient: monmap: 2021-05-26T16:41:11.338 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:11.338 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.338 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:11.335746+0000 2021-05-26T16:41:11.339 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:11.335746+0000 2021-05-26T16:41:11.339 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:11.339 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.339 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:11.340 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:11.340 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:11.340 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:11.340 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:11.341 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:11.341 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:11.341 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:11.341 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:11.341 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.334+0000 7f73d37bc700 1 Processor -- start 2021-05-26T16:41:11.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.334+0000 7f73d37bc700 1 -- start start 2021-05-26T16:41:11.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.334+0000 7f73d37bc700 10 monclient: init 2021-05-26T16:41:11.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 10 monclient: _add_conns ranks=[1,3,5,2,4,8,0,7,6] 2021-05-26T16:41:11.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 10 monclient(hunting): picked mon.noname-f con 0x7f73cc096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:11.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 10 monclient(hunting): picked mon.noname-g con 0x7f73cc099db0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:11.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 10 monclient(hunting): picked mon.noname-h con 0x7f73cc09a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:11.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc059750 con 0x7f73cc096ca0 2021-05-26T16:41:11.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc064620 con 0x7f73cc099db0 2021-05-26T16:41:11.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc064e50 con 0x7f73cc09a260 2021-05-26T16:41:11.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d37bc700 10 monclient(hunting): authenticate will time out at 828.967384s 2021-05-26T16:41:11.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d1558700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f73cc096ca0 0x7f73cc063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.3:46156/0 (socket says 172.21.15.3:46156) 2021-05-26T16:41:11.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d0d57700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f73cc099db0 0x7f73cc132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.3:33504/0 (socket says 172.21.15.3:33504) 2021-05-26T16:41:11.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.335+0000 7f73d1558700 1 -- 172.21.15.3:0/2559837917 learned_addr learned my addr 172.21.15.3:0/2559837917 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:11.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.337+0000 7f73d1558700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6789/0 conn(0x7f73cc096ca0 legacy=0x7f73cc063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.337+0000 7f73d0d57700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6790/0 conn(0x7f73cc099db0 legacy=0x7f73cc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.337+0000 7f73d1d59700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6791/0 conn(0x7f73cc09a260 legacy=0x7f73cc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d0d57700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6790/0 conn(0x7f73cc099db0 legacy=0x7f73cc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2021-05-26T16:41:11.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d0d57700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6790/0 conn(0x7f73cc099db0 legacy=0x7f73cc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:41:11.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d0d57700 1 --1- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6790/0 conn(0x7f73cc099db0 0x7f73cc132080 :-1 s=OPENED pgs=60 cs=1 l=1).handle_message read tag failed 2021-05-26T16:41:11.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d0d57700 1 --1- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6790/0 conn(0x7f73cc099db0 0x7f73cc132080 :-1 s=OPENED pgs=60 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:41:11.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.137:6790/0 2021-05-26T16:41:11.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907991859 0 0) 0x7f73cc059750 con 0x7f73cc096ca0 2021-05-26T16:41:11.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient(hunting): my global_id is 4285 2021-05-26T16:41:11.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b4003270 con 0x7f73cc096ca0 2021-05-26T16:41:11.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113442000 0 0) 0x7f73cc064e50 con 0x7f73cc09a260 2021-05-26T16:41:11.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient(hunting): my global_id is 4379 2021-05-26T16:41:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73cc059750 con 0x7f73cc09a260 2021-05-26T16:41:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1336398892 0 0) 0x7f73b4003270 con 0x7f73cc096ca0 2021-05-26T16:41:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6791/0 conn(0x7f73cc09a260 legacy=0x7f73cc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6790/0 conn(0x7f73cc099db0 legacy=0x7f73cc132080 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 monclient: found mon.noname-f 2021-05-26T16:41:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.137:6789/0 2021-05-26T16:41:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc09c390 con 0x7f73cc096ca0 2021-05-26T16:41:11.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f73c0001b10 con 0x7f73cc096ca0 2021-05-26T16:41:11.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 5 monclient: authenticate success, global_id 4285 2021-05-26T16:41:11.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:11.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2021-05-26T16:41:11.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: dump: 2021-05-26T16:41:11.363 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.364 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.364 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.364 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.364 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.364 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.365 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.365 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.365 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.365 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.365 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.366 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.366 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.366 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.366 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.367 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:11.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 <== mon.1 v1:172.21.15.137:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f73c00045f0 con 0x7f73cc096ca0 2021-05-26T16:41:11.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:11.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:11.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 4 set_mon_vals no callback set 2021-05-26T16:41:11.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 1 -- 172.21.15.3:0/2559837917 <== mon.1 v1:172.21.15.137:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f73c0004b20 con 0x7f73cc096ca0 2021-05-26T16:41:11.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:11.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73bbfff700 10 monclient: dump: 2021-05-26T16:41:11.369 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.369 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.369 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.369 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.370 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.370 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.370 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.370 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.370 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.371 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.371 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.371 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.371 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.371 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.372 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.372 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 10 monclient: shutdown 2021-05-26T16:41:11.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:11.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.338+0000 7f73d37bc700 1 -- 172.21.15.3:0/2559837917 >> v1:172.21.15.137:6789/0 conn(0x7f73cc096ca0 legacy=0x7f73cc063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 1 -- 172.21.15.3:0/2559837917 shutdown_connections 2021-05-26T16:41:11.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 1 -- 172.21.15.3:0/2559837917 >> 172.21.15.3:0/2559837917 conn(0x7f73cc09cc00 msgr2=0x7f73cc09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:11.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 1 -- 172.21.15.3:0/2559837917 shutdown_connections 2021-05-26T16:41:11.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 1 -- 172.21.15.3:0/2559837917 wait complete. 2021-05-26T16:41:11.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 10 monclient: build_initial_monmap 2021-05-26T16:41:11.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 10 monclient: monmap: 2021-05-26T16:41:11.375 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:11.376 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:11.376 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:11.376 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:11.376 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:11.377 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.377 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:11.377 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:11.377 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:11.379 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:11.379 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 1 Processor -- start 2021-05-26T16:41:11.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 1 -- start start 2021-05-26T16:41:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.339+0000 7f73d37bc700 10 monclient: init 2021-05-26T16:41:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 10 monclient: _add_conns ranks=[5,4,6,1,7,8,2,0,3] 2021-05-26T16:41:11.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 10 monclient(hunting): picked mon.noname-h con 0x7f73cc096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:11.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 10 monclient(hunting): picked mon.noname-c con 0x7f73cc099db0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 10 monclient(hunting): picked mon.noname-d con 0x7f73cc09a260 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc116af0 con 0x7f73cc099db0 2021-05-26T16:41:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc116d90 con 0x7f73cc096ca0 2021-05-26T16:41:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc117030 con 0x7f73cc09a260 2021-05-26T16:41:11.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d37bc700 10 monclient(hunting): authenticate will time out at 828.972571s 2021-05-26T16:41:11.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d0d57700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f73cc099db0 0x7f73cc1411c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36642/0 (socket says 172.21.15.3:36642) 2021-05-26T16:41:11.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.340+0000 7f73d0d57700 1 -- 172.21.15.3:0/3142570049 learned_addr learned my addr 172.21.15.3:0/3142570049 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:11.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.342+0000 7f73d0d57700 1 -- 172.21.15.3:0/3142570049 >> v1:172.21.15.3:6791/0 conn(0x7f73cc099db0 legacy=0x7f73cc1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.342+0000 7f73d1558700 1 -- 172.21.15.3:0/3142570049 >> v1:172.21.15.137:6791/0 conn(0x7f73cc096ca0 legacy=0x7f73cc13c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.342+0000 7f73d1d59700 1 -- 172.21.15.3:0/3142570049 >> v1:172.21.15.3:6792/0 conn(0x7f73cc09a260 legacy=0x7f73cc1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751740916 0 0) 0x7f73cc116af0 con 0x7f73cc099db0 2021-05-26T16:41:11.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): my global_id is 4333 2021-05-26T16:41:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac003270 con 0x7f73cc099db0 2021-05-26T16:41:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829930579 0 0) 0x7f73cc116d90 con 0x7f73cc096ca0 2021-05-26T16:41:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): my global_id is 4388 2021-05-26T16:41:11.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73cc116af0 con 0x7f73cc096ca0 2021-05-26T16:41:11.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142927268 0 0) 0x7f73cc117030 con 0x7f73cc09a260 2021-05-26T16:41:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): my global_id is 4299 2021-05-26T16:41:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73cc116d90 con 0x7f73cc09a260 2021-05-26T16:41:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1012877223 0 0) 0x7f73ac003270 con 0x7f73cc099db0 2021-05-26T16:41:11.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73cc117030 con 0x7f73cc099db0 2021-05-26T16:41:11.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f73bc004530 con 0x7f73cc099db0 2021-05-26T16:41:11.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): dump: 2021-05-26T16:41:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.390 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.390 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.390 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.390 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.391 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.391 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.391 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.391 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.391 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.392 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.392 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:11.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3883869164 0 0) 0x7f73cc116af0 con 0x7f73cc096ca0 2021-05-26T16:41:11.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73ac003270 con 0x7f73cc096ca0 2021-05-26T16:41:11.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1711055534 0 0) 0x7f73cc116d90 con 0x7f73cc09a260 2021-05-26T16:41:11.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73cc116af0 con 0x7f73cc09a260 2021-05-26T16:41:11.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f73c0001ad0 con 0x7f73cc096ca0 2021-05-26T16:41:11.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:11.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): dump: 2021-05-26T16:41:11.394 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.394 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.394 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.395 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.395 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.395 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.395 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.396 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.396 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.396 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.396 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.396 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.397 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.397 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.397 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.397 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f73c8002080 con 0x7f73cc09a260 2021-05-26T16:41:11.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:11.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient(hunting): dump: 2021-05-26T16:41:11.398 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.398 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.399 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.399 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.399 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.399 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.400 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.400 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.400 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.400 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.400 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.401 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.401 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.401 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.401 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.401 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.402 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1654867822 0 0) 0x7f73cc117030 con 0x7f73cc099db0 2021-05-26T16:41:11.402 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 >> v1:172.21.15.3:6792/0 conn(0x7f73cc09a260 legacy=0x7f73cc1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.402 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 >> v1:172.21.15.137:6791/0 conn(0x7f73cc096ca0 legacy=0x7f73cc13c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.402 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.402 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 monclient: found mon.c 2021-05-26T16:41:11.403 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.403 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:11.403 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc12e350 con 0x7f73cc099db0 2021-05-26T16:41:11.403 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.403 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.404 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73d37bc700 5 monclient: authenticate success, global_id 4333 2021-05-26T16:41:11.404 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73d37bc700 10 monclient: _renew_subs 2021-05-26T16:41:11.404 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73d37bc700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:11.404 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc13cc40 con 0x7f73cc099db0 2021-05-26T16:41:11.404 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73d37bc700 10 monclient: _renew_subs 2021-05-26T16:41:11.405 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73d37bc700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:11.405 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc12f1b0 con 0x7f73cc099db0 2021-05-26T16:41:11.405 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f73bc004bb0 con 0x7f73cc099db0 2021-05-26T16:41:11.405 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:11.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f73bc005060 con 0x7f73cc099db0 2021-05-26T16:41:11.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:11.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73bb7fe700 4 set_mon_vals no callback set 2021-05-26T16:41:11.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.343+0000 7f73b97fa700 10 monclient: dump: 2021-05-26T16:41:11.407 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.407 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.407 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.407 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.407 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.408 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.408 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.408 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.408 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.409 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.409 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.409 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.409 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.409 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.410 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.410 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.344+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f73bc005270 con 0x7f73cc099db0 2021-05-26T16:41:11.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.344+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f73bc03da20 con 0x7f73cc099db0 2021-05-26T16:41:11.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.344+0000 7f73d37bc700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.344+0000 7f73d37bc700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.344+0000 7f73d37bc700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:11.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.344+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a4004db0 con 0x7f73cc099db0 2021-05-26T16:41:11.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.344+0000 7f73d1558700 10 monclient: get_auth_request con 0x7f73ac0335a0 auth_method 0 2021-05-26T16:41:11.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.348+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f73bc013760 con 0x7f73cc099db0 2021-05-26T16:41:11.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.348+0000 7f73b97fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.348+0000 7f73b97fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:11.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.506+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 --> v1:172.21.15.137:6812/30003 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73a4000b90 con 0x7f73ac0335a0 2021-05-26T16:41:11.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.508+0000 7f73b97fa700 1 -- 172.21.15.3:0/3142570049 <== mgr.4104 v1:172.21.15.137:6812/30003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+38644 (unknown 2965378022 0 1572859562) 0x7f73a4000b90 con 0x7f73ac0335a0 2021-05-26T16:41:11.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:11.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 >> v1:172.21.15.137:6812/30003 conn(0x7f73ac0335a0 legacy=0x7f73ac035a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 10 monclient: shutdown 2021-05-26T16:41:11.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:11.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 >> v1:172.21.15.3:6791/0 conn(0x7f73cc099db0 legacy=0x7f73cc1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 shutdown_connections 2021-05-26T16:41:11.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 >> 172.21.15.3:0/3142570049 conn(0x7f73cc09cc00 msgr2=0x7f73cc09f810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:11.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 shutdown_connections 2021-05-26T16:41:11.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.510+0000 7f73d37bc700 1 -- 172.21.15.3:0/3142570049 wait complete. 2021-05-26T16:41:11.515 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2021-05-26T16:41:11.524 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-05-26T16:41:10.586550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29544,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":28736,"kb_avail":566201496,"statfs":{"total":579820584960,"available":579790331904,"internally_reserved":0,"allocated":778240,"data_stored":228343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29425664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337071+0000","last_change":"2021-05-26T16:41:04.336448+0000","last_active":"2021-05-26T16:41:04.337071+0000","last_peered":"2021-05-26T16:41:04.337071+0000","last_clean":"2021-05-26T16:41:04.337071+0000","last_became_active":"2021-05-26T16:41:04.336153+0000","last_became_peered":"2021-05-26T16:41:04.336153+0000","last_unstale":"2021-05-26T16:41:04.337071+0000","last_undegraded":"2021-05-26T16:41:04.337071+0000","last_fullsized":"2021-05-26T16:41:04.337071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337482+0000","last_change":"2021-05-26T16:41:04.336928+0000","last_active":"2021-05-26T16:41:04.337482+0000","last_peered":"2021-05-26T16:41:04.337482+0000","last_clean":"2021-05-26T16:41:04.337482+0000","last_became_active":"2021-05-26T16:41:04.336581+0000","last_became_peered":"2021-05-26T16:41:04.336581+0000","last_unstale":"2021-05-26T16:41:04.337482+0000","last_undegraded":"2021-05-26T16:41:04.337482+0000","last_fullsized":"2021-05-26T16:41:04.337482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336466+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336466+0000","last_peered":"2021-05-26T16:41:04.336466+0000","last_clean":"2021-05-26T16:41:04.336466+0000","last_became_active":"2021-05-26T16:41:04.330738+0000","last_became_peered":"2021-05-26T16:41:04.330738+0000","last_unstale":"2021-05-26T16:41:04.336466+0000","last_undegraded":"2021-05-26T16:41:04.336466+0000","last_fullsized":"2021-05-26T16:41:04.336466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336420+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336420+0000","last_peered":"2021-05-26T16:41:04.336420+0000","last_clean":"2021-05-26T16:41:04.336420+0000","last_became_active":"2021-05-26T16:41:04.330720+0000","last_became_peered":"2021-05-26T16:41:04.330720+0000","last_unstale":"2021-05-26T16:41:04.336420+0000","last_undegraded":"2021-05-26T16:41:04.336420+0000","last_fullsized":"2021-05-26T16:41:04.336420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.328271+0000","last_change":"2021-05-26T16:41:03.320118+0000","last_active":"2021-05-26T16:41:04.328271+0000","last_peered":"2021-05-26T16:41:04.328271+0000","last_clean":"2021-05-26T16:41:04.328271+0000","last_became_active":"2021-05-26T16:41:03.319736+0000","last_became_peered":"2021-05-26T16:41:03.319736+0000","last_unstale":"2021-05-26T16:41:04.328271+0000","last_undegraded":"2021-05-26T16:41:04.328271+0000","last_fullsized":"2021-05-26T16:41:04.328271+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_clean_scrub_stamp":"2021-05-26T16:41:02.308057+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336008+0000","last_change":"2021-05-26T16:41:04.327668+0000","last_active":"2021-05-26T16:41:04.336008+0000","last_peered":"2021-05-26T16:41:04.336008+0000","last_clean":"2021-05-26T16:41:04.336008+0000","last_became_active":"2021-05-26T16:41:04.327310+0000","last_became_peered":"2021-05-26T16:41:04.327310+0000","last_unstale":"2021-05-26T16:41:04.336008+0000","last_undegraded":"2021-05-26T16:41:04.336008+0000","last_fullsized":"2021-05-26T16:41:04.336008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.329067+0000","last_change":"2021-05-26T16:41:04.327922+0000","last_active":"2021-05-26T16:41:04.329067+0000","last_peered":"2021-05-26T16:41:04.329067+0000","last_clean":"2021-05-26T16:41:04.329067+0000","last_became_active":"2021-05-26T16:41:04.327579+0000","last_became_peered":"2021-05-26T16:41:04.327579+0000","last_unstale":"2021-05-26T16:41:04.329067+0000","last_undegraded":"2021-05-26T16:41:04.329067+0000","last_fullsized":"2021-05-26T16:41:04.329067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336022+0000","last_change":"2021-05-26T16:41:04.327865+0000","last_active":"2021-05-26T16:41:04.336022+0000","last_peered":"2021-05-26T16:41:04.336022+0000","last_clean":"2021-05-26T16:41:04.336022+0000","last_became_active":"2021-05-26T16:41:04.327593+0000","last_became_peered":"2021-05-26T16:41:04.327593+0000","last_unstale":"2021-05-26T16:41:04.336022+0000","last_undegraded":"2021-05-26T16:41:04.336022+0000","last_fullsized":"2021-05-26T16:41:04.336022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.330247+0000","last_change":"2021-05-26T16:41:04.328266+0000","last_active":"2021-05-26T16:41:04.330247+0000","last_peered":"2021-05-26T16:41:04.330247+0000","last_clean":"2021-05-26T16:41:04.330247+0000","last_became_active":"2021-05-26T16:41:04.327859+0000","last_became_peered":"2021-05-26T16:41:04.327859+0000","last_unstale":"2021-05-26T16:41:04.330247+0000","last_undegraded":"2021-05-26T16:41:04.330247+0000","last_fullsized":"2021-05-26T16:41:04.330247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4928,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366912,"statfs":{"total":96636764160,"available":96631717888,"internally_reserved":0,"allocated":122880,"data_stored":34658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-05-26T16:41:11.526 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-05-26T16:41:11.641 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.638+0000 7f39392b7700 10 monclient: get_monmap_and_config 2021-05-26T16:41:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.638+0000 7f39392b7700 10 monclient: build_initial_monmap 2021-05-26T16:41:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.638+0000 7f39392b7700 10 monclient: monmap: 2021-05-26T16:41:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:11.640128+0000 2021-05-26T16:41:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:11.640128+0000 2021-05-26T16:41:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:11.646 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.656 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 1 Processor -- start 2021-05-26T16:41:11.656 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 1 -- start start 2021-05-26T16:41:11.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient: init 2021-05-26T16:41:11.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient: _add_conns ranks=[4,8,6,0,7,1,2,3,5] 2021-05-26T16:41:11.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient(hunting): picked mon.noname-c con 0x7f393412cbd0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:11.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient(hunting): picked mon.noname-e con 0x7f3934099a30 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:11.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient(hunting): picked mon.noname-d con 0x7f3934099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:11.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3934046600 con 0x7f393412cbd0 2021-05-26T16:41:11.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393409b5e0 con 0x7f3934099eb0 2021-05-26T16:41:11.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393412d8f0 con 0x7f3934099a30 2021-05-26T16:41:11.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f39392b7700 10 monclient(hunting): authenticate will time out at 829.271871s 2021-05-26T16:41:11.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f3933fff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f393412cbd0 0x7f393412d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36652/0 (socket says 172.21.15.3:36652) 2021-05-26T16:41:11.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.639+0000 7f3933fff700 1 -- 172.21.15.3:0/1036487870 learned_addr learned my addr 172.21.15.3:0/1036487870 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:11.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f39337fe700 1 -- 172.21.15.3:0/1036487870 >> v1:172.21.15.3:6793/0 conn(0x7f3934099a30 legacy=0x7f3934131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3938ab6700 1 -- 172.21.15.3:0/1036487870 >> v1:172.21.15.3:6792/0 conn(0x7f3934099eb0 legacy=0x7f3934135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3933fff700 1 -- 172.21.15.3:0/1036487870 >> v1:172.21.15.3:6791/0 conn(0x7f393412cbd0 legacy=0x7f393412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025887853 0 0) 0x7f393409b5e0 con 0x7f3934099eb0 2021-05-26T16:41:11.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): my global_id is 4308 2021-05-26T16:41:11.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3918003270 con 0x7f3934099eb0 2021-05-26T16:41:11.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563617762 0 0) 0x7f393412d8f0 con 0x7f3934099a30 2021-05-26T16:41:11.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): my global_id is 4301 2021-05-26T16:41:11.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f393409b5e0 con 0x7f3934099a30 2021-05-26T16:41:11.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722903538 0 0) 0x7f3934046600 con 0x7f393412cbd0 2021-05-26T16:41:11.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient(hunting): my global_id is 4342 2021-05-26T16:41:11.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f393412d8f0 con 0x7f393412cbd0 2021-05-26T16:41:11.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2291427538 0 0) 0x7f3918003270 con 0x7f3934099eb0 2021-05-26T16:41:11.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 >> v1:172.21.15.3:6793/0 conn(0x7f3934099a30 legacy=0x7f3934131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 >> v1:172.21.15.3:6791/0 conn(0x7f393412cbd0 legacy=0x7f393412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 monclient: found mon.noname-d 2021-05-26T16:41:11.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:11.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393409c2b0 con 0x7f3934099eb0 2021-05-26T16:41:11.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3928001e30 con 0x7f3934099eb0 2021-05-26T16:41:11.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f39392b7700 5 monclient: authenticate success, global_id 4308 2021-05-26T16:41:11.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: dump: 2021-05-26T16:41:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.669 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.669 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.669 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.669 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.669 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.670 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.670 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.670 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.670 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.670 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f39392b7700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:11.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3928002280 con 0x7f3934099eb0 2021-05-26T16:41:11.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:11.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 1 -- 172.21.15.3:0/1036487870 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3928002730 con 0x7f3934099eb0 2021-05-26T16:41:11.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f39392b7700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:11.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f39392b7700 4 set_mon_vals no callback set 2021-05-26T16:41:11.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:11.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.642+0000 7f3932ffd700 10 monclient: dump: 2021-05-26T16:41:11.672 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.673 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.673 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.673 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.673 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.673 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.676 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 10 monclient: shutdown 2021-05-26T16:41:11.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:11.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 1 -- 172.21.15.3:0/1036487870 >> v1:172.21.15.3:6792/0 conn(0x7f3934099eb0 legacy=0x7f3934135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 1 -- 172.21.15.3:0/1036487870 shutdown_connections 2021-05-26T16:41:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 1 -- 172.21.15.3:0/1036487870 >> 172.21.15.3:0/1036487870 conn(0x7f39340a00c0 msgr2=0x7f39340a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 1 -- 172.21.15.3:0/1036487870 shutdown_connections 2021-05-26T16:41:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 1 -- 172.21.15.3:0/1036487870 wait complete. 2021-05-26T16:41:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 10 monclient: build_initial_monmap 2021-05-26T16:41:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.643+0000 7f39392b7700 10 monclient: monmap: 2021-05-26T16:41:11.678 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:11.678 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:11.678 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:11.678 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:11.679 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:11.679 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.679 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:11.679 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:11.679 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:11.680 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:11.680 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:11.680 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:11.680 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:11.680 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:11.681 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 1 Processor -- start 2021-05-26T16:41:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 1 -- start start 2021-05-26T16:41:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient: init 2021-05-26T16:41:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient: _add_conns ranks=[5,6,0,2,7,4,8,1,3] 2021-05-26T16:41:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient(hunting): picked mon.noname-h con 0x7f3934099a30 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient(hunting): picked mon.noname-d con 0x7f3934099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient(hunting): picked mon.noname-a con 0x7f393412cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39341166d0 con 0x7f393412cbd0 2021-05-26T16:41:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3934116970 con 0x7f3934099a30 2021-05-26T16:41:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3934116c10 con 0x7f3934099eb0 2021-05-26T16:41:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39392b7700 10 monclient(hunting): authenticate will time out at 829.276915s 2021-05-26T16:41:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39337fe700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f3934099eb0 0x7f3934140fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56548/0 (socket says 172.21.15.3:56548) 2021-05-26T16:41:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.644+0000 7f39337fe700 1 -- 172.21.15.3:0/348205498 learned_addr learned my addr 172.21.15.3:0/348205498 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39337fe700 1 -- 172.21.15.3:0/348205498 >> v1:172.21.15.3:6792/0 conn(0x7f3934099eb0 legacy=0x7f3934140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f3938ab6700 1 -- 172.21.15.3:0/348205498 >> v1:172.21.15.3:6789/0 conn(0x7f393412cbd0 legacy=0x7f39341446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87043296 0 0) 0x7f3934116c10 con 0x7f3934099eb0 2021-05-26T16:41:11.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): my global_id is 4317 2021-05-26T16:41:11.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3914003270 con 0x7f3934099eb0 2021-05-26T16:41:11.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149124462 0 0) 0x7f39341166d0 con 0x7f393412cbd0 2021-05-26T16:41:11.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): my global_id is 4392 2021-05-26T16:41:11.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3934116c10 con 0x7f393412cbd0 2021-05-26T16:41:11.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f3933fff700 1 -- 172.21.15.3:0/348205498 >> v1:172.21.15.137:6791/0 conn(0x7f3934099a30 legacy=0x7f393413c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1736402611 0 0) 0x7f3914003270 con 0x7f3934099eb0 2021-05-26T16:41:11.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f39341166d0 con 0x7f3934099eb0 2021-05-26T16:41:11.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3924002240 con 0x7f3934099eb0 2021-05-26T16:41:11.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:11.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): dump: 2021-05-26T16:41:11.688 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.689 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.689 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.689 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.689 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.689 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.691 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.691 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.691 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.691 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.691 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3670684008 0 0) 0x7f3934116c10 con 0x7f393412cbd0 2021-05-26T16:41:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3914003270 con 0x7f393412cbd0 2021-05-26T16:41:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3928002730 con 0x7f393412cbd0 2021-05-26T16:41:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): dump: 2021-05-26T16:41:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.695 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.695 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.695 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.695 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.695 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.696 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.696 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.696 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.696 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480480447 0 0) 0x7f3934116970 con 0x7f3934099a30 2021-05-26T16:41:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient(hunting): my global_id is 4397 2021-05-26T16:41:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3934116c10 con 0x7f3934099a30 2021-05-26T16:41:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1249968746 0 0) 0x7f39341166d0 con 0x7f3934099eb0 2021-05-26T16:41:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 >> v1:172.21.15.137:6791/0 conn(0x7f3934099a30 legacy=0x7f393413c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 >> v1:172.21.15.3:6789/0 conn(0x7f393412cbd0 legacy=0x7f39341446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 monclient: found mon.d 2021-05-26T16:41:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934095350 con 0x7f3934099eb0 2021-05-26T16:41:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39392b7700 5 monclient: authenticate success, global_id 4317 2021-05-26T16:41:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39392b7700 10 monclient: _renew_subs 2021-05-26T16:41:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39392b7700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3934129a20 con 0x7f3934099eb0 2021-05-26T16:41:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39392b7700 10 monclient: _renew_subs 2021-05-26T16:41:11.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39392b7700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:11.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f393413cae0 con 0x7f3934099eb0 2021-05-26T16:41:11.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3924002510 con 0x7f3934099eb0 2021-05-26T16:41:11.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:11.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f39240029c0 con 0x7f3934099eb0 2021-05-26T16:41:11.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f39327fc700 4 set_mon_vals no callback set 2021-05-26T16:41:11.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:11.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.647+0000 7f391ffff700 10 monclient: dump: 2021-05-26T16:41:11.703 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.703 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.703 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.703 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.703 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.704 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.704 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.704 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.704 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.704 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.705 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.705 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.705 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.705 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.705 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.706 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.648+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f3924002ba0 con 0x7f3934099eb0 2021-05-26T16:41:11.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.648+0000 7f39392b7700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.648+0000 7f39392b7700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.648+0000 7f39392b7700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:11.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.648+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f392403d9b0 con 0x7f3934099eb0 2021-05-26T16:41:11.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.648+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c004db0 con 0x7f3934099eb0 2021-05-26T16:41:11.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.649+0000 7f3933fff700 10 monclient: get_auth_request con 0x7f3914032f40 auth_method 0 2021-05-26T16:41:11.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.653+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f3924013680 con 0x7f3934099eb0 2021-05-26T16:41:11.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.653+0000 7f391ffff700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:11.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.653+0000 7f391ffff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:11.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.806+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 --> v1:172.21.15.137:6812/30003 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f390c000b90 con 0x7f3914032f40 2021-05-26T16:41:11.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.808+0000 7f391ffff700 1 -- 172.21.15.3:0/348205498 <== mgr.4104 v1:172.21.15.137:6812/30003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+38644 (unknown 2965378022 0 1572859562) 0x7f390c000b90 con 0x7f3914032f40 2021-05-26T16:41:11.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:11.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.809+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 >> v1:172.21.15.137:6812/30003 conn(0x7f3914032f40 legacy=0x7f3914035400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.809+0000 7f39392b7700 10 monclient: shutdown 2021-05-26T16:41:11.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.809+0000 7f39392b7700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:11.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.809+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 >> v1:172.21.15.3:6792/0 conn(0x7f3934099eb0 legacy=0x7f3934140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.809+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 shutdown_connections 2021-05-26T16:41:11.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.809+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 >> 172.21.15.3:0/348205498 conn(0x7f39340a00c0 msgr2=0x7f393412b330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:11.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.810+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 shutdown_connections 2021-05-26T16:41:11.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.810+0000 7f39392b7700 1 -- 172.21.15.3:0/348205498 wait complete. 2021-05-26T16:41:11.815 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2021-05-26T16:41:11.825 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-05-26T16:41:10.586550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29544,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":28736,"kb_avail":566201496,"statfs":{"total":579820584960,"available":579790331904,"internally_reserved":0,"allocated":778240,"data_stored":228343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29425664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337071+0000","last_change":"2021-05-26T16:41:04.336448+0000","last_active":"2021-05-26T16:41:04.337071+0000","last_peered":"2021-05-26T16:41:04.337071+0000","last_clean":"2021-05-26T16:41:04.337071+0000","last_became_active":"2021-05-26T16:41:04.336153+0000","last_became_peered":"2021-05-26T16:41:04.336153+0000","last_unstale":"2021-05-26T16:41:04.337071+0000","last_undegraded":"2021-05-26T16:41:04.337071+0000","last_fullsized":"2021-05-26T16:41:04.337071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337482+0000","last_change":"2021-05-26T16:41:04.336928+0000","last_active":"2021-05-26T16:41:04.337482+0000","last_peered":"2021-05-26T16:41:04.337482+0000","last_clean":"2021-05-26T16:41:04.337482+0000","last_became_active":"2021-05-26T16:41:04.336581+0000","last_became_peered":"2021-05-26T16:41:04.336581+0000","last_unstale":"2021-05-26T16:41:04.337482+0000","last_undegraded":"2021-05-26T16:41:04.337482+0000","last_fullsized":"2021-05-26T16:41:04.337482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336466+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336466+0000","last_peered":"2021-05-26T16:41:04.336466+0000","last_clean":"2021-05-26T16:41:04.336466+0000","last_became_active":"2021-05-26T16:41:04.330738+0000","last_became_peered":"2021-05-26T16:41:04.330738+0000","last_unstale":"2021-05-26T16:41:04.336466+0000","last_undegraded":"2021-05-26T16:41:04.336466+0000","last_fullsized":"2021-05-26T16:41:04.336466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336420+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336420+0000","last_peered":"2021-05-26T16:41:04.336420+0000","last_clean":"2021-05-26T16:41:04.336420+0000","last_became_active":"2021-05-26T16:41:04.330720+0000","last_became_peered":"2021-05-26T16:41:04.330720+0000","last_unstale":"2021-05-26T16:41:04.336420+0000","last_undegraded":"2021-05-26T16:41:04.336420+0000","last_fullsized":"2021-05-26T16:41:04.336420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.328271+0000","last_change":"2021-05-26T16:41:03.320118+0000","last_active":"2021-05-26T16:41:04.328271+0000","last_peered":"2021-05-26T16:41:04.328271+0000","last_clean":"2021-05-26T16:41:04.328271+0000","last_became_active":"2021-05-26T16:41:03.319736+0000","last_became_peered":"2021-05-26T16:41:03.319736+0000","last_unstale":"2021-05-26T16:41:04.328271+0000","last_undegraded":"2021-05-26T16:41:04.328271+0000","last_fullsized":"2021-05-26T16:41:04.328271+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_clean_scrub_stamp":"2021-05-26T16:41:02.308057+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336008+0000","last_change":"2021-05-26T16:41:04.327668+0000","last_active":"2021-05-26T16:41:04.336008+0000","last_peered":"2021-05-26T16:41:04.336008+0000","last_clean":"2021-05-26T16:41:04.336008+0000","last_became_active":"2021-05-26T16:41:04.327310+0000","last_became_peered":"2021-05-26T16:41:04.327310+0000","last_unstale":"2021-05-26T16:41:04.336008+0000","last_undegraded":"2021-05-26T16:41:04.336008+0000","last_fullsized":"2021-05-26T16:41:04.336008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.329067+0000","last_change":"2021-05-26T16:41:04.327922+0000","last_active":"2021-05-26T16:41:04.329067+0000","last_peered":"2021-05-26T16:41:04.329067+0000","last_clean":"2021-05-26T16:41:04.329067+0000","last_became_active":"2021-05-26T16:41:04.327579+0000","last_became_peered":"2021-05-26T16:41:04.327579+0000","last_unstale":"2021-05-26T16:41:04.329067+0000","last_undegraded":"2021-05-26T16:41:04.329067+0000","last_fullsized":"2021-05-26T16:41:04.329067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336022+0000","last_change":"2021-05-26T16:41:04.327865+0000","last_active":"2021-05-26T16:41:04.336022+0000","last_peered":"2021-05-26T16:41:04.336022+0000","last_clean":"2021-05-26T16:41:04.336022+0000","last_became_active":"2021-05-26T16:41:04.327593+0000","last_became_peered":"2021-05-26T16:41:04.327593+0000","last_unstale":"2021-05-26T16:41:04.336022+0000","last_undegraded":"2021-05-26T16:41:04.336022+0000","last_fullsized":"2021-05-26T16:41:04.336022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.330247+0000","last_change":"2021-05-26T16:41:04.328266+0000","last_active":"2021-05-26T16:41:04.330247+0000","last_peered":"2021-05-26T16:41:04.330247+0000","last_clean":"2021-05-26T16:41:04.330247+0000","last_became_active":"2021-05-26T16:41:04.327859+0000","last_became_peered":"2021-05-26T16:41:04.327859+0000","last_unstale":"2021-05-26T16:41:04.330247+0000","last_undegraded":"2021-05-26T16:41:04.330247+0000","last_fullsized":"2021-05-26T16:41:04.330247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4928,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366912,"statfs":{"total":96636764160,"available":96631717888,"internally_reserved":0,"allocated":122880,"data_stored":34658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-05-26T16:41:11.828 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-05-26T16:41:11.829 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-05-26T16:41:11.829 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-05-26T16:41:11.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-05-26T16:41:11.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.941+0000 7f875f627700 10 monclient: get_monmap_and_config 2021-05-26T16:41:11.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.941+0000 7f875f627700 10 monclient: build_initial_monmap 2021-05-26T16:41:11.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.941+0000 7f875f627700 10 monclient: monmap: 2021-05-26T16:41:11.945 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:11.945 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.946 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:11.943042+0000 2021-05-26T16:41:11.946 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:11.943042+0000 2021-05-26T16:41:11.947 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:11.947 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.948 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:11.948 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:11.948 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:11.949 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:11.949 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:11.950 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:11.951 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:11.951 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:11.951 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:11.951 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 1 Processor -- start 2021-05-26T16:41:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 1 -- start start 2021-05-26T16:41:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient: init 2021-05-26T16:41:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient: _add_conns ranks=[7,8,2,3,6,5,0,1,4] 2021-05-26T16:41:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient(hunting): picked mon.noname-i con 0x7f8758096ca0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient(hunting): picked mon.noname-e con 0x7f8758099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient(hunting): picked mon.noname-b con 0x7f875809a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:11.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758059750 con 0x7f875809a260 2021-05-26T16:41:11.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758064620 con 0x7f8758096ca0 2021-05-26T16:41:11.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758064e50 con 0x7f8758099db0 2021-05-26T16:41:11.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875f627700 10 monclient(hunting): authenticate will time out at 829.574770s 2021-05-26T16:41:11.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875cbc2700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f8758099db0 0x7f8758132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52234/0 (socket says 172.21.15.3:52234) 2021-05-26T16:41:11.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875cbc2700 1 -- 172.21.15.3:0/4269365575 learned_addr learned my addr 172.21.15.3:0/4269365575 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:11.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.942+0000 7f875dbc4700 1 --1- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6790/0 conn(0x7f875809a260 0x7f87581357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53200/0 (socket says 172.21.15.3:53200) 2021-05-26T16:41:11.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875dbc4700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6790/0 conn(0x7f875809a260 legacy=0x7f87581357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875cbc2700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6793/0 conn(0x7f8758099db0 legacy=0x7f8758132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145895658 0 0) 0x7f8758059750 con 0x7f875809a260 2021-05-26T16:41:11.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): my global_id is 4340 2021-05-26T16:41:11.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8740003270 con 0x7f875809a260 2021-05-26T16:41:11.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875d3c3700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.137:6792/0 conn(0x7f8758096ca0 legacy=0x7f8758063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498327688 0 0) 0x7f8758064e50 con 0x7f8758099db0 2021-05-26T16:41:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): my global_id is 4310 2021-05-26T16:41:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8758059750 con 0x7f8758099db0 2021-05-26T16:41:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760057242 0 0) 0x7f8758064620 con 0x7f8758096ca0 2021-05-26T16:41:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:11.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient(hunting): my global_id is 4282 2021-05-26T16:41:11.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8758064e50 con 0x7f8758096ca0 2021-05-26T16:41:11.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029655234 0 0) 0x7f8740003270 con 0x7f875809a260 2021-05-26T16:41:11.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6793/0 conn(0x7f8758099db0 legacy=0x7f8758132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.137:6792/0 conn(0x7f8758096ca0 legacy=0x7f8758063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 monclient: found mon.noname-b 2021-05-26T16:41:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875809c390 con 0x7f875809a260 2021-05-26T16:41:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875f627700 5 monclient: authenticate success, global_id 4340 2021-05-26T16:41:11.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8754001dd0 con 0x7f875809a260 2021-05-26T16:41:11.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:11.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875dbc4700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6790/0 conn(0x7f875809a260 legacy=0x7f87581357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2021-05-26T16:41:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875dbc4700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6790/0 conn(0x7f875809a260 legacy=0x7f87581357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:41:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875dbc4700 1 --1- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6790/0 conn(0x7f875809a260 0x7f87581357b0 :-1 s=OPENED pgs=68 cs=1 l=1).handle_message read tag failed 2021-05-26T16:41:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 10 monclient: dump: 2021-05-26T16:41:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.986 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.986 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.986 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.986 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875dbc4700 1 --1- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6790/0 conn(0x7f875809a260 0x7f87581357b0 :-1 s=OPENED pgs=68 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:41:11.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f875f627700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:11.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.945+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 DispatchQueue::entry inject delay of 0.002000 2021-05-26T16:41:11.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient: ms_handle_reset current mon v1:172.21.15.3:6790/0 2021-05-26T16:41:11.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:11.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6790/0 conn(0x7f875809a260 legacy=0x7f87581357b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:11.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient: _add_conns ranks=[0,8,3,2,4,6,5,7,1] 2021-05-26T16:41:11.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient(hunting): picked mon.a con 0x7f87400034b0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:11.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient(hunting): picked mon.e con 0x7f8758099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:11.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient(hunting): picked mon.g con 0x7f8740003fa0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:11.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8740003270 con 0x7f87400034b0 2021-05-26T16:41:11.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8758059750 con 0x7f8740003fa0 2021-05-26T16:41:11.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8758064620 con 0x7f8758099db0 2021-05-26T16:41:11.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:11.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.947+0000 7f8747fff700 10 monclient(hunting): ms_handle_reset stray mon v1:172.21.15.3:6790/0 2021-05-26T16:41:11.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f875cbc2700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6793/0 conn(0x7f8758099db0 legacy=0x7f874000a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f875d3c3700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6789/0 conn(0x7f87400034b0 legacy=0x7f8740003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975328649 0 0) 0x7f8758064620 con 0x7f8758099db0 2021-05-26T16:41:11.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient(hunting): _init_auth already have auth, reseting 2021-05-26T16:41:11.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6793/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f874000f740 con 0x7f8758099db0 2021-05-26T16:41:11.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921115994 0 0) 0x7f8740003270 con 0x7f87400034b0 2021-05-26T16:41:11.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:11.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient(hunting): _init_auth already have auth, reseting 2021-05-26T16:41:11.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6789/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f8758064620 con 0x7f87400034b0 2021-05-26T16:41:11.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f875dbc4700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.137:6790/0 conn(0x7f8740003fa0 legacy=0x7f874000de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:11.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (unknown 90749905 0 0) 0x7f874000f740 con 0x7f8758099db0 2021-05-26T16:41:11.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.137:6790/0 conn(0x7f8740003fa0 legacy=0x7f874000de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6789/0 conn(0x7f87400034b0 legacy=0x7f8740003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:11.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:11.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 monclient: found mon.e 2021-05-26T16:41:11.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:11.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:11.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=2+}) v3 -- 0x7f87400128b0 con 0x7f8758099db0 2021-05-26T16:41:11.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:11.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:11.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8748004a90 con 0x7f8758099db0 2021-05-26T16:41:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: dump: 2021-05-26T16:41:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:11.996 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:11.996 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.996 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:11.996 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:11.996 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:11.997 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:11.997 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:11.997 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:11.997 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:11.997 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:11.999 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f875f627700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (unknown 4164950227 0 0) 0x7f8758064620 con 0x7f87400034b0 2021-05-26T16:41:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f874c001c20 con 0x7f87400034b0 2021-05-26T16:41:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:41:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 1 -- 172.21.15.3:0/4269365575 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8748004cb0 con 0x7f8758099db0 2021-05-26T16:41:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f8747fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f875f627700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.950+0000 7f875f627700 4 set_mon_vals no callback set 2021-05-26T16:41:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 10 monclient: shutdown 2021-05-26T16:41:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 1 -- 172.21.15.3:0/4269365575 >> v1:172.21.15.3:6793/0 conn(0x7f8758099db0 legacy=0x7f874000a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875dbc4700 1 -- 172.21.15.3:0/4269365575 reap_dead start 2021-05-26T16:41:12.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 1 -- 172.21.15.3:0/4269365575 shutdown_connections 2021-05-26T16:41:12.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 1 -- 172.21.15.3:0/4269365575 >> 172.21.15.3:0/4269365575 conn(0x7f875809cc00 msgr2=0x7f875809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:12.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 1 -- 172.21.15.3:0/4269365575 shutdown_connections 2021-05-26T16:41:12.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 1 -- 172.21.15.3:0/4269365575 wait complete. 2021-05-26T16:41:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 10 monclient: build_initial_monmap 2021-05-26T16:41:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.951+0000 7f875f627700 10 monclient: monmap: 2021-05-26T16:41:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:12.006 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 1 Processor -- start 2021-05-26T16:41:12.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 1 -- start start 2021-05-26T16:41:12.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient: init 2021-05-26T16:41:12.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:12.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient: _add_conns ranks=[1,0,7,2,3,5,6,8,4] 2021-05-26T16:41:12.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient(hunting): picked mon.noname-f con 0x7f8758099db0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:12.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient(hunting): picked mon.noname-a con 0x7f8758129e20 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:12.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient(hunting): picked mon.noname-i con 0x7f87580945e0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:12.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875813cee0 con 0x7f8758129e20 2021-05-26T16:41:12.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758116c10 con 0x7f8758099db0 2021-05-26T16:41:12.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758116eb0 con 0x7f87580945e0 2021-05-26T16:41:12.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:12.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875f627700 10 monclient(hunting): authenticate will time out at 829.584873s 2021-05-26T16:41:12.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875cbc2700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8758129e20 0x7f8758141390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51168/0 (socket says 172.21.15.3:51168) 2021-05-26T16:41:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.952+0000 7f875cbc2700 1 -- 172.21.15.3:0/1359849919 learned_addr learned my addr 172.21.15.3:0/1359849919 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875cbc2700 1 -- 172.21.15.3:0/1359849919 >> v1:172.21.15.3:6789/0 conn(0x7f8758129e20 legacy=0x7f8758141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776713764 0 0) 0x7f875813cee0 con 0x7f8758129e20 2021-05-26T16:41:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): my global_id is 4401 2021-05-26T16:41:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8738003270 con 0x7f8758129e20 2021-05-26T16:41:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875d3c3700 1 -- 172.21.15.3:0/1359849919 >> v1:172.21.15.137:6789/0 conn(0x7f8758099db0 legacy=0x7f8758129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875dbc4700 1 -- 172.21.15.3:0/1359849919 >> v1:172.21.15.137:6792/0 conn(0x7f87580945e0 legacy=0x7f8758144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2317808652 0 0) 0x7f8738003270 con 0x7f8758129e20 2021-05-26T16:41:12.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f875813cee0 con 0x7f8758129e20 2021-05-26T16:41:12.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8748004870 con 0x7f8758129e20 2021-05-26T16:41:12.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:12.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): dump: 2021-05-26T16:41:12.013 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.013 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.013 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.014 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.014 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.014 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.014 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.014 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.015 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.015 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.015 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.015 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.016 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.016 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.016 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.016 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:12.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056578173 0 0) 0x7f8758116c10 con 0x7f8758099db0 2021-05-26T16:41:12.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): my global_id is 4294 2021-05-26T16:41:12.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8738003270 con 0x7f8758099db0 2021-05-26T16:41:12.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106568915 0 0) 0x7f8758116eb0 con 0x7f87580945e0 2021-05-26T16:41:12.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient(hunting): my global_id is 4291 2021-05-26T16:41:12.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8758116c10 con 0x7f87580945e0 2021-05-26T16:41:12.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2659926356 0 0) 0x7f875813cee0 con 0x7f8758129e20 2021-05-26T16:41:12.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 >> v1:172.21.15.137:6792/0 conn(0x7f87580945e0 legacy=0x7f8758144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 >> v1:172.21.15.137:6789/0 conn(0x7f8758099db0 legacy=0x7f8758129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:12.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 monclient: found mon.a 2021-05-26T16:41:12.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:12.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758117150 con 0x7f8758129e20 2021-05-26T16:41:12.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:12.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:12.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875f627700 5 monclient: authenticate success, global_id 4401 2021-05-26T16:41:12.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875f627700 10 monclient: _renew_subs 2021-05-26T16:41:12.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875f627700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8758095c20 con 0x7f8758129e20 2021-05-26T16:41:12.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875f627700 10 monclient: _renew_subs 2021-05-26T16:41:12.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875f627700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8758131530 con 0x7f8758129e20 2021-05-26T16:41:12.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8748001580 con 0x7f8758129e20 2021-05-26T16:41:12.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:12.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8748001ad0 con 0x7f8758129e20 2021-05-26T16:41:12.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87477fe700 4 set_mon_vals no callback set 2021-05-26T16:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.955+0000 7f87457fa700 10 monclient: dump: 2021-05-26T16:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.025 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.025 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.025 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.025 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.025 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.956+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f874800e820 con 0x7f8758129e20 2021-05-26T16:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.956+0000 7f875f627700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.956+0000 7f875f627700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.956+0000 7f875f627700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.956+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8730004db0 con 0x7f8758129e20 2021-05-26T16:41:12.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.956+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f874803daa0 con 0x7f8758129e20 2021-05-26T16:41:12.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.956+0000 7f875d3c3700 10 monclient: get_auth_request con 0x7f8738032a80 auth_method 0 2021-05-26T16:41:12.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.961+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f87480137e0 con 0x7f8758129e20 2021-05-26T16:41:12.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.961+0000 7f87457fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:11.961+0000 7f87457fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:12.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.183+0000 7f875f627700 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2021-05-26T16:41:12.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.183+0000 7f875f627700 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2021-05-26T16:41:12.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.183+0000 7f875f627700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.183+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f87300055e0 con 0x7f8758129e20 2021-05-26T16:41:12.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.184+0000 7f87457fa700 1 -- 172.21.15.3:0/1359849919 <== mon.0 v1:172.21.15.3:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f87480133d0 con 0x7f8758129e20 2021-05-26T16:41:12.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.184+0000 7f87457fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2021-05-26T16:41:12.190 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.184+0000 7f87457fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:12.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:12.193 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-05-26T16:41:12.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 >> v1:172.21.15.137:6812/30003 conn(0x7f8738032a80 legacy=0x7f8738034f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 10 monclient: shutdown 2021-05-26T16:41:12.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:12.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 >> v1:172.21.15.3:6789/0 conn(0x7f8758129e20 legacy=0x7f8758141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 shutdown_connections 2021-05-26T16:41:12.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 >> 172.21.15.3:0/1359849919 conn(0x7f875809cc00 msgr2=0x7f8758097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:12.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 shutdown_connections 2021-05-26T16:41:12.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.185+0000 7f875f627700 1 -- 172.21.15.3:0/1359849919 wait complete. 2021-05-26T16:41:12.200 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-05-26T16:41:12.201 INFO:teuthology.run_tasks:Running task mon_thrash... 2021-05-26T16:41:12.218 INFO:tasks.mon_thrash:Beginning mon_thrash... 2021-05-26T16:41:12.219 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-05-26T16:41:12.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.332+0000 7fb821bc1700 10 monclient: get_monmap_and_config 2021-05-26T16:41:12.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.333+0000 7fb821bc1700 10 monclient: build_initial_monmap 2021-05-26T16:41:12.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.333+0000 7fb821bc1700 10 monclient: monmap: 2021-05-26T16:41:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:12.334606+0000 2021-05-26T16:41:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:12.334606+0000 2021-05-26T16:41:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:12.339 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:12.339 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:12.339 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:12.339 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:12.339 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:12.340 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:12.340 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.333+0000 7fb821bc1700 1 Processor -- start 2021-05-26T16:41:12.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.333+0000 7fb821bc1700 1 -- start start 2021-05-26T16:41:12.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.333+0000 7fb821bc1700 10 monclient: init 2021-05-26T16:41:12.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:12.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 10 monclient: _add_conns ranks=[4,3,7,2,5,0,8,1,6] 2021-05-26T16:41:12.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 10 monclient(hunting): picked mon.noname-c con 0x7fb81c064aa0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:12.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 10 monclient(hunting): picked mon.noname-g con 0x7fb81c099c40 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:12.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 10 monclient(hunting): picked mon.noname-i con 0x7fb81c09a0c0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:12.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c059750 con 0x7fb81c099c40 2021-05-26T16:41:12.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c09a530 con 0x7fb81c064aa0 2021-05-26T16:41:12.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c09c4e0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:12.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb821bc1700 10 monclient(hunting): authenticate will time out at 829.966236s 2021-05-26T16:41:12.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb81b7fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fb81c064aa0 0x7fb81c063f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36690/0 (socket says 172.21.15.3:36690) 2021-05-26T16:41:12.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.334+0000 7fb81b7fe700 1 -- 172.21.15.3:0/1780877945 learned_addr learned my addr 172.21.15.3:0/1780877945 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:12.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81b7fe700 1 -- 172.21.15.3:0/1780877945 >> v1:172.21.15.3:6791/0 conn(0x7fb81c064aa0 legacy=0x7fb81c063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428623209 0 0) 0x7fb808001450 con 0x7fb81c064aa0 2021-05-26T16:41:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 10 monclient(hunting): my global_id is 4351 2021-05-26T16:41:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb800003270 con 0x7fb81c064aa0 2021-05-26T16:41:12.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81bfff700 1 -- 172.21.15.3:0/1780877945 >> v1:172.21.15.137:6792/0 conn(0x7fb81c09a0c0 legacy=0x7fb81c1357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81affd700 1 -- 172.21.15.3:0/1780877945 >> v1:172.21.15.137:6790/0 conn(0x7fb81c099c40 legacy=0x7fb81c132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1345635685 0 0) 0x7fb800003270 con 0x7fb81c064aa0 2021-05-26T16:41:12.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 >> v1:172.21.15.137:6792/0 conn(0x7fb81c09a0c0 legacy=0x7fb81c1357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 >> v1:172.21.15.137:6790/0 conn(0x7fb81c099c40 legacy=0x7fb81c132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 1 monclient: found mon.noname-c 2021-05-26T16:41:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.336+0000 7fb81a7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c09c780 con 0x7fb81c064aa0 2021-05-26T16:41:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb808001bf0 con 0x7fb81c064aa0 2021-05-26T16:41:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 5 monclient: authenticate success, global_id 4351 2021-05-26T16:41:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: dump: 2021-05-26T16:41:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.358 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.358 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.358 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.358 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.358 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.359 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.359 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.359 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.359 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.359 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.361 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb808004630 con 0x7fb81c064aa0 2021-05-26T16:41:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 1 -- 172.21.15.3:0/1780877945 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb808004b20 con 0x7fb81c064aa0 2021-05-26T16:41:12.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:12.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 4 set_mon_vals no callback set 2021-05-26T16:41:12.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:12.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb81a7fc700 10 monclient: dump: 2021-05-26T16:41:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.365 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.365 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.365 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.365 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.365 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.366 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.366 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 10 monclient: shutdown 2021-05-26T16:41:12.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 1 -- 172.21.15.3:0/1780877945 >> v1:172.21.15.3:6791/0 conn(0x7fb81c064aa0 legacy=0x7fb81c063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 1 -- 172.21.15.3:0/1780877945 shutdown_connections 2021-05-26T16:41:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 1 -- 172.21.15.3:0/1780877945 >> 172.21.15.3:0/1780877945 conn(0x7fb81c05e1e0 msgr2=0x7fb81c09cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 1 -- 172.21.15.3:0/1780877945 shutdown_connections 2021-05-26T16:41:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.337+0000 7fb821bc1700 1 -- 172.21.15.3:0/1780877945 wait complete. 2021-05-26T16:41:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 10 monclient: build_initial_monmap 2021-05-26T16:41:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 10 monclient: monmap: 2021-05-26T16:41:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:12.371 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:12.371 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:12.371 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:12.371 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 1 Processor -- start 2021-05-26T16:41:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 1 -- start start 2021-05-26T16:41:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 10 monclient: init 2021-05-26T16:41:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 10 monclient: _add_conns ranks=[1,2,3,5,4,8,0,7,6] 2021-05-26T16:41:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 10 monclient(hunting): picked mon.noname-f con 0x7fb81c099c40 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:12.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.338+0000 7fb821bc1700 10 monclient(hunting): picked mon.noname-b con 0x7fb81c09a0c0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:12.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb821bc1700 10 monclient(hunting): picked mon.noname-g con 0x7fb81c11ad80 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:12.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb821bc1700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c11bed0 con 0x7fb81c099c40 2021-05-26T16:41:12.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb821bc1700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c11c170 con 0x7fb81c09a0c0 2021-05-26T16:41:12.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb821bc1700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c11c410 con 0x7fb81c11ad80 2021-05-26T16:41:12.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb821bc1700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:12.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb821bc1700 10 monclient(hunting): authenticate will time out at 829.971048s 2021-05-26T16:41:12.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb81affd700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fb81c09a0c0 0x7fb81c1412a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53228/0 (socket says 172.21.15.3:53228) 2021-05-26T16:41:12.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.339+0000 7fb81affd700 1 -- 172.21.15.3:0/1955376257 learned_addr learned my addr 172.21.15.3:0/1955376257 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:12.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb81affd700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.3:6790/0 conn(0x7fb81c09a0c0 legacy=0x7fb81c1412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb81bfff700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6790/0 conn(0x7fb81c11ad80 legacy=0x7fb81c1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb81b7fe700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6789/0 conn(0x7fb81c099c40 legacy=0x7fb81c13c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020141476 0 0) 0x7fb81c11c170 con 0x7fb81c09a0c0 2021-05-26T16:41:12.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): my global_id is 4349 2021-05-26T16:41:12.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7fc003270 con 0x7fb81c09a0c0 2021-05-26T16:41:12.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb81b7fe700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6789/0 conn(0x7fb81c099c40 legacy=0x7fb81c13c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-05-26T16:41:12.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb81b7fe700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6789/0 conn(0x7fb81c099c40 legacy=0x7fb81c13c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:41:12.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb81b7fe700 1 --1- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6789/0 conn(0x7fb81c099c40 0x7fb81c13c610 :-1 s=OPENED pgs=67 cs=1 l=1).handle_message read tag failed 2021-05-26T16:41:12.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb81b7fe700 1 --1- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6789/0 conn(0x7fb81c099c40 0x7fb81c13c610 :-1 s=OPENED pgs=67 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:41:12.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.137:6789/0 2021-05-26T16:41:12.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895496952 0 0) 0x7fb81c11c410 con 0x7fb81c11ad80 2021-05-26T16:41:12.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): my global_id is 4323 2021-05-26T16:41:12.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb81c11c170 con 0x7fb81c11ad80 2021-05-26T16:41:12.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2264262642 0 0) 0x7fb7fc003270 con 0x7fb81c09a0c0 2021-05-26T16:41:12.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb81c11c410 con 0x7fb81c09a0c0 2021-05-26T16:41:12.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb80c001cb0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:12.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): dump: 2021-05-26T16:41:12.380 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.380 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.381 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.381 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.381 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.381 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.381 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.382 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.382 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.382 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.382 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.382 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.383 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2820847500 0 0) 0x7fb81c11c170 con 0x7fb81c11ad80 2021-05-26T16:41:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb7fc003270 con 0x7fb81c11ad80 2021-05-26T16:41:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb810001f20 con 0x7fb81c11ad80 2021-05-26T16:41:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:12.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient(hunting): dump: 2021-05-26T16:41:12.385 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.385 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.385 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.387 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.387 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.387 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.387 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.387 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.388 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.388 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.388 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2574257063 0 0) 0x7fb81c11c410 con 0x7fb81c09a0c0 2021-05-26T16:41:12.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6790/0 conn(0x7fb81c11ad80 legacy=0x7fb81c1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6789/0 conn(0x7fb81c099c40 legacy=0x7fb81c13c610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:12.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:12.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 monclient: found mon.b 2021-05-26T16:41:12.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:12.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:12.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c11a2a0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:12.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.341+0000 7fb8077fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:12.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb821bc1700 5 monclient: authenticate success, global_id 4349 2021-05-26T16:41:12.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb821bc1700 10 monclient: _renew_subs 2021-05-26T16:41:12.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb821bc1700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:12.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c12ef80 con 0x7fb81c09a0c0 2021-05-26T16:41:12.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb821bc1700 10 monclient: _renew_subs 2021-05-26T16:41:12.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb821bc1700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c13cee0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb80c002390 con 0x7fb81c09a0c0 2021-05-26T16:41:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb80c002840 con 0x7fb81c09a0c0 2021-05-26T16:41:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb819ffb700 4 set_mon_vals no callback set 2021-05-26T16:41:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 10 monclient: dump: 2021-05-26T16:41:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.397 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fb80c002a20 con 0x7fb81c09a0c0 2021-05-26T16:41:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.342+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fb80c03d7f0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.343+0000 7fb821bc1700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.343+0000 7fb821bc1700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.343+0000 7fb821bc1700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.343+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f4004db0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.343+0000 7fb81b7fe700 10 monclient: get_auth_request con 0x7fb7fc032f10 auth_method 0 2021-05-26T16:41:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.347+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fb80c0134c0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.347+0000 7fb8077fe700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.347+0000 7fb8077fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:12.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.508+0000 7fb821bc1700 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:12.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.508+0000 7fb821bc1700 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:12.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.508+0000 7fb821bc1700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:12.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.508+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f4005060 con 0x7fb81c09a0c0 2021-05-26T16:41:12.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.508+0000 7fb8077fe700 1 -- 172.21.15.3:0/1955376257 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9976 (unknown 4221056075 0 4226676142) 0x7fb80c0130b0 con 0x7fb81c09a0c0 2021-05-26T16:41:12.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.508+0000 7fb8077fe700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2021-05-26T16:41:12.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.508+0000 7fb8077fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:12.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:12.514 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","created":"2021-05-26T16:40:51.540326+0000","modified":"2021-05-26T16:41:05.316620+0000","last_up_change":"2021-05-26T16:41:01.304218+0000","last_in_change":"2021-05-26T16:40:55.160191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-05-26T16:41:01.359450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-05-26T16:41:03.248067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15008bbc-879f-43a6-bfbc-f16853c84582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6800","nonce":30458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6801","nonce":30458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6803","nonce":30458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6802","nonce":30458}]},"public_addr":"172.21.15.3:6800/30458","cluster_addr":"172.21.15.3:6801/30458","heartbeat_back_addr":"172.21.15.3:6803/30458","heartbeat_front_addr":"172.21.15.3:6802/30458","state":["exists","up"]},{"osd":1,"uuid":"13c28fda-7809-4964-9b17-4c6fb9fff0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6804","nonce":30459}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6805","nonce":30459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6808","nonce":30459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6806","nonce":30459}]},"public_addr":"172.21.15.3:6804/30459","cluster_addr":"172.21.15.3:6805/30459","heartbeat_back_addr":"172.21.15.3:6808/30459","heartbeat_front_addr":"172.21.15.3:6806/30459","state":["exists","up"]},{"osd":2,"uuid":"ca01de00-a5fb-4b03-9412-bca079506190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6807","nonce":30460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6809","nonce":30460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6811","nonce":30460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6810","nonce":30460}]},"public_addr":"172.21.15.3:6807/30460","cluster_addr":"172.21.15.3:6809/30460","heartbeat_back_addr":"172.21.15.3:6811/30460","heartbeat_front_addr":"172.21.15.3:6810/30460","state":["exists","up"]},{"osd":3,"uuid":"ecf54fc5-53a9-4585-a369-03a5d382cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6800","nonce":30479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6801","nonce":30479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6803","nonce":30479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6802","nonce":30479}]},"public_addr":"172.21.15.137:6800/30479","cluster_addr":"172.21.15.137:6801/30479","heartbeat_back_addr":"172.21.15.137:6803/30479","heartbeat_front_addr":"172.21.15.137:6802/30479","state":["exists","up"]},{"osd":4,"uuid":"c2926c74-967a-4c6d-acb7-4a0d32f89e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6804","nonce":30480}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6806","nonce":30480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6811","nonce":30480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6808","nonce":30480}]},"public_addr":"172.21.15.137:6804/30480","cluster_addr":"172.21.15.137:6806/30480","heartbeat_back_addr":"172.21.15.137:6811/30480","heartbeat_front_addr":"172.21.15.137:6808/30480","state":["exists","up"]},{"osd":5,"uuid":"acee8981-3ab2-4bad-b287-217a027a7b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6805","nonce":30481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6807","nonce":30481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6810","nonce":30481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6809","nonce":30481}]},"public_addr":"172.21.15.137:6805/30481","cluster_addr":"172.21.15.137:6807/30481","heartbeat_back_addr":"172.21.15.137:6810/30481","heartbeat_front_addr":"172.21.15.137:6809/30481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.244103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.235066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.269488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.281565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.243717+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-05-26T16:41:00.240437+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-05-26T16:41:12.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.137:6812/30003 conn(0x7fb7fc032f10 legacy=0x7fb7fc0353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 10 monclient: shutdown 2021-05-26T16:41:12.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:12.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 >> v1:172.21.15.3:6790/0 conn(0x7fb81c09a0c0 legacy=0x7fb81c1412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 shutdown_connections 2021-05-26T16:41:12.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 >> 172.21.15.3:0/1955376257 conn(0x7fb81c064aa0 msgr2=0x7fb81c09de80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:12.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 shutdown_connections 2021-05-26T16:41:12.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.510+0000 7fb821bc1700 1 -- 172.21.15.3:0/1955376257 wait complete. 2021-05-26T16:41:12.525 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-05-26T16:41:01.359450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-05-26T16:41:03.248067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-05-26T16:41:12.526 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-05-26T16:41:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.641+0000 7f5960901700 10 monclient: get_monmap_and_config 2021-05-26T16:41:12.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.641+0000 7f5960901700 10 monclient: build_initial_monmap 2021-05-26T16:41:12.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.641+0000 7f5960901700 10 monclient: monmap: 2021-05-26T16:41:12.645 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:12.645 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:12.642825+0000 2021-05-26T16:41:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:12.642825+0000 2021-05-26T16:41:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.647 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:12.647 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:12.647 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:12.647 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:12.647 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:12.648 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:12.648 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:12.648 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:12.648 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:12.649 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.641+0000 7f5960901700 1 Processor -- start 2021-05-26T16:41:12.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.641+0000 7f5960901700 1 -- start start 2021-05-26T16:41:12.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.641+0000 7f5960901700 10 monclient: init 2021-05-26T16:41:12.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:12.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 10 monclient: _add_conns ranks=[5,8,3,4,7,0,2,6,1] 2021-05-26T16:41:12.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 10 monclient(hunting): picked mon.noname-h con 0x7f595c096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:12.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 10 monclient(hunting): picked mon.noname-e con 0x7f595c099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:12.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 10 monclient(hunting): picked mon.noname-g con 0x7f595c09a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:12.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c059750 con 0x7f595c09a260 2021-05-26T16:41:12.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c064620 con 0x7f595c096ca0 2021-05-26T16:41:12.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c064e50 con 0x7f595c099db0 2021-05-26T16:41:12.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:12.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5960901700 10 monclient(hunting): authenticate will time out at 830.274445s 2021-05-26T16:41:12.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5959d9b700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f595c099db0 0x7f595c132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52272/0 (socket says 172.21.15.3:52272) 2021-05-26T16:41:12.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.642+0000 7f5959d9b700 1 -- 172.21.15.3:0/4069433600 learned_addr learned my addr 172.21.15.3:0/4069433600 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:12.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.644+0000 7f5959d9b700 1 -- 172.21.15.3:0/4069433600 >> v1:172.21.15.3:6793/0 conn(0x7f595c099db0 legacy=0x7f595c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.644+0000 7f595a59c700 1 -- 172.21.15.3:0/4069433600 >> v1:172.21.15.137:6791/0 conn(0x7f595c096ca0 legacy=0x7f595c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.644+0000 7f595ad9d700 1 -- 172.21.15.3:0/4069433600 >> v1:172.21.15.137:6790/0 conn(0x7f595c09a260 legacy=0x7f595c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857953738 0 0) 0x7f595c064e50 con 0x7f595c099db0 2021-05-26T16:41:12.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): my global_id is 4319 2021-05-26T16:41:12.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5940003270 con 0x7f595c099db0 2021-05-26T16:41:12.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047855900 0 0) 0x7f595c059750 con 0x7f595c09a260 2021-05-26T16:41:12.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): my global_id is 4332 2021-05-26T16:41:12.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f595c064e50 con 0x7f595c09a260 2021-05-26T16:41:12.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345529607 0 0) 0x7f595c064620 con 0x7f595c096ca0 2021-05-26T16:41:12.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.665 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient(hunting): my global_id is 4406 2021-05-26T16:41:12.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f595c059750 con 0x7f595c096ca0 2021-05-26T16:41:12.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2784113129 0 0) 0x7f5940003270 con 0x7f595c099db0 2021-05-26T16:41:12.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 >> v1:172.21.15.137:6791/0 conn(0x7f595c096ca0 legacy=0x7f595c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 >> v1:172.21.15.137:6790/0 conn(0x7f595c09a260 legacy=0x7f595c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.666 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: _finish_hunting 0 2021-05-26T16:41:12.667 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 monclient: found mon.noname-e 2021-05-26T16:41:12.667 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:12.667 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:12.667 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c09c390 con 0x7f595c099db0 2021-05-26T16:41:12.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: _finish_auth 0 2021-05-26T16:41:12.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:12.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5950001b20 con 0x7f595c099db0 2021-05-26T16:41:12.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 5 monclient: authenticate success, global_id 4319 2021-05-26T16:41:12.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:12.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:12.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: dump: 2021-05-26T16:41:12.669 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.670 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.670 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.670 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.670 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.670 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.671 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.671 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.671 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.671 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.671 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.672 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.672 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.672 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.672 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.672 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:12.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f59500045f0 con 0x7f595c099db0 2021-05-26T16:41:12.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:12.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:12.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 1 -- 172.21.15.3:0/4069433600 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5950004aa0 con 0x7f595c099db0 2021-05-26T16:41:12.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 4 set_mon_vals no callback set 2021-05-26T16:41:12.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:12.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f595959a700 10 monclient: dump: 2021-05-26T16:41:12.675 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.675 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.675 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.675 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.675 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.676 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.676 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.676 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.676 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.676 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.677 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.677 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.677 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.677 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.678 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.678 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 10 monclient: shutdown 2021-05-26T16:41:12.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:12.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 1 -- 172.21.15.3:0/4069433600 >> v1:172.21.15.3:6793/0 conn(0x7f595c099db0 legacy=0x7f595c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 1 -- 172.21.15.3:0/4069433600 shutdown_connections 2021-05-26T16:41:12.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.645+0000 7f5960901700 1 -- 172.21.15.3:0/4069433600 >> 172.21.15.3:0/4069433600 conn(0x7f595c09cc00 msgr2=0x7f595c09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:12.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.646+0000 7f5960901700 1 -- 172.21.15.3:0/4069433600 shutdown_connections 2021-05-26T16:41:12.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.646+0000 7f5960901700 1 -- 172.21.15.3:0/4069433600 wait complete. 2021-05-26T16:41:12.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.646+0000 7f5960901700 10 monclient: build_initial_monmap 2021-05-26T16:41:12.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.646+0000 7f5960901700 10 monclient: monmap: 2021-05-26T16:41:12.680 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:12.680 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:12.680 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:12.681 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:12.681 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:12.681 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.681 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:12.683 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.646+0000 7f5960901700 1 Processor -- start 2021-05-26T16:41:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.646+0000 7f5960901700 1 -- start start 2021-05-26T16:41:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.646+0000 7f5960901700 10 monclient: init 2021-05-26T16:41:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 10 monclient: _add_conns ranks=[8,6,0,4,5,7,1,3,2] 2021-05-26T16:41:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 10 monclient(hunting): picked mon.noname-e con 0x7f595c096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 10 monclient(hunting): picked mon.noname-d con 0x7f595c099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 10 monclient(hunting): picked mon.noname-a con 0x7f595c09a260 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c09bfb0 con 0x7f595c09a260 2021-05-26T16:41:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c116e40 con 0x7f595c099db0 2021-05-26T16:41:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c1170e0 con 0x7f595c096ca0 2021-05-26T16:41:12.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:12.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f5960901700 10 monclient(hunting): authenticate will time out at 830.279444s 2021-05-26T16:41:12.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f595a59c700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f595c096ca0 0x7f595c1296a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52278/0 (socket says 172.21.15.3:52278) 2021-05-26T16:41:12.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.647+0000 7f595a59c700 1 -- 172.21.15.3:0/932977262 learned_addr learned my addr 172.21.15.3:0/932977262 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:12.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f595a59c700 1 -- 172.21.15.3:0/932977262 >> v1:172.21.15.3:6793/0 conn(0x7f595c096ca0 legacy=0x7f595c1296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f5959d9b700 1 -- 172.21.15.3:0/932977262 >> v1:172.21.15.3:6792/0 conn(0x7f595c099db0 legacy=0x7f595c1410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f595ad9d700 1 -- 172.21.15.3:0/932977262 >> v1:172.21.15.3:6789/0 conn(0x7f595c09a260 legacy=0x7f595c144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f595a59c700 1 --1- 172.21.15.3:0/932977262 >> v1:172.21.15.3:6793/0 conn(0x7f595c096ca0 0x7f595c1296a0 :-1 s=OPENED pgs=79 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7f595c1170e0 auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917332550 0 0) 0x7f595c116e40 con 0x7f595c099db0 2021-05-26T16:41:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 10 monclient(hunting): my global_id is 4326 2021-05-26T16:41:12.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5938003270 con 0x7f595c099db0 2021-05-26T16:41:12.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230290035 0 0) 0x7f595c09bfb0 con 0x7f595c09a260 2021-05-26T16:41:12.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 10 monclient(hunting): my global_id is 4410 2021-05-26T16:41:12.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.649+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f595c116e40 con 0x7f595c09a260 2021-05-26T16:41:12.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1286523483 0 0) 0x7f595c116e40 con 0x7f595c09a260 2021-05-26T16:41:12.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f595c09bfb0 con 0x7f595c09a260 2021-05-26T16:41:12.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f594c002030 con 0x7f595c09a260 2021-05-26T16:41:12.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:12.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:12.691 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.691 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.691 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.691 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.692 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.692 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.692 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.692 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.692 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.693 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.693 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.693 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.693 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.694 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.694 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.694 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:12.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1928711483 0 0) 0x7f5938003270 con 0x7f595c099db0 2021-05-26T16:41:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f595c116e40 con 0x7f595c099db0 2021-05-26T16:41:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5950001ae0 con 0x7f595c099db0 2021-05-26T16:41:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.697 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.697 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.697 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.697 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.699 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.699 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3132830587 0 0) 0x7f595c09bfb0 con 0x7f595c09a260 2021-05-26T16:41:12.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 >> v1:172.21.15.3:6793/0 conn(0x7f595c096ca0 legacy=0x7f595c1296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 >> v1:172.21.15.3:6792/0 conn(0x7f595c099db0 legacy=0x7f595c1410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:12.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 monclient: found mon.a 2021-05-26T16:41:12.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:12.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c12f3b0 con 0x7f595c09a260 2021-05-26T16:41:12.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:12.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:12.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5960901700 5 monclient: authenticate success, global_id 4410 2021-05-26T16:41:12.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835714326 0 0) 0x7f595c1170e0 con 0x7f595c096ca0 2021-05-26T16:41:12.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5960901700 10 monclient: _renew_subs 2021-05-26T16:41:12.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5960901700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c1308f0 con 0x7f595c09a260 2021-05-26T16:41:12.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:12.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5960901700 10 monclient: _renew_subs 2021-05-26T16:41:12.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5960901700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c131300 con 0x7f595c09a260 2021-05-26T16:41:12.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f594c0026b0 con 0x7f595c09a260 2021-05-26T16:41:12.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:12.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f594c002b60 con 0x7f595c09a260 2021-05-26T16:41:12.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f5958d99700 4 set_mon_vals no callback set 2021-05-26T16:41:12.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:12.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.650+0000 7f594a7fc700 10 monclient: dump: 2021-05-26T16:41:12.704 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.705 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.705 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.705 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.705 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.705 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.706 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.706 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.706 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.706 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.706 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.707 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.651+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f594c002cc0 con 0x7f595c09a260 2021-05-26T16:41:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.651+0000 7f5960901700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.651+0000 7f5960901700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.651+0000 7f5960901700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.651+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c004db0 con 0x7f595c09a260 2021-05-26T16:41:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.651+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f594c03daf0 con 0x7f595c09a260 2021-05-26T16:41:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.651+0000 7f595a59c700 10 monclient: get_auth_request con 0x7f5938032e50 auth_method 0 2021-05-26T16:41:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.655+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f594c013590 con 0x7f595c09a260 2021-05-26T16:41:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.655+0000 7f594a7fc700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.655+0000 7f594a7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:12.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.812+0000 7f5960901700 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}] 2021-05-26T16:41:12.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.812+0000 7f5960901700 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}] 2021-05-26T16:41:12.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.812+0000 7f5960901700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:12.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.812+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f593c0055e0 con 0x7f595c09a260 2021-05-26T16:41:12.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.813+0000 7f594a7fc700 1 -- 172.21.15.3:0/932977262 <== mon.0 v1:172.21.15.3:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v15) v1 ==== 110+0+10 (unknown 1134451309 0 2170607528) 0x7f594c0133b0 con 0x7f595c09a260 2021-05-26T16:41:12.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.813+0000 7f594a7fc700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}] 2021-05-26T16:41:12.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.813+0000 7f594a7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:12.818 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2021-05-26T16:41:12.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.814+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 >> v1:172.21.15.137:6812/30003 conn(0x7f5938032e50 legacy=0x7f5938035310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.814+0000 7f5960901700 10 monclient: shutdown 2021-05-26T16:41:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.814+0000 7f5960901700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.814+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 >> v1:172.21.15.3:6789/0 conn(0x7f595c09a260 legacy=0x7f595c144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.815+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 shutdown_connections 2021-05-26T16:41:12.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.815+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 >> 172.21.15.3:0/932977262 conn(0x7f595c09cc00 msgr2=0x7f595c097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:12.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.815+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 shutdown_connections 2021-05-26T16:41:12.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.815+0000 7f5960901700 1 -- 172.21.15.3:0/932977262 wait complete. 2021-05-26T16:41:12.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-05-26T16:41:12.946 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.943+0000 7f723ec95700 10 monclient: get_monmap_and_config 2021-05-26T16:41:12.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.943+0000 7f723ec95700 10 monclient: build_initial_monmap 2021-05-26T16:41:12.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.943+0000 7f723ec95700 10 monclient: monmap: 2021-05-26T16:41:12.947 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:12.947 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.948 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:12.944938+0000 2021-05-26T16:41:12.948 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:12.944938+0000 2021-05-26T16:41:12.948 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:12.948 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.948 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:12.949 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:12.949 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:12.949 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:12.949 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:12.950 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:12.950 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:12.950 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:12.950 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:12.951 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.943+0000 7f723ec95700 1 Processor -- start 2021-05-26T16:41:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 1 -- start start 2021-05-26T16:41:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient: init 2021-05-26T16:41:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient: _add_conns ranks=[4,3,7,5,2,8,0,6,1] 2021-05-26T16:41:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient(hunting): picked mon.noname-c con 0x7f723812cbd0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient(hunting): picked mon.noname-g con 0x7f7238099a30 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:12.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient(hunting): picked mon.noname-i con 0x7f7238099eb0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:12.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7238046600 con 0x7f7238099a30 2021-05-26T16:41:12.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723809b5e0 con 0x7f723812cbd0 2021-05-26T16:41:12.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723812d8f0 con 0x7f7238099eb0 2021-05-26T16:41:12.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723ec95700 10 monclient(hunting): authenticate will time out at 830.576692s 2021-05-26T16:41:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723dc93700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f723812cbd0 0x7f723812d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36718/0 (socket says 172.21.15.3:36718) 2021-05-26T16:41:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.944+0000 7f723dc93700 1 -- 172.21.15.3:0/3409346168 learned_addr learned my addr 172.21.15.3:0/3409346168 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.946+0000 7f723dc93700 1 -- 172.21.15.3:0/3409346168 >> v1:172.21.15.3:6791/0 conn(0x7f723812cbd0 legacy=0x7f723812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914098825 0 0) 0x7f723809b5e0 con 0x7f723812cbd0 2021-05-26T16:41:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient(hunting): my global_id is 4360 2021-05-26T16:41:12.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7220003270 con 0x7f723812cbd0 2021-05-26T16:41:12.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723e494700 1 -- 172.21.15.3:0/3409346168 >> v1:172.21.15.137:6792/0 conn(0x7f7238099eb0 legacy=0x7f7238135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723d492700 1 -- 172.21.15.3:0/3409346168 >> v1:172.21.15.137:6790/0 conn(0x7f7238099a30 legacy=0x7f7238131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290673744 0 0) 0x7f7220003270 con 0x7f723812cbd0 2021-05-26T16:41:12.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 >> v1:172.21.15.137:6792/0 conn(0x7f7238099eb0 legacy=0x7f7238135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 >> v1:172.21.15.137:6790/0 conn(0x7f7238099a30 legacy=0x7f7238131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: _finish_hunting 0 2021-05-26T16:41:12.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 monclient: found mon.noname-c 2021-05-26T16:41:12.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:12.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:12.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723809c2b0 con 0x7f723812cbd0 2021-05-26T16:41:12.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: _finish_auth 0 2021-05-26T16:41:12.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:12.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 5 monclient: authenticate success, global_id 4360 2021-05-26T16:41:12.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f722c001a60 con 0x7f723812cbd0 2021-05-26T16:41:12.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:12.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:12.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: dump: 2021-05-26T16:41:12.971 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.972 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.972 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.972 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.972 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.972 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.973 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.973 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.973 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.973 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.974 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.974 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.974 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.974 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.974 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.975 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:12.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f722c001d70 con 0x7f723812cbd0 2021-05-26T16:41:12.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:12.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:12.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 4 set_mon_vals no callback set 2021-05-26T16:41:12.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 1 -- 172.21.15.3:0/3409346168 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f722c004930 con 0x7f723812cbd0 2021-05-26T16:41:12.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:12.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723cc91700 10 monclient: dump: 2021-05-26T16:41:12.977 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.977 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.978 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.978 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.978 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.978 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.978 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.979 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.979 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.979 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.979 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.980 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.980 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.980 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.980 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.980 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 10 monclient: shutdown 2021-05-26T16:41:12.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:12.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 1 -- 172.21.15.3:0/3409346168 >> v1:172.21.15.3:6791/0 conn(0x7f723812cbd0 legacy=0x7f723812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:12.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 1 -- 172.21.15.3:0/3409346168 shutdown_connections 2021-05-26T16:41:12.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.947+0000 7f723ec95700 1 -- 172.21.15.3:0/3409346168 >> 172.21.15.3:0/3409346168 conn(0x7f72380a00c0 msgr2=0x7f72380a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:12.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.948+0000 7f723ec95700 1 -- 172.21.15.3:0/3409346168 shutdown_connections 2021-05-26T16:41:12.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.948+0000 7f723ec95700 1 -- 172.21.15.3:0/3409346168 wait complete. 2021-05-26T16:41:12.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.948+0000 7f723ec95700 10 monclient: build_initial_monmap 2021-05-26T16:41:12.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.948+0000 7f723ec95700 10 monclient: monmap: 2021-05-26T16:41:12.982 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:12.983 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:12.983 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:12.983 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:12.983 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:12.984 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.984 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:12.984 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:12.984 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:12.984 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:12.985 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:12.985 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:12.985 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:12.985 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:12.985 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:12.986 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.948+0000 7f723ec95700 1 Processor -- start 2021-05-26T16:41:12.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.948+0000 7f723ec95700 1 -- start start 2021-05-26T16:41:12.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.948+0000 7f723ec95700 10 monclient: init 2021-05-26T16:41:12.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:12.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 10 monclient: _add_conns ranks=[5,1,6,3,2,8,7,0,4] 2021-05-26T16:41:12.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 10 monclient(hunting): picked mon.noname-h con 0x7f7238099a30 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:12.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 10 monclient(hunting): picked mon.noname-f con 0x7f7238099eb0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:12.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 10 monclient(hunting): picked mon.noname-d con 0x7f723812cbd0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72381166d0 con 0x7f7238099eb0 2021-05-26T16:41:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7238116900 con 0x7f7238099a30 2021-05-26T16:41:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7238116be0 con 0x7f723812cbd0 2021-05-26T16:41:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723ec95700 10 monclient(hunting): authenticate will time out at 830.581485s 2021-05-26T16:41:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723e494700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f723812cbd0 0x7f7238144700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56616/0 (socket says 172.21.15.3:56616) 2021-05-26T16:41:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.949+0000 7f723e494700 1 -- 172.21.15.3:0/1681156655 learned_addr learned my addr 172.21.15.3:0/1681156655 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f723e494700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.3:6792/0 conn(0x7f723812cbd0 legacy=0x7f7238144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f723dc93700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6791/0 conn(0x7f7238099a30 legacy=0x7f723813c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f723d492700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6789/0 conn(0x7f7238099eb0 legacy=0x7f7238140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:12.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f723dc93700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6791/0 conn(0x7f7238099a30 legacy=0x7f723813c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-05-26T16:41:12.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f723dc93700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6791/0 conn(0x7f7238099a30 legacy=0x7f723813c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:41:12.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f723dc93700 1 --1- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6791/0 conn(0x7f7238099a30 0x7f723813c310 :-1 s=OPENED pgs=71 cs=1 l=1).handle_message read tag failed 2021-05-26T16:41:12.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f723dc93700 1 --1- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6791/0 conn(0x7f7238099a30 0x7f723813c310 :-1 s=OPENED pgs=71 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:41:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862138279 0 0) 0x7f7238116be0 con 0x7f723812cbd0 2021-05-26T16:41:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f7225ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f7225ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f7225ffb700 10 monclient(hunting): my global_id is 4335 2021-05-26T16:41:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7218003270 con 0x7f723812cbd0 2021-05-26T16:41:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.951+0000 7f7225ffb700 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.137:6791/0 2021-05-26T16:41:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099858822 0 0) 0x7f72381166d0 con 0x7f7238099eb0 2021-05-26T16:41:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): my global_id is 4312 2021-05-26T16:41:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7238116be0 con 0x7f7238099eb0 2021-05-26T16:41:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 733306844 0 0) 0x7f7218003270 con 0x7f723812cbd0 2021-05-26T16:41:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72381166d0 con 0x7f723812cbd0 2021-05-26T16:41:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f72340020e0 con 0x7f723812cbd0 2021-05-26T16:41:12.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:12.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:12.994 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:12.995 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:12.995 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.995 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:12.995 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:12.995 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:12.996 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:12.996 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:12.996 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:12.996 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:12.998 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3611283750 0 0) 0x7f7238116be0 con 0x7f7238099eb0 2021-05-26T16:41:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7218003270 con 0x7f7238099eb0 2021-05-26T16:41:12.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7228001c10 con 0x7f7238099eb0 2021-05-26T16:41:12.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:12.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:12.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:12.999 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.001 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.001 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.001 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.001 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.001 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.002 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.002 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.002 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.002 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.003 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.003 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3149006473 0 0) 0x7f72381166d0 con 0x7f723812cbd0 2021-05-26T16:41:13.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6791/0 conn(0x7f7238099a30 legacy=0x7f723813c310 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:13.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6789/0 conn(0x7f7238099eb0 legacy=0x7f7238140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:13.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 monclient: found mon.d 2021-05-26T16:41:13.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:13.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:13.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238116e80 con 0x7f723812cbd0 2021-05-26T16:41:13.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:13.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:13.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f723ec95700 5 monclient: authenticate success, global_id 4335 2021-05-26T16:41:13.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f723ec95700 10 monclient: _renew_subs 2021-05-26T16:41:13.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f723ec95700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:13.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7238095460 con 0x7f723812cbd0 2021-05-26T16:41:13.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7234002740 con 0x7f723812cbd0 2021-05-26T16:41:13.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:13.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7234002c70 con 0x7f723812cbd0 2021-05-26T16:41:13.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:13.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:13.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7225ffb700 10 monclient: dump: 2021-05-26T16:41:13.007 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.007 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.008 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.008 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.008 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.008 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.009 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.009 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.009 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.009 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.009 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.010 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.010 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.010 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.010 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.010 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f7227fff700 4 set_mon_vals no callback set 2021-05-26T16:41:13.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f723ec95700 10 monclient: _renew_subs 2021-05-26T16:41:13.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f723ec95700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:13.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.952+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7238095e60 con 0x7f723812cbd0 2021-05-26T16:41:13.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.953+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f7234002e50 con 0x7f723812cbd0 2021-05-26T16:41:13.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.953+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f723403dc70 con 0x7f723812cbd0 2021-05-26T16:41:13.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.953+0000 7f723ec95700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:13.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.953+0000 7f723ec95700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:13.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.953+0000 7f723ec95700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:13.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.953+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238096110 con 0x7f723812cbd0 2021-05-26T16:41:13.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.953+0000 7f723dc93700 10 monclient: get_auth_request con 0x7f7218032de0 auth_method 0 2021-05-26T16:41:13.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.957+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f7234013940 con 0x7f723812cbd0 2021-05-26T16:41:13.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.957+0000 7f7225ffb700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:13.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:12.957+0000 7f7225ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:13.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.116+0000 7f723ec95700 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2021-05-26T16:41:13.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.116+0000 7f723ec95700 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2021-05-26T16:41:13.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.116+0000 7f723ec95700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.116+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f723806c030 con 0x7f723812cbd0 2021-05-26T16:41:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.117+0000 7f7225ffb700 1 -- 172.21.15.3:0/1681156655 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (unknown 946793192 0 265718887) 0x7f7234013530 con 0x7f723812cbd0 2021-05-26T16:41:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.117+0000 7f7225ffb700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2021-05-26T16:41:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.117+0000 7f7225ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:13.122 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2021-05-26T16:41:13.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.137:6812/30003 conn(0x7f7218032de0 legacy=0x7f72180352a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 10 monclient: shutdown 2021-05-26T16:41:13.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:13.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 >> v1:172.21.15.3:6792/0 conn(0x7f723812cbd0 legacy=0x7f7238144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 shutdown_connections 2021-05-26T16:41:13.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 >> 172.21.15.3:0/1681156655 conn(0x7f72380a00c0 msgr2=0x7f723812aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:13.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 shutdown_connections 2021-05-26T16:41:13.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.118+0000 7f723ec95700 1 -- 172.21.15.3:0/1681156655 wait complete. 2021-05-26T16:41:13.133 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2021-05-26T16:41:13.134 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-05-26T16:41:13.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.249+0000 7f86823b6700 10 monclient: get_monmap_and_config 2021-05-26T16:41:13.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.249+0000 7f86823b6700 10 monclient: build_initial_monmap 2021-05-26T16:41:13.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.249+0000 7f86823b6700 10 monclient: monmap: 2021-05-26T16:41:13.256 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:13.256 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.256 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:13.250628+0000 2021-05-26T16:41:13.256 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:13.250628+0000 2021-05-26T16:41:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:13.259 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.249+0000 7f86823b6700 1 Processor -- start 2021-05-26T16:41:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.249+0000 7f86823b6700 1 -- start start 2021-05-26T16:41:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.249+0000 7f86823b6700 10 monclient: init 2021-05-26T16:41:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 10 monclient: _add_conns ranks=[0,3,5,2,1,4,8,7,6] 2021-05-26T16:41:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 10 monclient(hunting): picked mon.noname-a con 0x7f867c064a20 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:13.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 10 monclient(hunting): picked mon.noname-g con 0x7f867c063e30 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:13.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 10 monclient(hunting): picked mon.noname-h con 0x7f867c0642e0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:13.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c059750 con 0x7f867c064a20 2021-05-26T16:41:13.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c064e00 con 0x7f867c063e30 2021-05-26T16:41:13.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c09c770 con 0x7f867c0642e0 2021-05-26T16:41:13.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:13.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f86823b6700 10 monclient(hunting): authenticate will time out at 830.882274s 2021-05-26T16:41:13.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f867bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f867c064a20 0x7f867c099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51222/0 (socket says 172.21.15.3:51222) 2021-05-26T16:41:13.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.250+0000 7f867bfff700 1 -- 172.21.15.3:0/2986949677 learned_addr learned my addr 172.21.15.3:0/2986949677 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:13.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867bfff700 1 -- 172.21.15.3:0/2986949677 >> v1:172.21.15.3:6789/0 conn(0x7f867c064a20 legacy=0x7f867c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f8680953700 1 -- 172.21.15.3:0/2986949677 >> v1:172.21.15.137:6791/0 conn(0x7f867c0642e0 legacy=0x7f867c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867b7fe700 1 -- 172.21.15.3:0/2986949677 >> v1:172.21.15.137:6790/0 conn(0x7f867c063e30 legacy=0x7f867c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788437882 0 0) 0x7f867c059750 con 0x7f867c064a20 2021-05-26T16:41:13.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867affd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:13.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867affd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:13.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867affd700 10 monclient(hunting): my global_id is 4419 2021-05-26T16:41:13.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8660003270 con 0x7f867c064a20 2021-05-26T16:41:13.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.252+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247242303 0 0) 0x7f867c064e00 con 0x7f867c063e30 2021-05-26T16:41:13.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:13.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:13.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient(hunting): my global_id is 4350 2021-05-26T16:41:13.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c059750 con 0x7f867c063e30 2021-05-26T16:41:13.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428491053 0 0) 0x7f867c09c770 con 0x7f867c0642e0 2021-05-26T16:41:13.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:13.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:13.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient(hunting): my global_id is 4415 2021-05-26T16:41:13.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c064e00 con 0x7f867c0642e0 2021-05-26T16:41:13.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261629510 0 0) 0x7f8660003270 con 0x7f867c064a20 2021-05-26T16:41:13.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 >> v1:172.21.15.137:6791/0 conn(0x7f867c0642e0 legacy=0x7f867c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 >> v1:172.21.15.137:6790/0 conn(0x7f867c063e30 legacy=0x7f867c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:13.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 monclient: found mon.noname-a 2021-05-26T16:41:13.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:13.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:13.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0977a0 con 0x7f867c064a20 2021-05-26T16:41:13.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: _finish_auth 0 2021-05-26T16:41:13.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:13.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 5 monclient: authenticate success, global_id 4419 2021-05-26T16:41:13.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8668001a60 con 0x7f867c064a20 2021-05-26T16:41:13.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:13.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:13.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:13.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: dump: 2021-05-26T16:41:13.280 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.280 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.280 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.281 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.281 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.281 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.281 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.281 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.282 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.282 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.282 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.282 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.283 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.283 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.283 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.283 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:13.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8668001d70 con 0x7f867c064a20 2021-05-26T16:41:13.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:13.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 1 -- 172.21.15.3:0/2986949677 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8668004930 con 0x7f867c064a20 2021-05-26T16:41:13.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:13.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 4 set_mon_vals no callback set 2021-05-26T16:41:13.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:13.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:13.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f867affd700 10 monclient: dump: 2021-05-26T16:41:13.285 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.286 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.286 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.286 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.286 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.286 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.287 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.287 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.287 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.287 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.287 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.288 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.288 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.288 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.288 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.289 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 10 monclient: shutdown 2021-05-26T16:41:13.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:13.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 1 -- 172.21.15.3:0/2986949677 >> v1:172.21.15.3:6789/0 conn(0x7f867c064a20 legacy=0x7f867c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 1 -- 172.21.15.3:0/2986949677 shutdown_connections 2021-05-26T16:41:13.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 1 -- 172.21.15.3:0/2986949677 >> 172.21.15.3:0/2986949677 conn(0x7f867c0a0db0 msgr2=0x7f867c09cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:13.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 1 -- 172.21.15.3:0/2986949677 shutdown_connections 2021-05-26T16:41:13.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.253+0000 7f86823b6700 1 -- 172.21.15.3:0/2986949677 wait complete. 2021-05-26T16:41:13.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.254+0000 7f86823b6700 10 monclient: build_initial_monmap 2021-05-26T16:41:13.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.254+0000 7f86823b6700 10 monclient: monmap: 2021-05-26T16:41:13.291 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:13.291 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:13.291 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:13.291 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:13.292 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:13.292 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.292 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:13.292 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:13.292 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:13.293 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:13.293 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:13.293 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:13.293 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:13.293 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:13.294 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:13.294 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.254+0000 7f86823b6700 1 Processor -- start 2021-05-26T16:41:13.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.254+0000 7f86823b6700 1 -- start start 2021-05-26T16:41:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.254+0000 7f86823b6700 10 monclient: init 2021-05-26T16:41:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 10 monclient: _add_conns ranks=[2,0,4,1,7,6,3,5,8] 2021-05-26T16:41:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 10 monclient(hunting): picked mon.noname-b con 0x7f867c063e30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 10 monclient(hunting): picked mon.noname-a con 0x7f867c0642e0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:13.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 10 monclient(hunting): picked mon.noname-c con 0x7f867c064a20 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:13.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c09c180 con 0x7f867c0642e0 2021-05-26T16:41:13.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c116eb0 con 0x7f867c063e30 2021-05-26T16:41:13.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c117150 con 0x7f867c064a20 2021-05-26T16:41:13.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f86823b6700 10 monclient(hunting): authenticate will time out at 830.887387s 2021-05-26T16:41:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f867b7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f867c0642e0 0x7f867c1410e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51230/0 (socket says 172.21.15.3:51230) 2021-05-26T16:41:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.255+0000 7f867b7fe700 1 -- 172.21.15.3:0/3378834074 learned_addr learned my addr 172.21.15.3:0/3378834074 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f867b7fe700 1 -- 172.21.15.3:0/3378834074 >> v1:172.21.15.3:6789/0 conn(0x7f867c0642e0 legacy=0x7f867c1410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8680953700 1 -- 172.21.15.3:0/3378834074 >> v1:172.21.15.3:6791/0 conn(0x7f867c064a20 legacy=0x7f867c144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f867bfff700 1 -- 172.21.15.3:0/3378834074 >> v1:172.21.15.3:6790/0 conn(0x7f867c063e30 legacy=0x7f867c129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982854802 0 0) 0x7f867c09c180 con 0x7f867c0642e0 2021-05-26T16:41:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:13.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): my global_id is 4428 2021-05-26T16:41:13.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f865c003270 con 0x7f867c0642e0 2021-05-26T16:41:13.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167556252 0 0) 0x7f867c117150 con 0x7f867c064a20 2021-05-26T16:41:13.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): my global_id is 4369 2021-05-26T16:41:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c09c180 con 0x7f867c064a20 2021-05-26T16:41:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592886376 0 0) 0x7f867c116eb0 con 0x7f867c063e30 2021-05-26T16:41:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:13.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:13.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 10 monclient(hunting): my global_id is 4358 2021-05-26T16:41:13.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.257+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c117150 con 0x7f867c063e30 2021-05-26T16:41:13.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3068782995 0 0) 0x7f865c003270 con 0x7f867c0642e0 2021-05-26T16:41:13.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f867c116eb0 con 0x7f867c0642e0 2021-05-26T16:41:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f866c001f00 con 0x7f867c0642e0 2021-05-26T16:41:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): dump: 2021-05-26T16:41:13.303 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.303 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.303 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.303 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.303 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.306 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.306 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:13.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4048223501 0 0) 0x7f867c09c180 con 0x7f867c064a20 2021-05-26T16:41:13.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f865c003270 con 0x7f867c064a20 2021-05-26T16:41:13.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 424568665 0 0) 0x7f867c117150 con 0x7f867c063e30 2021-05-26T16:41:13.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f867c09c180 con 0x7f867c063e30 2021-05-26T16:41:13.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8670002280 con 0x7f867c064a20 2021-05-26T16:41:13.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:13.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:13.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): dump: 2021-05-26T16:41:13.308 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.309 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.309 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.309 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.309 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.309 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.310 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.310 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.310 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.310 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.311 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.311 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.311 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.311 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.311 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.312 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8668001ad0 con 0x7f867c063e30 2021-05-26T16:41:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient(hunting): dump: 2021-05-26T16:41:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.315 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.315 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.315 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.315 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.316 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.316 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.316 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.316 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 661297720 0 0) 0x7f867c116eb0 con 0x7f867c0642e0 2021-05-26T16:41:13.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 >> v1:172.21.15.3:6791/0 conn(0x7f867c064a20 legacy=0x7f867c144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 >> v1:172.21.15.3:6790/0 conn(0x7f867c063e30 legacy=0x7f867c129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:13.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 monclient: found mon.a 2021-05-26T16:41:13.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:13.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:13.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c12f3b0 con 0x7f867c0642e0 2021-05-26T16:41:13.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:13.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:13.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f86823b6700 5 monclient: authenticate success, global_id 4428 2021-05-26T16:41:13.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f86823b6700 10 monclient: _renew_subs 2021-05-26T16:41:13.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f86823b6700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:13.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c1308f0 con 0x7f867c0642e0 2021-05-26T16:41:13.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f86823b6700 10 monclient: _renew_subs 2021-05-26T16:41:13.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f86823b6700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:13.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c131300 con 0x7f867c0642e0 2021-05-26T16:41:13.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f866c002500 con 0x7f867c0642e0 2021-05-26T16:41:13.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:13.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f866c0029b0 con 0x7f867c0642e0 2021-05-26T16:41:13.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:13.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f867a7fc700 4 set_mon_vals no callback set 2021-05-26T16:41:13.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:13.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.258+0000 7f8667fff700 10 monclient: dump: 2021-05-26T16:41:13.322 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:13.322 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.322 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.322 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:13.323 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:13.323 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.323 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:13.323 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:13.324 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:13.324 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:13.324 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:13.324 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:13.324 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:13.325 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:13.325 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:13.325 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.259+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f866c002b90 con 0x7f867c0642e0 2021-05-26T16:41:13.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.259+0000 7f86823b6700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:13.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.259+0000 7f86823b6700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:13.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.259+0000 7f86823b6700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:13.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.259+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f866c03d9a0 con 0x7f867c0642e0 2021-05-26T16:41:13.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.259+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8654004db0 con 0x7f867c0642e0 2021-05-26T16:41:13.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.259+0000 7f867bfff700 10 monclient: get_auth_request con 0x7f865c0333e0 auth_method 0 2021-05-26T16:41:13.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.263+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mon.0 v1:172.21.15.3:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f866c0136e0 con 0x7f867c0642e0 2021-05-26T16:41:13.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.263+0000 7f8667fff700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:13.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.263+0000 7f8667fff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:13.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.418+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 --> v1:172.21.15.137:6812/30003 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8654000b90 con 0x7f865c0333e0 2021-05-26T16:41:13.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.419+0000 7f8667fff700 1 -- 172.21.15.3:0/3378834074 <== mgr.4104 v1:172.21.15.137:6812/30003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+38632 (unknown 2965378022 0 3071699888) 0x7f8654000b90 con 0x7f865c0333e0 2021-05-26T16:41:13.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:13.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 >> v1:172.21.15.137:6812/30003 conn(0x7f865c0333e0 legacy=0x7f865c0358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 10 monclient: shutdown 2021-05-26T16:41:13.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:13.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 >> v1:172.21.15.3:6789/0 conn(0x7f867c0642e0 legacy=0x7f867c1410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:13.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 shutdown_connections 2021-05-26T16:41:13.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 >> 172.21.15.3:0/3378834074 conn(0x7f867c0a0db0 msgr2=0x7f867c09ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:13.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 shutdown_connections 2021-05-26T16:41:13.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.421+0000 7f86823b6700 1 -- 172.21.15.3:0/3378834074 wait complete. 2021-05-26T16:41:13.427 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2021-05-26T16:41:13.436 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2021-05-26T16:41:12.587122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29552,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":28736,"kb_avail":566201488,"statfs":{"total":579820584960,"available":579790323712,"internally_reserved":0,"allocated":786432,"data_stored":232422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29425664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337071+0000","last_change":"2021-05-26T16:41:04.336448+0000","last_active":"2021-05-26T16:41:04.337071+0000","last_peered":"2021-05-26T16:41:04.337071+0000","last_clean":"2021-05-26T16:41:04.337071+0000","last_became_active":"2021-05-26T16:41:04.336153+0000","last_became_peered":"2021-05-26T16:41:04.336153+0000","last_unstale":"2021-05-26T16:41:04.337071+0000","last_undegraded":"2021-05-26T16:41:04.337071+0000","last_fullsized":"2021-05-26T16:41:04.337071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337482+0000","last_change":"2021-05-26T16:41:04.336928+0000","last_active":"2021-05-26T16:41:04.337482+0000","last_peered":"2021-05-26T16:41:04.337482+0000","last_clean":"2021-05-26T16:41:04.337482+0000","last_became_active":"2021-05-26T16:41:04.336581+0000","last_became_peered":"2021-05-26T16:41:04.336581+0000","last_unstale":"2021-05-26T16:41:04.337482+0000","last_undegraded":"2021-05-26T16:41:04.337482+0000","last_fullsized":"2021-05-26T16:41:04.337482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336466+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336466+0000","last_peered":"2021-05-26T16:41:04.336466+0000","last_clean":"2021-05-26T16:41:04.336466+0000","last_became_active":"2021-05-26T16:41:04.330738+0000","last_became_peered":"2021-05-26T16:41:04.330738+0000","last_unstale":"2021-05-26T16:41:04.336466+0000","last_undegraded":"2021-05-26T16:41:04.336466+0000","last_fullsized":"2021-05-26T16:41:04.336466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336420+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336420+0000","last_peered":"2021-05-26T16:41:04.336420+0000","last_clean":"2021-05-26T16:41:04.336420+0000","last_became_active":"2021-05-26T16:41:04.330720+0000","last_became_peered":"2021-05-26T16:41:04.330720+0000","last_unstale":"2021-05-26T16:41:04.336420+0000","last_undegraded":"2021-05-26T16:41:04.336420+0000","last_fullsized":"2021-05-26T16:41:04.336420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.328271+0000","last_change":"2021-05-26T16:41:03.320118+0000","last_active":"2021-05-26T16:41:04.328271+0000","last_peered":"2021-05-26T16:41:04.328271+0000","last_clean":"2021-05-26T16:41:04.328271+0000","last_became_active":"2021-05-26T16:41:03.319736+0000","last_became_peered":"2021-05-26T16:41:03.319736+0000","last_unstale":"2021-05-26T16:41:04.328271+0000","last_undegraded":"2021-05-26T16:41:04.328271+0000","last_fullsized":"2021-05-26T16:41:04.328271+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_clean_scrub_stamp":"2021-05-26T16:41:02.308057+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336008+0000","last_change":"2021-05-26T16:41:04.327668+0000","last_active":"2021-05-26T16:41:04.336008+0000","last_peered":"2021-05-26T16:41:04.336008+0000","last_clean":"2021-05-26T16:41:04.336008+0000","last_became_active":"2021-05-26T16:41:04.327310+0000","last_became_peered":"2021-05-26T16:41:04.327310+0000","last_unstale":"2021-05-26T16:41:04.336008+0000","last_undegraded":"2021-05-26T16:41:04.336008+0000","last_fullsized":"2021-05-26T16:41:04.336008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.329067+0000","last_change":"2021-05-26T16:41:04.327922+0000","last_active":"2021-05-26T16:41:04.329067+0000","last_peered":"2021-05-26T16:41:04.329067+0000","last_clean":"2021-05-26T16:41:04.329067+0000","last_became_active":"2021-05-26T16:41:04.327579+0000","last_became_peered":"2021-05-26T16:41:04.327579+0000","last_unstale":"2021-05-26T16:41:04.329067+0000","last_undegraded":"2021-05-26T16:41:04.329067+0000","last_fullsized":"2021-05-26T16:41:04.329067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336022+0000","last_change":"2021-05-26T16:41:04.327865+0000","last_active":"2021-05-26T16:41:04.336022+0000","last_peered":"2021-05-26T16:41:04.336022+0000","last_clean":"2021-05-26T16:41:04.336022+0000","last_became_active":"2021-05-26T16:41:04.327593+0000","last_became_peered":"2021-05-26T16:41:04.327593+0000","last_unstale":"2021-05-26T16:41:04.336022+0000","last_undegraded":"2021-05-26T16:41:04.336022+0000","last_fullsized":"2021-05-26T16:41:04.336022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.330247+0000","last_change":"2021-05-26T16:41:04.328266+0000","last_active":"2021-05-26T16:41:04.330247+0000","last_peered":"2021-05-26T16:41:04.330247+0000","last_clean":"2021-05-26T16:41:04.330247+0000","last_became_active":"2021-05-26T16:41:04.327859+0000","last_became_peered":"2021-05-26T16:41:04.327859+0000","last_unstale":"2021-05-26T16:41:04.330247+0000","last_undegraded":"2021-05-26T16:41:04.330247+0000","last_fullsized":"2021-05-26T16:41:04.330247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-05-26T16:41:13.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-05-26T16:41:13.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.549+0000 7f0ac3bee700 10 monclient: get_monmap_and_config 2021-05-26T16:41:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.549+0000 7f0ac3bee700 10 monclient: build_initial_monmap 2021-05-26T16:41:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.549+0000 7f0ac3bee700 10 monclient: monmap: 2021-05-26T16:41:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:13.550928+0000 2021-05-26T16:41:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:13.550928+0000 2021-05-26T16:41:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:13.556 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:13.556 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:13.556 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:13.556 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:13.557 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:13.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.549+0000 7f0ac3bee700 1 Processor -- start 2021-05-26T16:41:13.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 1 -- start start 2021-05-26T16:41:13.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient: init 2021-05-26T16:41:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient: _add_conns ranks=[6,7,1,8,3,5,2,0,4] 2021-05-26T16:41:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient(hunting): picked mon.noname-d con 0x7f0abc064aa0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient(hunting): picked mon.noname-i con 0x7f0abc099c40 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient(hunting): picked mon.noname-f con 0x7f0abc09a0c0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc059750 con 0x7f0abc09a0c0 2021-05-26T16:41:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc09a530 con 0x7f0abc064aa0 2021-05-26T16:41:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc09c4e0 con 0x7f0abc099c40 2021-05-26T16:41:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac3bee700 10 monclient(hunting): authenticate will time out at 831.182536s 2021-05-26T16:41:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac198a700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f0abc064aa0 0x7f0abc063f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56636/0 (socket says 172.21.15.3:56636) 2021-05-26T16:41:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.550+0000 7f0ac198a700 1 -- 172.21.15.3:0/2082982253 learned_addr learned my addr 172.21.15.3:0/2082982253 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.552+0000 7f0ac198a700 1 -- 172.21.15.3:0/2082982253 >> v1:172.21.15.3:6792/0 conn(0x7f0abc064aa0 legacy=0x7f0abc063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.553+0000 7f0ac1189700 1 -- 172.21.15.3:0/2082982253 >> v1:172.21.15.137:6792/0 conn(0x7f0abc099c40 legacy=0x7f0abc132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:13.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:13.553+0000 7f0ac218b700 1 -- 172.21.15.3:0/2082982253 >> v1:172.21.15.137:6789/0 conn(0x7f0abc09a0c0 legacy=0x7f0abc1357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:14.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168707103 0 0) 0x7f0ab0001450 con 0x7f0abc064aa0 2021-05-26T16:41:14.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:14.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:14.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): my global_id is 4344 2021-05-26T16:41:14.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa4003270 con 0x7f0abc064aa0 2021-05-26T16:41:14.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872105058 0 0) 0x7f0abc09c4e0 con 0x7f0abc099c40 2021-05-26T16:41:14.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:14.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:14.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): my global_id is 4318 2021-05-26T16:41:14.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab0001450 con 0x7f0abc099c40 2021-05-26T16:41:14.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399307482 0 0) 0x7f0abc059750 con 0x7f0abc09a0c0 2021-05-26T16:41:14.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:14.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:14.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient(hunting): my global_id is 4321 2021-05-26T16:41:14.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0abc09c4e0 con 0x7f0abc09a0c0 2021-05-26T16:41:14.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2878710955 0 0) 0x7f0aa4003270 con 0x7f0abc064aa0 2021-05-26T16:41:14.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 >> v1:172.21.15.137:6792/0 conn(0x7f0abc099c40 legacy=0x7f0abc132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:14.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 >> v1:172.21.15.137:6789/0 conn(0x7f0abc09a0c0 legacy=0x7f0abc1357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:14.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient: _finish_hunting 0 2021-05-26T16:41:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 monclient: found mon.noname-d 2021-05-26T16:41:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc09c780 con 0x7f0abc064aa0 2021-05-26T16:41:14.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient: _finish_auth 0 2021-05-26T16:41:14.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:14.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0ab0001bf0 con 0x7f0abc064aa0 2021-05-26T16:41:14.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:14.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:14.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.140+0000 7f0ac0988700 10 monclient: dump: 2021-05-26T16:41:14.150 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:14.150 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:14.150 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.150 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.151 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:14.151 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:14.151 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:14.151 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:14.152 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:14.152 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:14.152 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:14.152 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:14.153 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:14.153 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:14.153 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:14.153 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:14.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 5 monclient: authenticate success, global_id 4344 2021-05-26T16:41:14.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:14.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ab0004630 con 0x7f0abc064aa0 2021-05-26T16:41:14.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac0988700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:14.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:14.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac0988700 1 -- 172.21.15.3:0/2082982253 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0ab0004ae0 con 0x7f0abc064aa0 2021-05-26T16:41:14.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 4 set_mon_vals no callback set 2021-05-26T16:41:14.163 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac0988700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:14.163 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac0988700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:14.163 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac0988700 10 monclient: dump: 2021-05-26T16:41:14.163 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:14.164 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:14.164 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.164 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.164 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:14.165 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:14.165 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:14.165 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:14.165 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:14.165 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:14.166 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:14.166 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:14.166 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:14.166 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:14.167 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:14.167 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:14.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 10 monclient: shutdown 2021-05-26T16:41:14.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:14.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 1 -- 172.21.15.3:0/2082982253 >> v1:172.21.15.3:6792/0 conn(0x7f0abc064aa0 legacy=0x7f0abc063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:14.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 1 -- 172.21.15.3:0/2082982253 shutdown_connections 2021-05-26T16:41:14.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.141+0000 7f0ac3bee700 1 -- 172.21.15.3:0/2082982253 >> 172.21.15.3:0/2082982253 conn(0x7f0abc05e1e0 msgr2=0x7f0abc09cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:14.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.142+0000 7f0ac3bee700 1 -- 172.21.15.3:0/2082982253 shutdown_connections 2021-05-26T16:41:14.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.142+0000 7f0ac3bee700 1 -- 172.21.15.3:0/2082982253 wait complete. 2021-05-26T16:41:14.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.142+0000 7f0ac3bee700 10 monclient: build_initial_monmap 2021-05-26T16:41:14.169 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.142+0000 7f0ac3bee700 10 monclient: monmap: 2021-05-26T16:41:14.169 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:14.169 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:14.169 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:14.170 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:14.170 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:14.170 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:14.170 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:14.170 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:14.171 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:14.171 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:14.171 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:14.171 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:14.171 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:14.172 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:14.172 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:14.172 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:14.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.143+0000 7f0ac3bee700 1 Processor -- start 2021-05-26T16:41:14.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.143+0000 7f0ac3bee700 1 -- start start 2021-05-26T16:41:14.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.143+0000 7f0ac3bee700 10 monclient: init 2021-05-26T16:41:14.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.143+0000 7f0ac3bee700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:14.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.143+0000 7f0ac3bee700 10 monclient: _add_conns ranks=[8,0,2,1,6,7,4,5,3] 2021-05-26T16:41:14.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.143+0000 7f0ac3bee700 10 monclient(hunting): picked mon.noname-e con 0x7f0abc099c40 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:14.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.143+0000 7f0ac3bee700 10 monclient(hunting): picked mon.noname-a con 0x7f0abc09a0c0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:14.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac198a700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f0abc099c40 0x7f0abc13c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52322/0 (socket says 172.21.15.3:52322) 2021-05-26T16:41:14.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac218b700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f0abc13cba0 0x7f0abc1448f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53288/0 (socket says 172.21.15.3:53288) 2021-05-26T16:41:14.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac218b700 1 -- 172.21.15.3:0/1112133618 learned_addr learned my addr 172.21.15.3:0/1112133618 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:14.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac1189700 1 --1- 172.21.15.3:0/1112133618 >> v1:172.21.15.3:6789/0 conn(0x7f0abc09a0c0 0x7f0abc1411c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51244/0 (socket says 172.21.15.3:51244) 2021-05-26T16:41:14.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac3bee700 10 monclient(hunting): picked mon.noname-b con 0x7f0abc13cba0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:14.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc11cc20 con 0x7f0abc09a0c0 2021-05-26T16:41:14.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc11ce50 con 0x7f0abc13cba0 2021-05-26T16:41:14.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc11d0f0 con 0x7f0abc099c40 2021-05-26T16:41:14.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac3bee700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:14.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.144+0000 7f0ac3bee700 10 monclient(hunting): authenticate will time out at 831.776545s 2021-05-26T16:41:14.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0ac1189700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.3:6789/0 conn(0x7f0abc09a0c0 legacy=0x7f0abc1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:14.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0ac218b700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.3:6790/0 conn(0x7f0abc13cba0 legacy=0x7f0abc1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:14.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0ac198a700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.3:6793/0 conn(0x7f0abc099c40 legacy=0x7f0abc13c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:14.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072989604 0 0) 0x7f0abc11cc20 con 0x7f0abc09a0c0 2021-05-26T16:41:14.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:14.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:14.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): my global_id is 4437 2021-05-26T16:41:14.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a9c003270 con 0x7f0abc09a0c0 2021-05-26T16:41:14.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240084944 0 0) 0x7f0abc11ce50 con 0x7f0abc13cba0 2021-05-26T16:41:14.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:14.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:14.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): my global_id is 4367 2021-05-26T16:41:14.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0abc11cc20 con 0x7f0abc13cba0 2021-05-26T16:41:14.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421457238 0 0) 0x7f0abc11d0f0 con 0x7f0abc099c40 2021-05-26T16:41:14.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:14.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:14.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 10 monclient(hunting): my global_id is 4337 2021-05-26T16:41:14.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.146+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0abc11ce50 con 0x7f0abc099c40 2021-05-26T16:41:14.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 356410243 0 0) 0x7f0abc11ce50 con 0x7f0abc099c40 2021-05-26T16:41:14.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0abc11d0f0 con 0x7f0abc099c40 2021-05-26T16:41:14.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3889676621 0 0) 0x7f0a9c003270 con 0x7f0abc09a0c0 2021-05-26T16:41:14.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0abc11ce50 con 0x7f0abc09a0c0 2021-05-26T16:41:14.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1386521110 0 0) 0x7f0abc11cc20 con 0x7f0abc13cba0 2021-05-26T16:41:14.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a9c003270 con 0x7f0abc13cba0 2021-05-26T16:41:14.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0ab0004ae0 con 0x7f0abc099c40 2021-05-26T16:41:14.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:14.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:14.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:14.182 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:14.182 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:14.182 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.182 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.183 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:14.183 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:14.183 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:14.183 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:14.183 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:14.184 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:14.184 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:14.184 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:14.184 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:14.184 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:14.185 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:14.185 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:14.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:14.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0aac002240 con 0x7f0abc09a0c0 2021-05-26T16:41:14.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:14.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:14.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:14.186 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:14.186 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:14.187 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.187 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.187 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:14.187 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:14.187 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:14.188 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:14.188 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:14.188 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:14.188 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:14.188 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:14.189 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:14.189 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:14.189 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:14.189 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:14.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0ab80025c0 con 0x7f0abc13cba0 2021-05-26T16:41:14.190 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:14.190 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:14.190 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:14.190 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:14.190 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:14.191 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.191 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.191 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:14.191 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:14.191 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:14.192 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:14.192 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:14.192 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:14.192 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:14.192 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:14.193 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:14.193 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:14.193 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:14.193 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:14.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2269647999 0 0) 0x7f0abc11d0f0 con 0x7f0abc099c40 2021-05-26T16:41:14.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.3:6790/0 conn(0x7f0abc13cba0 legacy=0x7f0abc1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:14.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.3:6789/0 conn(0x7f0abc09a0c0 legacy=0x7f0abc1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:14.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:14.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 monclient: found mon.e 2021-05-26T16:41:14.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:14.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:14.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc11d390 con 0x7f0abc099c40 2021-05-26T16:41:14.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:14.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:14.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0ac3bee700 5 monclient: authenticate success, global_id 4337 2021-05-26T16:41:14.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0ac3bee700 10 monclient: _renew_subs 2021-05-26T16:41:14.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0ac3bee700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:14.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc11b220 con 0x7f0abc099c40 2021-05-26T16:41:14.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ab0001be0 con 0x7f0abc099c40 2021-05-26T16:41:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0ab00050e0 con 0x7f0abc099c40 2021-05-26T16:41:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aa9ffb700 10 monclient: dump: 2021-05-26T16:41:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:14.199 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:14.199 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:14.199 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:14.199 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:14.199 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:14.200 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:14.200 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:14.200 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:14.200 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:14.200 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:14.201 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:14.201 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:14.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0aabfff700 4 set_mon_vals no callback set 2021-05-26T16:41:14.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0ac3bee700 10 monclient: _renew_subs 2021-05-26T16:41:14.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0ac3bee700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:14.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.147+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc130ed0 con 0x7f0abc099c40 2021-05-26T16:41:14.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.148+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f0ab000e650 con 0x7f0abc099c40 2021-05-26T16:41:14.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.148+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f0ab003d5c0 con 0x7f0abc099c40 2021-05-26T16:41:14.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac1189700 10 monclient: get_auth_request con 0x7f0a9c0334a0 auth_method 0 2021-05-26T16:41:14.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac1189700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.137:6812/30003 conn(0x7f0a9c0334a0 legacy=0x7f0a9c035960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-05-26T16:41:14.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac1189700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.137:6812/30003 conn(0x7f0a9c0334a0 legacy=0x7f0a9c035960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:41:14.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac1189700 1 --1- 172.21.15.3:0/1112133618 >> v1:172.21.15.137:6812/30003 conn(0x7f0a9c0334a0 0x7f0a9c035960 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-05-26T16:41:14.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac1189700 1 --1- 172.21.15.3:0/1112133618 >> v1:172.21.15.137:6812/30003 conn(0x7f0a9c0334a0 0x7f0a9c035960 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-05-26T16:41:14.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.137:6812/30003 conn(0x7f0a9c0334a0 legacy=0x7f0a9c035960 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:14.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac3bee700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:14.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac3bee700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:14.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac3bee700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:14.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.149+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc09a530 con 0x7f0abc099c40 2021-05-26T16:41:14.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.153+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f0abc09a530 con 0x7f0abc099c40 2021-05-26T16:41:14.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.153+0000 7f0aa9ffb700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:14.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:14.153+0000 7f0aa9ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:15.152 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.149+0000 7f0aa3fff700 1 -- 172.21.15.3:0/1112133618 --> v1:172.21.15.137:6812/30003 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a90006990 con 0x7f0a9c0334a0 2021-05-26T16:41:15.152 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.149+0000 7f0ac1189700 10 monclient: get_auth_request con 0x7f0a9c0334a0 auth_method 0 2021-05-26T16:41:15.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.153+0000 7f0aa9ffb700 1 -- 172.21.15.3:0/1112133618 <== mgr.4104 v1:172.21.15.137:6812/30003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+38632 (unknown 2965378022 0 290354997) 0x7f0a90006990 con 0x7f0a9c0334a0 2021-05-26T16:41:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-05-26T16:41:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.137:6812/30003 conn(0x7f0a9c0334a0 legacy=0x7f0a90005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 10 monclient: shutdown 2021-05-26T16:41:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 >> v1:172.21.15.3:6793/0 conn(0x7f0abc099c40 legacy=0x7f0abc13c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 shutdown_connections 2021-05-26T16:41:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 >> 172.21.15.3:0/1112133618 conn(0x7f0abc064aa0 msgr2=0x7f0abc09f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 shutdown_connections 2021-05-26T16:41:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.157+0000 7f0ac3bee700 1 -- 172.21.15.3:0/1112133618 wait complete. 2021-05-26T16:41:15.163 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2021-05-26T16:41:15.177 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2021-05-26T16:41:14.587711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29552,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":28736,"kb_avail":566201488,"statfs":{"total":579820584960,"available":579790323712,"internally_reserved":0,"allocated":786432,"data_stored":232422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29425664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337071+0000","last_change":"2021-05-26T16:41:04.336448+0000","last_active":"2021-05-26T16:41:04.337071+0000","last_peered":"2021-05-26T16:41:04.337071+0000","last_clean":"2021-05-26T16:41:04.337071+0000","last_became_active":"2021-05-26T16:41:04.336153+0000","last_became_peered":"2021-05-26T16:41:04.336153+0000","last_unstale":"2021-05-26T16:41:04.337071+0000","last_undegraded":"2021-05-26T16:41:04.337071+0000","last_fullsized":"2021-05-26T16:41:04.337071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.337482+0000","last_change":"2021-05-26T16:41:04.336928+0000","last_active":"2021-05-26T16:41:04.337482+0000","last_peered":"2021-05-26T16:41:04.337482+0000","last_clean":"2021-05-26T16:41:04.337482+0000","last_became_active":"2021-05-26T16:41:04.336581+0000","last_became_peered":"2021-05-26T16:41:04.336581+0000","last_unstale":"2021-05-26T16:41:04.337482+0000","last_undegraded":"2021-05-26T16:41:04.337482+0000","last_fullsized":"2021-05-26T16:41:04.337482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336466+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336466+0000","last_peered":"2021-05-26T16:41:04.336466+0000","last_clean":"2021-05-26T16:41:04.336466+0000","last_became_active":"2021-05-26T16:41:04.330738+0000","last_became_peered":"2021-05-26T16:41:04.330738+0000","last_unstale":"2021-05-26T16:41:04.336466+0000","last_undegraded":"2021-05-26T16:41:04.336466+0000","last_fullsized":"2021-05-26T16:41:04.336466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336420+0000","last_change":"2021-05-26T16:41:04.331001+0000","last_active":"2021-05-26T16:41:04.336420+0000","last_peered":"2021-05-26T16:41:04.336420+0000","last_clean":"2021-05-26T16:41:04.336420+0000","last_became_active":"2021-05-26T16:41:04.330720+0000","last_became_peered":"2021-05-26T16:41:04.330720+0000","last_unstale":"2021-05-26T16:41:04.336420+0000","last_undegraded":"2021-05-26T16:41:04.336420+0000","last_fullsized":"2021-05-26T16:41:04.336420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.328271+0000","last_change":"2021-05-26T16:41:03.320118+0000","last_active":"2021-05-26T16:41:04.328271+0000","last_peered":"2021-05-26T16:41:04.328271+0000","last_clean":"2021-05-26T16:41:04.328271+0000","last_became_active":"2021-05-26T16:41:03.319736+0000","last_became_peered":"2021-05-26T16:41:03.319736+0000","last_unstale":"2021-05-26T16:41:04.328271+0000","last_undegraded":"2021-05-26T16:41:04.328271+0000","last_fullsized":"2021-05-26T16:41:04.328271+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:02.308057+0000","last_clean_scrub_stamp":"2021-05-26T16:41:02.308057+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336008+0000","last_change":"2021-05-26T16:41:04.327668+0000","last_active":"2021-05-26T16:41:04.336008+0000","last_peered":"2021-05-26T16:41:04.336008+0000","last_clean":"2021-05-26T16:41:04.336008+0000","last_became_active":"2021-05-26T16:41:04.327310+0000","last_became_peered":"2021-05-26T16:41:04.327310+0000","last_unstale":"2021-05-26T16:41:04.336008+0000","last_undegraded":"2021-05-26T16:41:04.336008+0000","last_fullsized":"2021-05-26T16:41:04.336008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.329067+0000","last_change":"2021-05-26T16:41:04.327922+0000","last_active":"2021-05-26T16:41:04.329067+0000","last_peered":"2021-05-26T16:41:04.329067+0000","last_clean":"2021-05-26T16:41:04.329067+0000","last_became_active":"2021-05-26T16:41:04.327579+0000","last_became_peered":"2021-05-26T16:41:04.327579+0000","last_unstale":"2021-05-26T16:41:04.329067+0000","last_undegraded":"2021-05-26T16:41:04.329067+0000","last_fullsized":"2021-05-26T16:41:04.329067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.336022+0000","last_change":"2021-05-26T16:41:04.327865+0000","last_active":"2021-05-26T16:41:04.336022+0000","last_peered":"2021-05-26T16:41:04.336022+0000","last_clean":"2021-05-26T16:41:04.336022+0000","last_became_active":"2021-05-26T16:41:04.327593+0000","last_became_peered":"2021-05-26T16:41:04.327593+0000","last_unstale":"2021-05-26T16:41:04.336022+0000","last_undegraded":"2021-05-26T16:41:04.336022+0000","last_fullsized":"2021-05-26T16:41:04.336022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-05-26T16:41:04.330247+0000","last_change":"2021-05-26T16:41:04.328266+0000","last_active":"2021-05-26T16:41:04.330247+0000","last_peered":"2021-05-26T16:41:04.330247+0000","last_clean":"2021-05-26T16:41:04.330247+0000","last_became_active":"2021-05-26T16:41:04.327859+0000","last_became_peered":"2021-05-26T16:41:04.327859+0000","last_unstale":"2021-05-26T16:41:04.330247+0000","last_undegraded":"2021-05-26T16:41:04.330247+0000","last_fullsized":"2021-05-26T16:41:04.330247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-05-26T16:41:03.309487+0000","last_clean_scrub_stamp":"2021-05-26T16:41:03.309487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-05-26T16:41:15.179 INFO:tasks.mon_thrash.ceph_manager:clean! 2021-05-26T16:41:15.179 DEBUG:tasks.mon_thrash:Yielding 2021-05-26T16:41:15.180 INFO:teuthology.run_tasks:Running task exec... 2021-05-26T16:41:15.190 INFO:teuthology.task.exec:Executing custom commands... 2021-05-26T16:41:15.191 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi137.front.sepia.ceph.com 2021-05-26T16:41:15.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:41:15.192 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2021-05-26T16:41:15.192 INFO:tasks.mon_thrash.mon_thrasher:seed: 1622047275, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: True, probability: 50 freeze mon: prob 10.0 duration 15.0 2021-05-26T16:41:15.193 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2021-05-26T16:41:15.193 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:41:15.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.316+0000 7fda1136d700 10 monclient: get_monmap_and_config 2021-05-26T16:41:15.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.316+0000 7fda1136d700 10 monclient: build_initial_monmap 2021-05-26T16:41:15.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.316+0000 7fda1136d700 10 monclient: monmap: 2021-05-26T16:41:15.322 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:15.322 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.322 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:15.317738+0000 2021-05-26T16:41:15.322 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:15.317738+0000 2021-05-26T16:41:15.322 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:15.323 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.323 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:15.323 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:15.323 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:15.323 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:15.324 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:15.324 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:15.324 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:15.324 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:15.324 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:15.325 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.316+0000 7fda1136d700 1 Processor -- start 2021-05-26T16:41:15.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.316+0000 7fda1136d700 1 -- start start 2021-05-26T16:41:15.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.316+0000 7fda1136d700 10 monclient: init 2021-05-26T16:41:15.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:15.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 10 monclient: _add_conns ranks=[3,6,0,8,5,4,1,7,2] 2021-05-26T16:41:15.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 10 monclient(hunting): picked mon.noname-g con 0x7fda0c064a20 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:15.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 10 monclient(hunting): picked mon.noname-d con 0x7fda0c063e30 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:15.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 10 monclient(hunting): picked mon.noname-a con 0x7fda0c0642e0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:15.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c059750 con 0x7fda0c0642e0 2021-05-26T16:41:15.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c064e00 con 0x7fda0c064a20 2021-05-26T16:41:15.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c09c770 con 0x7fda0c063e30 2021-05-26T16:41:15.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:15.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda1136d700 10 monclient(hunting): authenticate will time out at 832.949277s 2021-05-26T16:41:15.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda0a7fc700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fda0c063e30 0x7fda0c132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56656/0 (socket says 172.21.15.3:56656) 2021-05-26T16:41:15.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.317+0000 7fda0a7fc700 1 -- 172.21.15.3:0/373388678 learned_addr learned my addr 172.21.15.3:0/373388678 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:15.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda0a7fc700 1 -- 172.21.15.3:0/373388678 >> v1:172.21.15.3:6792/0 conn(0x7fda0c063e30 legacy=0x7fda0c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda0b7fe700 1 -- 172.21.15.3:0/373388678 >> v1:172.21.15.3:6789/0 conn(0x7fda0c0642e0 legacy=0x7fda0c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda0affd700 1 -- 172.21.15.3:0/373388678 >> v1:172.21.15.137:6790/0 conn(0x7fda0c064a20 legacy=0x7fda0c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979893955 0 0) 0x7fda0c059750 con 0x7fda0c0642e0 2021-05-26T16:41:15.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 10 monclient(hunting): my global_id is 4446 2021-05-26T16:41:15.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f8003270 con 0x7fda0c0642e0 2021-05-26T16:41:15.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294869823 0 0) 0x7fda0c09c770 con 0x7fda0c063e30 2021-05-26T16:41:15.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 10 monclient(hunting): my global_id is 4362 2021-05-26T16:41:15.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.319+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c059750 con 0x7fda0c063e30 2021-05-26T16:41:15.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440080633 0 0) 0x7fda0c064e00 con 0x7fda0c064a20 2021-05-26T16:41:15.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient(hunting): my global_id is 4368 2021-05-26T16:41:15.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c09c770 con 0x7fda0c064a20 2021-05-26T16:41:15.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214498597 0 0) 0x7fd9f8003270 con 0x7fda0c0642e0 2021-05-26T16:41:15.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 >> v1:172.21.15.3:6792/0 conn(0x7fda0c063e30 legacy=0x7fda0c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 >> v1:172.21.15.137:6790/0 conn(0x7fda0c064a20 legacy=0x7fda0c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 monclient: found mon.noname-a 2021-05-26T16:41:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:15.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0977a0 con 0x7fda0c0642e0 2021-05-26T16:41:15.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:15.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:15.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd9fc001e30 con 0x7fda0c0642e0 2021-05-26T16:41:15.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:15.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: dump: 2021-05-26T16:41:15.344 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.344 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.344 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.345 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.345 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.345 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.345 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.345 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.346 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.346 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.346 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.346 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.346 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.347 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.347 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.347 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 5 monclient: authenticate success, global_id 4446 2021-05-26T16:41:15.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:15.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd9fc002280 con 0x7fda0c0642e0 2021-05-26T16:41:15.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:15.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:15.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 1 -- 172.21.15.3:0/373388678 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd9fc002730 con 0x7fda0c0642e0 2021-05-26T16:41:15.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 4 set_mon_vals no callback set 2021-05-26T16:41:15.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:15.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda09ffb700 10 monclient: dump: 2021-05-26T16:41:15.349 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.349 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.350 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.350 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.350 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.350 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.350 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.351 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.351 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.351 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.351 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.351 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.352 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.352 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.352 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.352 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 10 monclient: shutdown 2021-05-26T16:41:15.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:15.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 1 -- 172.21.15.3:0/373388678 >> v1:172.21.15.3:6789/0 conn(0x7fda0c0642e0 legacy=0x7fda0c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 1 -- 172.21.15.3:0/373388678 shutdown_connections 2021-05-26T16:41:15.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 1 -- 172.21.15.3:0/373388678 >> 172.21.15.3:0/373388678 conn(0x7fda0c0a0db0 msgr2=0x7fda0c09cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:15.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 1 -- 172.21.15.3:0/373388678 shutdown_connections 2021-05-26T16:41:15.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.320+0000 7fda1136d700 1 -- 172.21.15.3:0/373388678 wait complete. 2021-05-26T16:41:15.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.321+0000 7fda1136d700 10 monclient: build_initial_monmap 2021-05-26T16:41:15.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.321+0000 7fda1136d700 10 monclient: monmap: 2021-05-26T16:41:15.354 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:15.355 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:15.355 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:15.355 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:15.355 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:15.355 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.356 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:15.356 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:15.356 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:15.356 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:15.356 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:15.357 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:15.357 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:15.357 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:15.357 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:15.357 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.321+0000 7fda1136d700 1 Processor -- start 2021-05-26T16:41:15.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.321+0000 7fda1136d700 1 -- start start 2021-05-26T16:41:15.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.321+0000 7fda1136d700 10 monclient: init 2021-05-26T16:41:15.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:15.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 10 monclient: _add_conns ranks=[8,3,1,5,0,4,7,6,2] 2021-05-26T16:41:15.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 10 monclient(hunting): picked mon.noname-e con 0x7fda0c063e30 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:15.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 10 monclient(hunting): picked mon.noname-g con 0x7fda0c0642e0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:15.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 10 monclient(hunting): picked mon.noname-f con 0x7fda0c064a20 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:15.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c116ff0 con 0x7fda0c064a20 2021-05-26T16:41:15.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c117290 con 0x7fda0c0642e0 2021-05-26T16:41:15.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c130000 con 0x7fda0c063e30 2021-05-26T16:41:15.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:15.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda1136d700 10 monclient(hunting): authenticate will time out at 832.954384s 2021-05-26T16:41:15.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda0affd700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fda0c063e30 0x7fda0c129850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52340/0 (socket says 172.21.15.3:52340) 2021-05-26T16:41:15.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.322+0000 7fda0affd700 1 -- 172.21.15.3:0/3363261983 learned_addr learned my addr 172.21.15.3:0/3363261983 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:15.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fda0affd700 1 -- 172.21.15.3:0/3363261983 >> v1:172.21.15.3:6793/0 conn(0x7fda0c063e30 legacy=0x7fda0c129850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fda0b7fe700 1 -- 172.21.15.3:0/3363261983 >> v1:172.21.15.137:6789/0 conn(0x7fda0c064a20 legacy=0x7fda0c144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fda0a7fc700 1 -- 172.21.15.3:0/3363261983 >> v1:172.21.15.137:6790/0 conn(0x7fda0c0642e0 legacy=0x7fda0c141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697537444 0 0) 0x7fda0c130000 con 0x7fda0c063e30 2021-05-26T16:41:15.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 10 monclient(hunting): my global_id is 4364 2021-05-26T16:41:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9ec003270 con 0x7fda0c063e30 2021-05-26T16:41:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705631798 0 0) 0x7fda0c116ff0 con 0x7fda0c064a20 2021-05-26T16:41:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 10 monclient(hunting): my global_id is 4339 2021-05-26T16:41:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.324+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c130000 con 0x7fda0c064a20 2021-05-26T16:41:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160813990 0 0) 0x7fda0c117290 con 0x7fda0c0642e0 2021-05-26T16:41:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): my global_id is 4377 2021-05-26T16:41:15.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c116ff0 con 0x7fda0c0642e0 2021-05-26T16:41:15.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1336508884 0 0) 0x7fd9ec003270 con 0x7fda0c063e30 2021-05-26T16:41:15.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fda0c117290 con 0x7fda0c063e30 2021-05-26T16:41:15.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd9f4001f00 con 0x7fda0c063e30 2021-05-26T16:41:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): dump: 2021-05-26T16:41:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.368 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.368 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.368 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.368 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.368 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 687057019 0 0) 0x7fda0c130000 con 0x7fda0c064a20 2021-05-26T16:41:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9ec003270 con 0x7fda0c064a20 2021-05-26T16:41:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd9fc002730 con 0x7fda0c064a20 2021-05-26T16:41:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:15.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient(hunting): dump: 2021-05-26T16:41:15.370 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.370 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.370 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.371 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.371 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.371 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.371 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.372 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.372 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.372 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.372 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.372 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.373 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.373 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.373 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.373 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.373 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3687964825 0 0) 0x7fda0c116ff0 con 0x7fda0c0642e0 2021-05-26T16:41:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fda0c130000 con 0x7fda0c0642e0 2021-05-26T16:41:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1497371661 0 0) 0x7fda0c117290 con 0x7fda0c063e30 2021-05-26T16:41:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 >> v1:172.21.15.137:6790/0 conn(0x7fda0c0642e0 legacy=0x7fda0c141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 >> v1:172.21.15.137:6789/0 conn(0x7fda0c064a20 legacy=0x7fda0c144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 monclient: found mon.e 2021-05-26T16:41:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c13cd20 con 0x7fda0c063e30 2021-05-26T16:41:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda1136d700 5 monclient: authenticate success, global_id 4364 2021-05-26T16:41:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda1136d700 10 monclient: _renew_subs 2021-05-26T16:41:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda1136d700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:15.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c12f520 con 0x7fda0c063e30 2021-05-26T16:41:15.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda1136d700 10 monclient: _renew_subs 2021-05-26T16:41:15.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda1136d700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:15.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c131540 con 0x7fda0c063e30 2021-05-26T16:41:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd9f40024e0 con 0x7fda0c063e30 2021-05-26T16:41:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd9f4002990 con 0x7fda0c063e30 2021-05-26T16:41:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fda097fa700 4 set_mon_vals no callback set 2021-05-26T16:41:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.325+0000 7fd9f2ffd700 10 monclient: dump: 2021-05-26T16:41:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.382 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.382 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.326+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fd9f4002b70 con 0x7fda0c063e30 2021-05-26T16:41:15.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.326+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7fd9f403d950 con 0x7fda0c063e30 2021-05-26T16:41:15.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.326+0000 7fda1136d700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:15.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.326+0000 7fda1136d700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:15.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.326+0000 7fda1136d700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:15.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.326+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e4004db0 con 0x7fda0c063e30 2021-05-26T16:41:15.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.326+0000 7fda0a7fc700 10 monclient: get_auth_request con 0x7fd9ec0331a0 auth_method 0 2021-05-26T16:41:15.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.330+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fd9f4013620 con 0x7fda0c063e30 2021-05-26T16:41:15.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.330+0000 7fd9f2ffd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:15.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.330+0000 7fd9f2ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:15.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.551+0000 7fda1136d700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:41:15.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.551+0000 7fda1136d700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:15.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.551+0000 7fda1136d700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:15.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.551+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 --> v1:172.21.15.3:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd9e40055e0 con 0x7fda0c063e30 2021-05-26T16:41:15.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.551+0000 7fd9f2ffd700 1 -- 172.21.15.3:0/3363261983 <== mon.8 v1:172.21.15.3:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2644 (unknown 254746657 0 847673434) 0x7fd9f4013210 con 0x7fda0c063e30 2021-05-26T16:41:15.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.551+0000 7fd9f2ffd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:15.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.551+0000 7fd9f2ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:15.557 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":4,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:41:15.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 >> v1:172.21.15.137:6812/30003 conn(0x7fd9ec0331a0 legacy=0x7fd9ec035660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 10 monclient: shutdown 2021-05-26T16:41:15.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:15.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 >> v1:172.21.15.3:6793/0 conn(0x7fda0c063e30 legacy=0x7fda0c129850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 shutdown_connections 2021-05-26T16:41:15.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 >> 172.21.15.3:0/3363261983 conn(0x7fda0c0a0db0 msgr2=0x7fda0c099ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:15.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 shutdown_connections 2021-05-26T16:41:15.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.553+0000 7fda1136d700 1 -- 172.21.15.3:0/3363261983 wait complete. 2021-05-26T16:41:15.568 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2021-05-26T16:41:15.568 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-05-26T16:41:15.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-05-26T16:41:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.683+0000 7f72e52c2700 10 monclient: get_monmap_and_config 2021-05-26T16:41:15.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.683+0000 7f72e52c2700 10 monclient: build_initial_monmap 2021-05-26T16:41:15.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.683+0000 7f72e52c2700 10 monclient: monmap: 2021-05-26T16:41:15.687 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:15.687 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.688 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:15.684983+0000 2021-05-26T16:41:15.688 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:15.684983+0000 2021-05-26T16:41:15.688 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:15.688 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.689 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:15.689 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:15.689 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:15.689 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:15.689 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:15.690 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:15.690 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:15.690 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:15.690 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:15.691 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.683+0000 7f72e52c2700 1 Processor -- start 2021-05-26T16:41:15.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 1 -- start start 2021-05-26T16:41:15.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient: init 2021-05-26T16:41:15.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:15.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient: _add_conns ranks=[7,2,8,3,1,0,4,6,5] 2021-05-26T16:41:15.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient(hunting): picked mon.noname-i con 0x7f72e0096ca0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:15.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient(hunting): picked mon.noname-b con 0x7f72e0099db0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:15.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient(hunting): picked mon.noname-e con 0x7f72e009a260 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:15.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0059750 con 0x7f72e0099db0 2021-05-26T16:41:15.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0064620 con 0x7f72e0096ca0 2021-05-26T16:41:15.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0064e50 con 0x7f72e009a260 2021-05-26T16:41:15.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:15.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72e52c2700 10 monclient(hunting): authenticate will time out at 833.316573s 2021-05-26T16:41:15.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72df7fe700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f72e009a260 0x7f72e01357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52352/0 (socket says 172.21.15.3:52352) 2021-05-26T16:41:15.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72de7fc700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f72e0099db0 0x7f72e0132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53310/0 (socket says 172.21.15.3:53310) 2021-05-26T16:41:15.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.684+0000 7f72df7fe700 1 -- 172.21.15.3:0/1362329379 learned_addr learned my addr 172.21.15.3:0/1362329379 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:15.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.686+0000 7f72de7fc700 1 -- 172.21.15.3:0/1362329379 >> v1:172.21.15.3:6790/0 conn(0x7f72e0099db0 legacy=0x7f72e0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.686+0000 7f72df7fe700 1 -- 172.21.15.3:0/1362329379 >> v1:172.21.15.3:6793/0 conn(0x7f72e009a260 legacy=0x7f72e01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.686+0000 7f72deffd700 1 -- 172.21.15.3:0/1362329379 >> v1:172.21.15.137:6792/0 conn(0x7f72e0096ca0 legacy=0x7f72e0063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269025443 0 0) 0x7f72e0064e50 con 0x7f72e009a260 2021-05-26T16:41:15.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient(hunting): my global_id is 4373 2021-05-26T16:41:15.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72cc003270 con 0x7f72e009a260 2021-05-26T16:41:15.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608098621 0 0) 0x7f72e0059750 con 0x7f72e0099db0 2021-05-26T16:41:15.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient(hunting): my global_id is 4385 2021-05-26T16:41:15.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e0064e50 con 0x7f72e0099db0 2021-05-26T16:41:15.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2900498506 0 0) 0x7f72cc003270 con 0x7f72e009a260 2021-05-26T16:41:15.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 >> v1:172.21.15.137:6792/0 conn(0x7f72e0096ca0 legacy=0x7f72e0063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 >> v1:172.21.15.3:6790/0 conn(0x7f72e0099db0 legacy=0x7f72e0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:15.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 monclient: found mon.noname-e 2021-05-26T16:41:15.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:15.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:15.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e009c390 con 0x7f72e009a260 2021-05-26T16:41:15.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:15.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:15.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 5 monclient: authenticate success, global_id 4373 2021-05-26T16:41:15.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f72d0001de0 con 0x7f72e009a260 2021-05-26T16:41:15.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:15.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: dump: 2021-05-26T16:41:15.710 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.711 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.711 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.711 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.711 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.712 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.712 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.712 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.712 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.712 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.713 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.713 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.713 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.713 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.714 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.715 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:15.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f72d00020f0 con 0x7f72e009a260 2021-05-26T16:41:15.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:15.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:15.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 1 -- 172.21.15.3:0/1362329379 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f72d0004cb0 con 0x7f72e009a260 2021-05-26T16:41:15.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 4 set_mon_vals no callback set 2021-05-26T16:41:15.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:15.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72ddffb700 10 monclient: dump: 2021-05-26T16:41:15.717 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.718 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.718 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.718 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.718 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.719 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.719 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.719 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.719 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.719 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.720 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.720 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.721 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.721 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.721 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.721 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 10 monclient: shutdown 2021-05-26T16:41:15.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:15.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 1 -- 172.21.15.3:0/1362329379 >> v1:172.21.15.3:6793/0 conn(0x7f72e009a260 legacy=0x7f72e01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 1 -- 172.21.15.3:0/1362329379 shutdown_connections 2021-05-26T16:41:15.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 1 -- 172.21.15.3:0/1362329379 >> 172.21.15.3:0/1362329379 conn(0x7f72e009cc00 msgr2=0x7f72e009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:15.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 1 -- 172.21.15.3:0/1362329379 shutdown_connections 2021-05-26T16:41:15.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.687+0000 7f72e52c2700 1 -- 172.21.15.3:0/1362329379 wait complete. 2021-05-26T16:41:15.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.688+0000 7f72e52c2700 10 monclient: build_initial_monmap 2021-05-26T16:41:15.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.688+0000 7f72e52c2700 10 monclient: monmap: 2021-05-26T16:41:15.723 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:15.724 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:15.724 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:15.724 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:15.724 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:15.725 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.725 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:15.725 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:15.725 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:15.725 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:15.726 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:15.726 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:15.726 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:15.726 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:15.727 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:15.727 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.688+0000 7f72e52c2700 1 Processor -- start 2021-05-26T16:41:15.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.688+0000 7f72e52c2700 1 -- start start 2021-05-26T16:41:15.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.688+0000 7f72e52c2700 10 monclient: init 2021-05-26T16:41:15.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:15.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 10 monclient: _add_conns ranks=[3,2,5,0,8,6,4,1,7] 2021-05-26T16:41:15.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 10 monclient(hunting): picked mon.noname-g con 0x7f72e0096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:15.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 10 monclient(hunting): picked mon.noname-b con 0x7f72e0099db0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:15.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 10 monclient(hunting): picked mon.noname-h con 0x7f72e009a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:15.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0116af0 con 0x7f72e0099db0 2021-05-26T16:41:15.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0116d90 con 0x7f72e0096ca0 2021-05-26T16:41:15.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0117030 con 0x7f72e009a260 2021-05-26T16:41:15.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:15.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72e52c2700 10 monclient(hunting): authenticate will time out at 833.321381s 2021-05-26T16:41:15.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72de7fc700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f72e0099db0 0x7f72e0141160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53318/0 (socket says 172.21.15.3:53318) 2021-05-26T16:41:15.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.689+0000 7f72de7fc700 1 -- 172.21.15.3:0/1715842261 learned_addr learned my addr 172.21.15.3:0/1715842261 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:15.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72de7fc700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6790/0 conn(0x7f72e0099db0 legacy=0x7f72e0141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790307430 0 0) 0x7f72e0116af0 con 0x7f72e0099db0 2021-05-26T16:41:15.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72c6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72c6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72c6ffd700 10 monclient(hunting): my global_id is 4394 2021-05-26T16:41:15.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0003270 con 0x7f72e0099db0 2021-05-26T16:41:15.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72df7fe700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.137:6791/0 conn(0x7f72e009a260 legacy=0x7f72e0144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72deffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.137:6790/0 conn(0x7f72e0096ca0 legacy=0x7f72e013c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.691+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1009621146 0 0) 0x7f72c0003270 con 0x7f72e0099db0 2021-05-26T16:41:15.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72e0116af0 con 0x7f72e0099db0 2021-05-26T16:41:15.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f72d4004530 con 0x7f72e0099db0 2021-05-26T16:41:15.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:15.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): dump: 2021-05-26T16:41:15.734 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.734 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.734 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.734 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.734 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.735 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.735 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.735 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.735 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.735 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.736 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.736 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.736 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.736 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.737 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.737 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:15.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153016558 0 0) 0x7f72e0117030 con 0x7f72e009a260 2021-05-26T16:41:15.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): my global_id is 4442 2021-05-26T16:41:15.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0003270 con 0x7f72e009a260 2021-05-26T16:41:15.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133069665 0 0) 0x7f72e0116d90 con 0x7f72e0096ca0 2021-05-26T16:41:15.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient(hunting): my global_id is 4386 2021-05-26T16:41:15.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e0117030 con 0x7f72e0096ca0 2021-05-26T16:41:15.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3079362267 0 0) 0x7f72e0116af0 con 0x7f72e0099db0 2021-05-26T16:41:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.137:6791/0 conn(0x7f72e009a260 legacy=0x7f72e0144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.137:6790/0 conn(0x7f72e0096ca0 legacy=0x7f72e013c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 monclient: found mon.b 2021-05-26T16:41:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e012f350 con 0x7f72e0099db0 2021-05-26T16:41:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72e52c2700 5 monclient: authenticate success, global_id 4394 2021-05-26T16:41:15.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72e52c2700 10 monclient: _renew_subs 2021-05-26T16:41:15.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72e52c2700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:15.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e0130050 con 0x7f72e0099db0 2021-05-26T16:41:15.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72e52c2700 10 monclient: _renew_subs 2021-05-26T16:41:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72e52c2700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e013cda0 con 0x7f72e0099db0 2021-05-26T16:41:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f72d4004b80 con 0x7f72e0099db0 2021-05-26T16:41:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f72d40050b0 con 0x7f72e0099db0 2021-05-26T16:41:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72dd7fa700 4 set_mon_vals no callback set 2021-05-26T16:41:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.692+0000 7f72c6ffd700 10 monclient: dump: 2021-05-26T16:41:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.745 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.745 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.745 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.749 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.693+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f72d4005290 con 0x7f72e0099db0 2021-05-26T16:41:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.693+0000 7f72e52c2700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.693+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f72b80065a0 con 0x7f72b8002840 2021-05-26T16:41:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.693+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f72d403daf0 con 0x7f72e0099db0 2021-05-26T16:41:15.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.693+0000 7f72df7fe700 10 monclient: get_auth_request con 0x7f72c0032940 auth_method 0 2021-05-26T16:41:15.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72deffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6789/0 conn(0x7f72b8002840 legacy=0x7f72b8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487861302 0 0) 0x7f72b80065a0 con 0x7f72b8002840 2021-05-26T16:41:15.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72c6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72c6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72c6ffd700 10 monclient(hunting): my global_id is 4455 2021-05-26T16:41:15.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e0116af0 con 0x7f72b8002840 2021-05-26T16:41:15.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1779533736 0 0) 0x7f72e0116af0 con 0x7f72b8002840 2021-05-26T16:41:15.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.695+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72b80065a0 con 0x7f72b8002840 2021-05-26T16:41:15.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f72c8001b40 con 0x7f72b8002840 2021-05-26T16:41:15.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:15.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 10 monclient: dump: 2021-05-26T16:41:15.752 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.753 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.753 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.753 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.753 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.753 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.754 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.754 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.754 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.754 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.755 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.755 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.755 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.755 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.755 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.756 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2813301771 0 0) 0x7f72b80065a0 con 0x7f72b8002840 2021-05-26T16:41:15.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72b8009e40 con 0x7f72b8002840 2021-05-26T16:41:15.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f72c8005510 con 0x7f72b8002840 2021-05-26T16:41:15.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:15.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:15.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6789/0 conn(0x7f72b8002840 legacy=0x7f72b8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.696+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6789/0 conn(0x7f72b8002840 legacy=0x7f72b8004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:15.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.703+0000 7f72e52c2700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:15.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.703+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f72b80074f0 con 0x7f72b8006890 2021-05-26T16:41:15.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72deffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6789/0 conn(0x7f72b8006890 legacy=0x7f72b8006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649653519 0 0) 0x7f72b80074f0 con 0x7f72b8006890 2021-05-26T16:41:15.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 10 monclient(hunting): my global_id is 4464 2021-05-26T16:41:15.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b80065a0 con 0x7f72b8006890 2021-05-26T16:41:15.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2885230173 0 0) 0x7f72b80065a0 con 0x7f72b8006890 2021-05-26T16:41:15.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72b80074f0 con 0x7f72b8006890 2021-05-26T16:41:15.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f72c80026f0 con 0x7f72b8006890 2021-05-26T16:41:15.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:15.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 10 monclient: dump: 2021-05-26T16:41:15.762 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.762 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.763 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.763 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.763 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.763 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.764 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.764 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.764 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.764 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.764 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.765 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.765 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.765 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.765 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.765 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3544829722 0 0) 0x7f72b80074f0 con 0x7f72b8006890 2021-05-26T16:41:15.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.705+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 --> v1:172.21.15.3:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f72b8008770 con 0x7f72b8006890 2021-05-26T16:41:15.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7494 (unknown 0 0 955753279) 0x7f72c8002a50 con 0x7f72b8006890 2021-05-26T16:41:15.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72c6ffd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:15.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72c6ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:15.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6789/0 conn(0x7f72b8006890 legacy=0x7f72b8006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72c6ffd700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6789/0 conn(0x7f72b8006890 legacy=0x7f72b8006d20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:15.767 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "leader", 2021-05-26T16:41:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 24, 2021-05-26T16:41:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:41:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:15.824 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:15.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.137:6812/30003 conn(0x7f72c0032940 legacy=0x7f72c0034e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 10 monclient: shutdown 2021-05-26T16:41:15.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:15.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 >> v1:172.21.15.3:6790/0 conn(0x7f72e0099db0 legacy=0x7f72e0141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72df7fe700 1 -- 172.21.15.3:0/1715842261 reap_dead start 2021-05-26T16:41:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72df7fe700 1 -- 172.21.15.3:0/1715842261 reap_dead start 2021-05-26T16:41:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 shutdown_connections 2021-05-26T16:41:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 >> 172.21.15.3:0/1715842261 conn(0x7f72e009cc00 msgr2=0x7f72e0098c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 shutdown_connections 2021-05-26T16:41:15.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.706+0000 7f72e52c2700 1 -- 172.21.15.3:0/1715842261 wait complete. 2021-05-26T16:41:15.828 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-05-26T16:41:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.941+0000 7f5944875700 10 monclient: get_monmap_and_config 2021-05-26T16:41:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.941+0000 7f5944875700 10 monclient: build_initial_monmap 2021-05-26T16:41:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.941+0000 7f5944875700 10 monclient: monmap: 2021-05-26T16:41:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:15.943473+0000 2021-05-26T16:41:15.947 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:15.943473+0000 2021-05-26T16:41:15.947 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:15.947 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.947 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:15.947 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:15.948 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:15.948 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:15.948 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:15.948 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:15.948 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:15.949 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:15.949 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:15.949 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.942+0000 7f5944875700 1 Processor -- start 2021-05-26T16:41:15.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.942+0000 7f5944875700 1 -- start start 2021-05-26T16:41:15.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.942+0000 7f5944875700 10 monclient: init 2021-05-26T16:41:15.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.942+0000 7f5944875700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:15.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.942+0000 7f5944875700 10 monclient: _add_conns ranks=[3,7,8,6,2,1,5,0,4] 2021-05-26T16:41:15.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 10 monclient(hunting): picked mon.noname-g con 0x7f5940096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:15.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 10 monclient(hunting): picked mon.noname-i con 0x7f5940099db0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:15.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 10 monclient(hunting): picked mon.noname-e con 0x7f594009a260 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:15.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5940059750 con 0x7f5940096ca0 2021-05-26T16:41:15.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5940064620 con 0x7f5940099db0 2021-05-26T16:41:15.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5940064e50 con 0x7f594009a260 2021-05-26T16:41:15.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:15.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f5944875700 10 monclient(hunting): authenticate will time out at 833.575089s 2021-05-26T16:41:15.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f593ed9d700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f594009a260 0x7f59401357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52370/0 (socket says 172.21.15.3:52370) 2021-05-26T16:41:15.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.943+0000 7f593ed9d700 1 -- 172.21.15.3:0/3729472051 learned_addr learned my addr 172.21.15.3:0/3729472051 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:15.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593ed9d700 1 -- 172.21.15.3:0/3729472051 >> v1:172.21.15.3:6793/0 conn(0x7f594009a260 legacy=0x7f59401357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593e59c700 1 -- 172.21.15.3:0/3729472051 >> v1:172.21.15.137:6790/0 conn(0x7f5940096ca0 legacy=0x7f5940063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593dd9b700 1 -- 172.21.15.3:0/3729472051 >> v1:172.21.15.137:6792/0 conn(0x7f5940099db0 legacy=0x7f5940132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476153949 0 0) 0x7f5940064e50 con 0x7f594009a260 2021-05-26T16:41:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): my global_id is 4382 2021-05-26T16:41:15.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5924003270 con 0x7f594009a260 2021-05-26T16:41:15.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028473509 0 0) 0x7f5940059750 con 0x7f5940096ca0 2021-05-26T16:41:15.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): my global_id is 4395 2021-05-26T16:41:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5940064e50 con 0x7f5940096ca0 2021-05-26T16:41:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932151307 0 0) 0x7f5940064620 con 0x7f5940099db0 2021-05-26T16:41:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 10 monclient(hunting): my global_id is 4336 2021-05-26T16:41:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.945+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5940059750 con 0x7f5940099db0 2021-05-26T16:41:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412147782 0 0) 0x7f5924003270 con 0x7f594009a260 2021-05-26T16:41:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 >> v1:172.21.15.137:6792/0 conn(0x7f5940099db0 legacy=0x7f5940132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 >> v1:172.21.15.137:6790/0 conn(0x7f5940096ca0 legacy=0x7f5940063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: _finish_hunting 0 2021-05-26T16:41:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 monclient: found mon.noname-e 2021-05-26T16:41:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594009c390 con 0x7f594009a260 2021-05-26T16:41:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: _finish_auth 0 2021-05-26T16:41:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5930001de0 con 0x7f594009a260 2021-05-26T16:41:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 5 monclient: authenticate success, global_id 4382 2021-05-26T16:41:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: dump: 2021-05-26T16:41:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.973 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f59300020f0 con 0x7f594009a260 2021-05-26T16:41:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 1 -- 172.21.15.3:0/3729472051 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5930004cb0 con 0x7f594009a260 2021-05-26T16:41:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 4 set_mon_vals no callback set 2021-05-26T16:41:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f593d59a700 10 monclient: dump: 2021-05-26T16:41:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.978 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.978 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 10 monclient: shutdown 2021-05-26T16:41:15.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 1 -- 172.21.15.3:0/3729472051 >> v1:172.21.15.3:6793/0 conn(0x7f594009a260 legacy=0x7f59401357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 1 -- 172.21.15.3:0/3729472051 shutdown_connections 2021-05-26T16:41:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 1 -- 172.21.15.3:0/3729472051 >> 172.21.15.3:0/3729472051 conn(0x7f594009cc00 msgr2=0x7f594009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 1 -- 172.21.15.3:0/3729472051 shutdown_connections 2021-05-26T16:41:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.946+0000 7f5944875700 1 -- 172.21.15.3:0/3729472051 wait complete. 2021-05-26T16:41:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient: build_initial_monmap 2021-05-26T16:41:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient: monmap: 2021-05-26T16:41:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:15.983 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 1 Processor -- start 2021-05-26T16:41:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 1 -- start start 2021-05-26T16:41:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient: init 2021-05-26T16:41:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient: _add_conns ranks=[6,8,0,7,4,2,3,5,1] 2021-05-26T16:41:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient(hunting): picked mon.noname-d con 0x7f5940096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient(hunting): picked mon.noname-e con 0x7f5940099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 10 monclient(hunting): picked mon.noname-a con 0x7f594009a260 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.947+0000 7f5944875700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5940116b30 con 0x7f594009a260 2021-05-26T16:41:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.948+0000 7f5944875700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5940116dd0 con 0x7f5940096ca0 2021-05-26T16:41:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.948+0000 7f5944875700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5940117070 con 0x7f5940099db0 2021-05-26T16:41:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.948+0000 7f5944875700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:15.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.948+0000 7f5944875700 10 monclient(hunting): authenticate will time out at 833.580031s 2021-05-26T16:41:15.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.948+0000 7f593dd9b700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f5940099db0 0x7f59401410e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52376/0 (socket says 172.21.15.3:52376) 2021-05-26T16:41:15.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.948+0000 7f593dd9b700 1 -- 172.21.15.3:0/910509750 learned_addr learned my addr 172.21.15.3:0/910509750 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:15.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.948+0000 7f593e59c700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f5940096ca0 0x7f594013c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56692/0 (socket says 172.21.15.3:56692) 2021-05-26T16:41:15.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f593ed9d700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6789/0 conn(0x7f594009a260 legacy=0x7f5940144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f593e59c700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6792/0 conn(0x7f5940096ca0 legacy=0x7f594013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f593dd9b700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6793/0 conn(0x7f5940099db0 legacy=0x7f59401410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:15.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f593e59c700 1 --1- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6792/0 conn(0x7f5940096ca0 0x7f594013c3b0 :-1 s=OPENED pgs=87 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7f5940116dd0 auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014828901 0 0) 0x7f5940117070 con 0x7f5940099db0 2021-05-26T16:41:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): my global_id is 4391 2021-05-26T16:41:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f591c003270 con 0x7f5940099db0 2021-05-26T16:41:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745713143 0 0) 0x7f5940116b30 con 0x7f594009a260 2021-05-26T16:41:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): my global_id is 4473 2021-05-26T16:41:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5940117070 con 0x7f594009a260 2021-05-26T16:41:15.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 762877418 0 0) 0x7f591c003270 con 0x7f5940099db0 2021-05-26T16:41:15.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5940116b30 con 0x7f5940099db0 2021-05-26T16:41:15.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5934001d20 con 0x7f5940099db0 2021-05-26T16:41:15.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:15.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:15.991 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.991 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.991 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.993 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.993 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.993 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.993 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.993 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.994 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.994 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.994 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:15.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 345042386 0 0) 0x7f5940117070 con 0x7f594009a260 2021-05-26T16:41:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f591c003270 con 0x7f594009a260 2021-05-26T16:41:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5930001e10 con 0x7f594009a260 2021-05-26T16:41:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:15.996 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:15.996 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:15.996 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.996 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:15.996 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:15.999 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1126525497 0 0) 0x7f5940116b30 con 0x7f5940099db0 2021-05-26T16:41:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6792/0 conn(0x7f5940096ca0 legacy=0x7f594013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6789/0 conn(0x7f594009a260 legacy=0x7f5940144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 monclient: found mon.e 2021-05-26T16:41:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594012f380 con 0x7f5940099db0 2021-05-26T16:41:16.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:16.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:16.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406540452 0 0) 0x7f5940116dd0 con 0x7f5940096ca0 2021-05-26T16:41:16.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f592e7fc700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:41:16.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.950+0000 7f5944875700 5 monclient: authenticate success, global_id 4391 2021-05-26T16:41:16.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f5944875700 10 monclient: _renew_subs 2021-05-26T16:41:16.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f5944875700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:16.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5940130050 con 0x7f5940099db0 2021-05-26T16:41:16.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f5944875700 10 monclient: _renew_subs 2021-05-26T16:41:16.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f5944875700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f594013cd00 con 0x7f5940099db0 2021-05-26T16:41:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5934002400 con 0x7f5940099db0 2021-05-26T16:41:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59340028b0 con 0x7f5940099db0 2021-05-26T16:41:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f593cd99700 4 set_mon_vals no callback set 2021-05-26T16:41:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 10 monclient: dump: 2021-05-26T16:41:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.007 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f5934002a90 con 0x7f5940099db0 2021-05-26T16:41:16.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3011847326 0 0) 0x7f593403d7d0 con 0x7f5940099db0 2021-05-26T16:41:16.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.951+0000 7f5944875700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.952+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f59200065a0 con 0x7f5920002840 2021-05-26T16:41:16.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.952+0000 7f593e59c700 10 monclient: get_auth_request con 0x7f591c033110 auth_method 0 2021-05-26T16:41:16.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f593ed9d700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6790/0 conn(0x7f5920002840 legacy=0x7f5920004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70360342 0 0) 0x7f59200065a0 con 0x7f5920002840 2021-05-26T16:41:16.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 10 monclient(hunting): my global_id is 4403 2021-05-26T16:41:16.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5940116dd0 con 0x7f5920002840 2021-05-26T16:41:16.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 42538985 0 0) 0x7f5940116dd0 con 0x7f5920002840 2021-05-26T16:41:16.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59200065a0 con 0x7f5920002840 2021-05-26T16:41:16.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5930005120 con 0x7f5920002840 2021-05-26T16:41:16.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:16.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 10 monclient: dump: 2021-05-26T16:41:16.011 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.011 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.012 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.012 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.012 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.012 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.012 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.013 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.013 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.013 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.013 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.013 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.014 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.014 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.014 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.014 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1113076078 0 0) 0x7f59200065a0 con 0x7f5920002840 2021-05-26T16:41:16.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.954+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5920009e40 con 0x7f5920002840 2021-05-26T16:41:16.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.955+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f59300053f0 con 0x7f5920002840 2021-05-26T16:41:16.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.955+0000 7f592e7fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.955+0000 7f592e7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:16.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.955+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6790/0 conn(0x7f5920002840 legacy=0x7f5920004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.955+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6790/0 conn(0x7f5920002840 legacy=0x7f5920004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.961+0000 7f5944875700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:16.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.961+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5920009ad0 con 0x7f5920008d90 2021-05-26T16:41:16.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f593ed9d700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6790/0 conn(0x7f5920008d90 legacy=0x7f5920009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528900167 0 0) 0x7f5920009ad0 con 0x7f5920008d90 2021-05-26T16:41:16.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 10 monclient(hunting): my global_id is 4412 2021-05-26T16:41:16.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59200065a0 con 0x7f5920008d90 2021-05-26T16:41:16.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 900895083 0 0) 0x7f59200065a0 con 0x7f5920008d90 2021-05-26T16:41:16.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5920009ad0 con 0x7f5920008d90 2021-05-26T16:41:16.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5930005bb0 con 0x7f5920008d90 2021-05-26T16:41:16.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:16.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 10 monclient: dump: 2021-05-26T16:41:16.021 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.021 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.021 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.021 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.022 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.022 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.022 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.022 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.023 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.023 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.023 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.023 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.023 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.024 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.024 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.024 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2613220195 0 0) 0x7f5920009ad0 con 0x7f5920008d90 2021-05-26T16:41:16.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.964+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 --> v1:172.21.15.3:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5920008740 con 0x7f5920008d90 2021-05-26T16:41:16.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 1005444612) 0x7f59300060c0 con 0x7f5920008d90 2021-05-26T16:41:16.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f592e7fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:16.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f592e7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:16.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6790/0 conn(0x7f5920008d90 legacy=0x7f5920009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f592e7fc700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6790/0 conn(0x7f5920008d90 legacy=0x7f5920009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.026 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 24, 2021-05-26T16:41:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:16.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.137:6812/30003 conn(0x7f591c033110 legacy=0x7f591c0355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 10 monclient: shutdown 2021-05-26T16:41:16.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:16.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 >> v1:172.21.15.3:6793/0 conn(0x7f5940099db0 legacy=0x7f59401410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f593ed9d700 1 -- 172.21.15.3:0/910509750 reap_dead start 2021-05-26T16:41:16.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 shutdown_connections 2021-05-26T16:41:16.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 >> 172.21.15.3:0/910509750 conn(0x7f594009cc00 msgr2=0x7f5940097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:16.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 shutdown_connections 2021-05-26T16:41:16.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:15.965+0000 7f5944875700 1 -- 172.21.15.3:0/910509750 wait complete. 2021-05-26T16:41:16.085 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-05-26T16:41:16.205 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.202+0000 7f602762d700 10 monclient: get_monmap_and_config 2021-05-26T16:41:16.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.202+0000 7f602762d700 10 monclient: build_initial_monmap 2021-05-26T16:41:16.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.202+0000 7f602762d700 10 monclient: monmap: 2021-05-26T16:41:16.206 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:16.206 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.206 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:16.203606+0000 2021-05-26T16:41:16.207 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:16.203606+0000 2021-05-26T16:41:16.207 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:16.207 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.207 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:16.208 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:16.208 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:16.208 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:16.208 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:16.208 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:16.209 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:16.209 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:16.209 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:16.209 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.202+0000 7f602762d700 1 Processor -- start 2021-05-26T16:41:16.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.202+0000 7f602762d700 1 -- start start 2021-05-26T16:41:16.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.202+0000 7f602762d700 10 monclient: init 2021-05-26T16:41:16.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:16.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 10 monclient: _add_conns ranks=[4,6,5,3,1,2,0,7,8] 2021-05-26T16:41:16.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 10 monclient(hunting): picked mon.noname-c con 0x7f6020096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:16.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 10 monclient(hunting): picked mon.noname-d con 0x7f6020099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:16.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 10 monclient(hunting): picked mon.noname-h con 0x7f602009a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:16.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020059750 con 0x7f6020096ca0 2021-05-26T16:41:16.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020064620 con 0x7f602009a260 2021-05-26T16:41:16.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020064e50 con 0x7f6020099db0 2021-05-26T16:41:16.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:16.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f602762d700 10 monclient(hunting): authenticate will time out at 833.835258s 2021-05-26T16:41:16.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f6024bc8700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f6020099db0 0x7f6020132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56704/0 (socket says 172.21.15.3:56704) 2021-05-26T16:41:16.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f60253c9700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f6020096ca0 0x7f6020063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36816/0 (socket says 172.21.15.3:36816) 2021-05-26T16:41:16.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.203+0000 7f6024bc8700 1 -- 172.21.15.3:0/2492755454 learned_addr learned my addr 172.21.15.3:0/2492755454 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:16.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.205+0000 7f60253c9700 1 -- 172.21.15.3:0/2492755454 >> v1:172.21.15.3:6791/0 conn(0x7f6020096ca0 legacy=0x7f6020063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.205+0000 7f6024bc8700 1 -- 172.21.15.3:0/2492755454 >> v1:172.21.15.3:6792/0 conn(0x7f6020099db0 legacy=0x7f6020132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.205+0000 7f6025bca700 1 -- 172.21.15.3:0/2492755454 >> v1:172.21.15.137:6791/0 conn(0x7f602009a260 legacy=0x7f60201357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.238+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306433060 0 0) 0x7f6020059750 con 0x7f6020096ca0 2021-05-26T16:41:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.238+0000 7f600ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.238+0000 7f600ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.238+0000 7f600ffff700 10 monclient(hunting): my global_id is 4396 2021-05-26T16:41:16.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.238+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6008003270 con 0x7f6020096ca0 2021-05-26T16:41:16.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471159283 0 0) 0x7f6008003270 con 0x7f6020096ca0 2021-05-26T16:41:16.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 >> v1:172.21.15.3:6792/0 conn(0x7f6020099db0 legacy=0x7f6020132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 >> v1:172.21.15.137:6791/0 conn(0x7f602009a260 legacy=0x7f60201357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:16.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 1 monclient: found mon.noname-c 2021-05-26T16:41:16.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:16.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:16.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602009c390 con 0x7f6020096ca0 2021-05-26T16:41:16.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 10 monclient: _finish_auth 0 2021-05-26T16:41:16.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:16.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6014001a50 con 0x7f6020096ca0 2021-05-26T16:41:16.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:16.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.239+0000 7f600ffff700 10 monclient: dump: 2021-05-26T16:41:16.248 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.248 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.248 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.248 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.248 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.249 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.249 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.249 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.249 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.249 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.250 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.250 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.250 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.250 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.250 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.251 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f602762d700 5 monclient: authenticate success, global_id 4396 2021-05-26T16:41:16.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f602762d700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:16.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6014001d60 con 0x7f6020096ca0 2021-05-26T16:41:16.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f600ffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:16.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f600ffff700 1 -- 172.21.15.3:0/2492755454 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6014004870 con 0x7f6020096ca0 2021-05-26T16:41:16.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f600ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f600ffff700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:16.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f600ffff700 10 monclient: dump: 2021-05-26T16:41:16.252 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.253 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.253 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.253 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.253 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.253 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.254 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.254 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.254 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.254 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.254 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.255 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.255 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.255 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.255 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.255 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f602762d700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:16.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.240+0000 7f602762d700 4 set_mon_vals no callback set 2021-05-26T16:41:16.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.241+0000 7f602762d700 10 monclient: shutdown 2021-05-26T16:41:16.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.241+0000 7f602762d700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:16.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.241+0000 7f602762d700 1 -- 172.21.15.3:0/2492755454 >> v1:172.21.15.3:6791/0 conn(0x7f6020096ca0 legacy=0x7f6020063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.241+0000 7f602762d700 1 -- 172.21.15.3:0/2492755454 shutdown_connections 2021-05-26T16:41:16.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.241+0000 7f602762d700 1 -- 172.21.15.3:0/2492755454 >> 172.21.15.3:0/2492755454 conn(0x7f602009cc00 msgr2=0x7f602009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:16.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.241+0000 7f602762d700 1 -- 172.21.15.3:0/2492755454 shutdown_connections 2021-05-26T16:41:16.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.241+0000 7f602762d700 1 -- 172.21.15.3:0/2492755454 wait complete. 2021-05-26T16:41:16.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.242+0000 7f602762d700 10 monclient: build_initial_monmap 2021-05-26T16:41:16.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.242+0000 7f602762d700 10 monclient: monmap: 2021-05-26T16:41:16.265 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:16.265 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:16.265 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:16.266 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:16.266 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:16.266 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.266 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:16.267 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:16.267 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:16.267 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:16.267 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:16.267 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:16.268 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:16.268 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:16.268 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:16.268 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.242+0000 7f602762d700 1 Processor -- start 2021-05-26T16:41:16.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.242+0000 7f602762d700 1 -- start start 2021-05-26T16:41:16.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.242+0000 7f602762d700 10 monclient: init 2021-05-26T16:41:16.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:16.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 10 monclient: _add_conns ranks=[2,5,3,6,1,4,8,7,0] 2021-05-26T16:41:16.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 10 monclient(hunting): picked mon.noname-b con 0x7f6020096ca0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:16.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 10 monclient(hunting): picked mon.noname-h con 0x7f6020099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:16.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 10 monclient(hunting): picked mon.noname-g con 0x7f602009a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:16.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602011d090 con 0x7f6020096ca0 2021-05-26T16:41:16.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602011d330 con 0x7f602009a260 2021-05-26T16:41:16.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602011d5d0 con 0x7f6020099db0 2021-05-26T16:41:16.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:16.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f602762d700 10 monclient(hunting): authenticate will time out at 833.875432s 2021-05-26T16:41:16.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f60253c9700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f6020096ca0 0x7f602013bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53352/0 (socket says 172.21.15.3:53352) 2021-05-26T16:41:16.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.243+0000 7f60253c9700 1 -- 172.21.15.3:0/90896564 learned_addr learned my addr 172.21.15.3:0/90896564 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:16.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f60253c9700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6790/0 conn(0x7f6020096ca0 legacy=0x7f602013bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f6024bc8700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.137:6791/0 conn(0x7f6020099db0 legacy=0x7f602012fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f6025bca700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.137:6790/0 conn(0x7f602009a260 legacy=0x7f6020144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562078533 0 0) 0x7f602011d090 con 0x7f6020096ca0 2021-05-26T16:41:16.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 10 monclient(hunting): my global_id is 4421 2021-05-26T16:41:16.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6000003270 con 0x7f6020096ca0 2021-05-26T16:41:16.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169954113 0 0) 0x7f602011d330 con 0x7f602009a260 2021-05-26T16:41:16.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.245+0000 7f600d7fa700 10 monclient(hunting): my global_id is 4404 2021-05-26T16:41:16.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f602011d090 con 0x7f602009a260 2021-05-26T16:41:16.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540936208 0 0) 0x7f602011d5d0 con 0x7f6020099db0 2021-05-26T16:41:16.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): my global_id is 4460 2021-05-26T16:41:16.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f602011d330 con 0x7f6020099db0 2021-05-26T16:41:16.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3340311946 0 0) 0x7f6000003270 con 0x7f6020096ca0 2021-05-26T16:41:16.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f602011d5d0 con 0x7f6020096ca0 2021-05-26T16:41:16.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6014004870 con 0x7f6020096ca0 2021-05-26T16:41:16.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:16.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): dump: 2021-05-26T16:41:16.276 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.276 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.277 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.277 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.277 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.277 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.277 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.278 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.278 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.278 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.278 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.279 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.279 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.279 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.279 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.279 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:16.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3587722533 0 0) 0x7f602011d090 con 0x7f602009a260 2021-05-26T16:41:16.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6000003270 con 0x7f602009a260 2021-05-26T16:41:16.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f601c001f60 con 0x7f602009a260 2021-05-26T16:41:16.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:16.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): dump: 2021-05-26T16:41:16.281 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.281 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.281 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.282 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.282 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.282 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.282 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.282 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.283 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.283 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.283 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.283 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.283 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.283 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.284 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.284 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 137186801 0 0) 0x7f602011d330 con 0x7f6020099db0 2021-05-26T16:41:16.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f602011d090 con 0x7f6020099db0 2021-05-26T16:41:16.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6010001c90 con 0x7f6020099db0 2021-05-26T16:41:16.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:16.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient(hunting): dump: 2021-05-26T16:41:16.285 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.285 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.286 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.286 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.286 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.286 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.286 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.287 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.287 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.287 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.287 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.287 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.288 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.288 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.288 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.288 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 152722519 0 0) 0x7f602011d5d0 con 0x7f6020096ca0 2021-05-26T16:41:16.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.137:6791/0 conn(0x7f6020099db0 legacy=0x7f602012fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.137:6790/0 conn(0x7f602009a260 legacy=0x7f6020144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:16.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 monclient: found mon.b 2021-05-26T16:41:16.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:16.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:16.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602013c620 con 0x7f6020096ca0 2021-05-26T16:41:16.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:16.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:16.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f602762d700 5 monclient: authenticate success, global_id 4421 2021-05-26T16:41:16.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f602762d700 10 monclient: _renew_subs 2021-05-26T16:41:16.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f602762d700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:16.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602013cd50 con 0x7f6020096ca0 2021-05-26T16:41:16.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f602762d700 10 monclient: _renew_subs 2021-05-26T16:41:16.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f602762d700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:16.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201302a0 con 0x7f6020096ca0 2021-05-26T16:41:16.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6014004ef0 con 0x7f6020096ca0 2021-05-26T16:41:16.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:16.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f60140053a0 con 0x7f6020096ca0 2021-05-26T16:41:16.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:16.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600f7fe700 4 set_mon_vals no callback set 2021-05-26T16:41:16.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.246+0000 7f600d7fa700 10 monclient: dump: 2021-05-26T16:41:16.293 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.293 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.294 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.294 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.294 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.294 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.294 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.295 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.295 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.295 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.295 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.295 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.296 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.296 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.296 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.296 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.247+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f601400e910 con 0x7f6020096ca0 2021-05-26T16:41:16.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.247+0000 7f602762d700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.247+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5ff80065a0 con 0x7f5ff8002840 2021-05-26T16:41:16.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.247+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 3941+0+0 (unknown 1804037707 0 0) 0x7f601403da60 con 0x7f6020096ca0 2021-05-26T16:41:16.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.247+0000 7f6025bca700 10 monclient: get_auth_request con 0x7f60000333f0 auth_method 0 2021-05-26T16:41:16.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.249+0000 7f6024bc8700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6791/0 conn(0x7f5ff8002840 legacy=0x7f5ff8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.249+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222392445 0 0) 0x7f5ff80065a0 con 0x7f5ff8002840 2021-05-26T16:41:16.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.249+0000 7f600d7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.249+0000 7f600d7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.249+0000 7f600d7fa700 10 monclient(hunting): my global_id is 4405 2021-05-26T16:41:16.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.249+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f602011d5d0 con 0x7f5ff8002840 2021-05-26T16:41:16.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3548237312 0 0) 0x7f602011d5d0 con 0x7f5ff8002840 2021-05-26T16:41:16.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5ff80065a0 con 0x7f5ff8002840 2021-05-26T16:41:16.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6010004a60 con 0x7f5ff8002840 2021-05-26T16:41:16.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:16.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 10 monclient: dump: 2021-05-26T16:41:16.300 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.300 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.300 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.300 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.301 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.301 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.301 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.301 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.301 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.303 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 784562528 0 0) 0x7f5ff80065a0 con 0x7f5ff8002840 2021-05-26T16:41:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ff8009e40 con 0x7f5ff8002840 2021-05-26T16:41:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f6010004f50 con 0x7f5ff8002840 2021-05-26T16:41:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6791/0 conn(0x7f5ff8002840 legacy=0x7f5ff8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.250+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6791/0 conn(0x7f5ff8002840 legacy=0x7f5ff8004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.257+0000 7f602762d700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.257+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5ff8009ad0 con 0x7f5ff8008d90 2021-05-26T16:41:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f6024bc8700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6791/0 conn(0x7f5ff8008d90 legacy=0x7f5ff8009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522531428 0 0) 0x7f5ff8009ad0 con 0x7f5ff8008d90 2021-05-26T16:41:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 10 monclient(hunting): my global_id is 4414 2021-05-26T16:41:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff80065a0 con 0x7f5ff8008d90 2021-05-26T16:41:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2212085935 0 0) 0x7f5ff80065a0 con 0x7f5ff8008d90 2021-05-26T16:41:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5ff8009ad0 con 0x7f5ff8008d90 2021-05-26T16:41:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6010005700 con 0x7f5ff8008d90 2021-05-26T16:41:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 10 monclient: dump: 2021-05-26T16:41:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.309 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.309 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.309 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.309 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.309 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.310 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4005746511 0 0) 0x7f5ff8009ad0 con 0x7f5ff8008d90 2021-05-26T16:41:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.259+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 --> v1:172.21.15.3:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5ff8008740 con 0x7f5ff8008d90 2021-05-26T16:41:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 2400513093) 0x7f6010005950 con 0x7f5ff8008d90 2021-05-26T16:41:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f600d7fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f600d7fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6791/0 conn(0x7f5ff8008d90 legacy=0x7f5ff8009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f600d7fa700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6791/0 conn(0x7f5ff8008d90 legacy=0x7f5ff8009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.312 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 24, 2021-05-26T16:41:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:16.369 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:16.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.137:6812/30003 conn(0x7f60000333f0 legacy=0x7f60000358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 10 monclient: shutdown 2021-05-26T16:41:16.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:16.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 >> v1:172.21.15.3:6790/0 conn(0x7f6020096ca0 legacy=0x7f602013bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f6025bca700 1 -- 172.21.15.3:0/90896564 reap_dead start 2021-05-26T16:41:16.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f6025bca700 1 -- 172.21.15.3:0/90896564 reap_dead start 2021-05-26T16:41:16.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 shutdown_connections 2021-05-26T16:41:16.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 >> 172.21.15.3:0/90896564 conn(0x7f602009cc00 msgr2=0x7f602009eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:16.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 shutdown_connections 2021-05-26T16:41:16.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.260+0000 7f602762d700 1 -- 172.21.15.3:0/90896564 wait complete. 2021-05-26T16:41:16.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2021-05-26T16:41:16.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.487+0000 7f5deae88700 10 monclient: get_monmap_and_config 2021-05-26T16:41:16.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.487+0000 7f5deae88700 10 monclient: build_initial_monmap 2021-05-26T16:41:16.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.487+0000 7f5deae88700 10 monclient: monmap: 2021-05-26T16:41:16.492 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:16.492 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.492 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:16.488745+0000 2021-05-26T16:41:16.492 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:16.488745+0000 2021-05-26T16:41:16.493 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:16.493 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.493 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:16.494 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:16.494 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:16.494 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:16.496 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.487+0000 7f5deae88700 1 Processor -- start 2021-05-26T16:41:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.487+0000 7f5deae88700 1 -- start start 2021-05-26T16:41:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.487+0000 7f5deae88700 10 monclient: init 2021-05-26T16:41:16.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:16.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 10 monclient: _add_conns ranks=[8,1,4,5,0,3,6,2,7] 2021-05-26T16:41:16.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 10 monclient(hunting): picked mon.noname-e con 0x7f5de4064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:16.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 10 monclient(hunting): picked mon.noname-f con 0x7f5de4063e30 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:16.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 10 monclient(hunting): picked mon.noname-c con 0x7f5de40642e0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:16.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de4059750 con 0x7f5de4063e30 2021-05-26T16:41:16.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de4064e00 con 0x7f5de40642e0 2021-05-26T16:41:16.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de409c770 con 0x7f5de4064a20 2021-05-26T16:41:16.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:16.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5deae88700 10 monclient(hunting): authenticate will time out at 834.120377s 2021-05-26T16:41:16.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5de8c24700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f5de4064a20 0x7f5de4099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52402/0 (socket says 172.21.15.3:52402) 2021-05-26T16:41:16.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5de9425700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f5de40642e0 0x7f5de41357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36838/0 (socket says 172.21.15.3:36838) 2021-05-26T16:41:16.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.488+0000 7f5de8c24700 1 -- 172.21.15.3:0/2112628308 learned_addr learned my addr 172.21.15.3:0/2112628308 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:16.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5de8c24700 1 -- 172.21.15.3:0/2112628308 >> v1:172.21.15.3:6793/0 conn(0x7f5de4064a20 legacy=0x7f5de4099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5de9425700 1 -- 172.21.15.3:0/2112628308 >> v1:172.21.15.3:6791/0 conn(0x7f5de40642e0 legacy=0x7f5de41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358251279 0 0) 0x7f5de409c770 con 0x7f5de4064a20 2021-05-26T16:41:16.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 10 monclient(hunting): my global_id is 4400 2021-05-26T16:41:16.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd0003270 con 0x7f5de4064a20 2021-05-26T16:41:16.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddbfff700 1 -- 172.21.15.3:0/2112628308 >> v1:172.21.15.137:6789/0 conn(0x7f5de4063e30 legacy=0x7f5de4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598806363 0 0) 0x7f5de4064e00 con 0x7f5de40642e0 2021-05-26T16:41:16.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 10 monclient(hunting): my global_id is 4423 2021-05-26T16:41:16.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.490+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de409c770 con 0x7f5de40642e0 2021-05-26T16:41:16.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446932270 0 0) 0x7f5de4059750 con 0x7f5de4063e30 2021-05-26T16:41:16.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient(hunting): my global_id is 4348 2021-05-26T16:41:16.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de4064e00 con 0x7f5de4063e30 2021-05-26T16:41:16.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3043143958 0 0) 0x7f5dd0003270 con 0x7f5de4064a20 2021-05-26T16:41:16.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 >> v1:172.21.15.3:6791/0 conn(0x7f5de40642e0 legacy=0x7f5de41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 >> v1:172.21.15.137:6789/0 conn(0x7f5de4063e30 legacy=0x7f5de4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:16.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 monclient: found mon.noname-e 2021-05-26T16:41:16.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:16.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:16.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40977a0 con 0x7f5de4064a20 2021-05-26T16:41:16.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:16.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:16.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5dd4001aa0 con 0x7f5de4064a20 2021-05-26T16:41:16.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 5 monclient: authenticate success, global_id 4400 2021-05-26T16:41:16.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:16.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:16.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: dump: 2021-05-26T16:41:16.519 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.519 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.519 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.520 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.520 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.520 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.521 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.521 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.521 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.521 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.522 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.522 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.522 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.522 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.523 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.523 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:16.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5dd40045f0 con 0x7f5de4064a20 2021-05-26T16:41:16.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:16.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:16.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/2112628308 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5dd4004aa0 con 0x7f5de4064a20 2021-05-26T16:41:16.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 4 set_mon_vals no callback set 2021-05-26T16:41:16.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:16.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5ddb7fe700 10 monclient: dump: 2021-05-26T16:41:16.525 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.525 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.526 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.526 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.526 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.527 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.527 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.527 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.527 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.528 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.528 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.528 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.528 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.528 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.529 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.529 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 10 monclient: shutdown 2021-05-26T16:41:16.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:16.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 1 -- 172.21.15.3:0/2112628308 >> v1:172.21.15.3:6793/0 conn(0x7f5de4064a20 legacy=0x7f5de4099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 1 -- 172.21.15.3:0/2112628308 shutdown_connections 2021-05-26T16:41:16.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 1 -- 172.21.15.3:0/2112628308 >> 172.21.15.3:0/2112628308 conn(0x7f5de40a0db0 msgr2=0x7f5de409cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:16.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 1 -- 172.21.15.3:0/2112628308 shutdown_connections 2021-05-26T16:41:16.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.491+0000 7f5deae88700 1 -- 172.21.15.3:0/2112628308 wait complete. 2021-05-26T16:41:16.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.492+0000 7f5deae88700 10 monclient: build_initial_monmap 2021-05-26T16:41:16.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.492+0000 7f5deae88700 10 monclient: monmap: 2021-05-26T16:41:16.531 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:16.532 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:16.532 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:16.532 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:16.532 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:16.532 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.533 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:16.533 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:16.533 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:16.534 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:16.534 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:16.534 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:16.534 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:16.534 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:16.535 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:16.535 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.492+0000 7f5deae88700 1 Processor -- start 2021-05-26T16:41:16.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.492+0000 7f5deae88700 1 -- start start 2021-05-26T16:41:16.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.492+0000 7f5deae88700 10 monclient: init 2021-05-26T16:41:16.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:16.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 10 monclient: _add_conns ranks=[6,7,4,8,0,1,3,5,2] 2021-05-26T16:41:16.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 10 monclient(hunting): picked mon.noname-d con 0x7f5de4063e30 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:16.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 10 monclient(hunting): picked mon.noname-i con 0x7f5de40642e0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:16.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 10 monclient(hunting): picked mon.noname-c con 0x7f5de4064a20 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:16.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de4116ea0 con 0x7f5de4064a20 2021-05-26T16:41:16.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de4117140 con 0x7f5de4063e30 2021-05-26T16:41:16.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de41173e0 con 0x7f5de40642e0 2021-05-26T16:41:16.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:16.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5deae88700 10 monclient(hunting): authenticate will time out at 834.125331s 2021-05-26T16:41:16.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5de9425700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f5de4064a20 0x7f5de4144330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36844/0 (socket says 172.21.15.3:36844) 2021-05-26T16:41:16.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5de8c24700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f5de4063e30 0x7f5de413bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56728/0 (socket says 172.21.15.3:56728) 2021-05-26T16:41:16.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.493+0000 7f5de9425700 1 -- 172.21.15.3:0/3889213065 learned_addr learned my addr 172.21.15.3:0/3889213065 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:16.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5de8c24700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5de4063e30 legacy=0x7f5de413bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5de9425700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6791/0 conn(0x7f5de4064a20 legacy=0x7f5de4144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5ddbfff700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.137:6792/0 conn(0x7f5de40642e0 legacy=0x7f5de41299a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698545183 0 0) 0x7f5de4117140 con 0x7f5de4063e30 2021-05-26T16:41:16.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): my global_id is 4389 2021-05-26T16:41:16.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc4003270 con 0x7f5de4063e30 2021-05-26T16:41:16.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399276768 0 0) 0x7f5de4116ea0 con 0x7f5de4064a20 2021-05-26T16:41:16.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): my global_id is 4432 2021-05-26T16:41:16.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de4117140 con 0x7f5de4064a20 2021-05-26T16:41:16.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772726712 0 0) 0x7f5de41173e0 con 0x7f5de40642e0 2021-05-26T16:41:16.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 10 monclient(hunting): my global_id is 4345 2021-05-26T16:41:16.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de4116ea0 con 0x7f5de40642e0 2021-05-26T16:41:16.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.495+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4121652044 0 0) 0x7f5dc4003270 con 0x7f5de4063e30 2021-05-26T16:41:16.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5de41173e0 con 0x7f5de4063e30 2021-05-26T16:41:16.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5dd4001360 con 0x7f5de4063e30 2021-05-26T16:41:16.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:16.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:16.544 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.544 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.544 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.544 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.544 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.545 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.545 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.545 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.545 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.545 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.546 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.546 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.546 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.546 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.546 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.547 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:16.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 562251831 0 0) 0x7f5de4117140 con 0x7f5de4064a20 2021-05-26T16:41:16.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5dc4003270 con 0x7f5de4064a20 2021-05-26T16:41:16.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5de0001cb0 con 0x7f5de4064a20 2021-05-26T16:41:16.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:16.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:16.548 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.549 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.549 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.549 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.549 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.549 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.550 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.550 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.550 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.551 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.551 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.551 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.552 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.552 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.552 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.552 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1713317137 0 0) 0x7f5de4116ea0 con 0x7f5de40642e0 2021-05-26T16:41:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5de4117140 con 0x7f5de40642e0 2021-05-26T16:41:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5dcc001d60 con 0x7f5de40642e0 2021-05-26T16:41:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2021-05-26T16:41:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient(hunting): dump: 2021-05-26T16:41:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.555 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.555 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.555 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.555 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.555 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.556 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.556 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.556 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.556 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.556 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.557 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.557 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.557 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2766850137 0 0) 0x7f5de41173e0 con 0x7f5de4063e30 2021-05-26T16:41:16.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.137:6792/0 conn(0x7f5de40642e0 legacy=0x7f5de41299a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6791/0 conn(0x7f5de4064a20 legacy=0x7f5de4144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:41:16.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 monclient: found mon.d 2021-05-26T16:41:16.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:16.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:16.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de413ce40 con 0x7f5de4063e30 2021-05-26T16:41:16.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient: _finish_auth 0 2021-05-26T16:41:16.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:16.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5deae88700 5 monclient: authenticate success, global_id 4389 2021-05-26T16:41:16.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5deae88700 10 monclient: _renew_subs 2021-05-26T16:41:16.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5deae88700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:16.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de412f690 con 0x7f5de4063e30 2021-05-26T16:41:16.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5deae88700 10 monclient: _renew_subs 2021-05-26T16:41:16.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5deae88700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:16.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de412a0b0 con 0x7f5de4063e30 2021-05-26T16:41:16.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5dd4001cd0 con 0x7f5de4063e30 2021-05-26T16:41:16.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:16.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5dd4005090 con 0x7f5de4063e30 2021-05-26T16:41:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5dd8ff9700 10 monclient: dump: 2021-05-26T16:41:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.565 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.565 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.565 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.565 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.567 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.496+0000 7f5ddaffd700 4 set_mon_vals no callback set 2021-05-26T16:41:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.497+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f5dd400e600 con 0x7f5de4063e30 2021-05-26T16:41:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.497+0000 7f5deae88700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.497+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5dbc0065a0 con 0x7f5dbc002840 2021-05-26T16:41:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.497+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 3941+0+0 (unknown 1804037707 0 0) 0x7f5dd403d910 con 0x7f5de4063e30 2021-05-26T16:41:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.497+0000 7f5de9425700 10 monclient: get_auth_request con 0x7f5dc40333f0 auth_method 0 2021-05-26T16:41:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5ddbfff700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5dbc002840 legacy=0x7f5dbc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435489391 0 0) 0x7f5dbc0065a0 con 0x7f5dbc002840 2021-05-26T16:41:16.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 10 monclient(hunting): my global_id is 4398 2021-05-26T16:41:16.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de41173e0 con 0x7f5dbc002840 2021-05-26T16:41:16.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4010477186 0 0) 0x7f5de41173e0 con 0x7f5dbc002840 2021-05-26T16:41:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5dbc0065a0 con 0x7f5dbc002840 2021-05-26T16:41:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5dcc002520 con 0x7f5dbc002840 2021-05-26T16:41:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 10 monclient: dump: 2021-05-26T16:41:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.572 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.572 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.572 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.572 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.572 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.574 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1011038429 0 0) 0x7f5dbc0065a0 con 0x7f5dbc002840 2021-05-26T16:41:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.499+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dbc009e40 con 0x7f5dbc002840 2021-05-26T16:41:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.500+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f5dcc002a10 con 0x7f5dbc002840 2021-05-26T16:41:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.500+0000 7f5dd8ff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.500+0000 7f5dd8ff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.500+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5dbc002840 legacy=0x7f5dbc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.500+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5dbc002840 legacy=0x7f5dbc004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.506+0000 7f5deae88700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.506+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5dbc007510 con 0x7f5dbc0068b0 2021-05-26T16:41:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5ddbfff700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5dbc0068b0 legacy=0x7f5dbc006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434486859 0 0) 0x7f5dbc007510 con 0x7f5dbc0068b0 2021-05-26T16:41:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient(hunting): my global_id is 4407 2021-05-26T16:41:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dbc0065a0 con 0x7f5dbc0068b0 2021-05-26T16:41:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4288622775 0 0) 0x7f5dbc0065a0 con 0x7f5dbc0068b0 2021-05-26T16:41:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5dbc007510 con 0x7f5dbc0068b0 2021-05-26T16:41:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5dcc005850 con 0x7f5dbc0068b0 2021-05-26T16:41:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient: dump: 2021-05-26T16:41:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.584 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 702000040 0 0) 0x7f5dbc007510 con 0x7f5dbc0068b0 2021-05-26T16:41:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 --> v1:172.21.15.3:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5dbc008770 con 0x7f5dbc0068b0 2021-05-26T16:41:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 519735811) 0x7f5dcc007b00 con 0x7f5dbc0068b0 2021-05-26T16:41:16.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:16.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:16.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5dbc0068b0 legacy=0x7f5dbc006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.509+0000 7f5dd8ff9700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5dbc0068b0 legacy=0x7f5dbc006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 24, 2021-05-26T16:41:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:16.640 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.137:6812/30003 conn(0x7f5dc40333f0 legacy=0x7f5dc40358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 10 monclient: shutdown 2021-05-26T16:41:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 >> v1:172.21.15.3:6792/0 conn(0x7f5de4063e30 legacy=0x7f5de413bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5de9425700 1 -- 172.21.15.3:0/3889213065 reap_dead start 2021-05-26T16:41:16.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5de9425700 1 -- 172.21.15.3:0/3889213065 reap_dead start 2021-05-26T16:41:16.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 shutdown_connections 2021-05-26T16:41:16.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 >> 172.21.15.3:0/3889213065 conn(0x7f5de40a0db0 msgr2=0x7f5de409ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:16.643 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 shutdown_connections 2021-05-26T16:41:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.510+0000 7f5deae88700 1 -- 172.21.15.3:0/3889213065 wait complete. 2021-05-26T16:41:16.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2021-05-26T16:41:16.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.757+0000 7ff84d114700 10 monclient: get_monmap_and_config 2021-05-26T16:41:16.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.757+0000 7ff84d114700 10 monclient: build_initial_monmap 2021-05-26T16:41:16.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.757+0000 7ff84d114700 10 monclient: monmap: 2021-05-26T16:41:16.761 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:16.761 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.762 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:16.759118+0000 2021-05-26T16:41:16.762 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:16.759118+0000 2021-05-26T16:41:16.762 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:16.762 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.763 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:16.763 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:16.763 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:16.763 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:16.763 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:16.764 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:16.764 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:16.764 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:16.764 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:16.765 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 1 Processor -- start 2021-05-26T16:41:16.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 1 -- start start 2021-05-26T16:41:16.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient: init 2021-05-26T16:41:16.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:16.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient: _add_conns ranks=[0,8,4,1,2,7,3,6,5] 2021-05-26T16:41:16.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient(hunting): picked mon.noname-a con 0x7ff84812cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:16.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient(hunting): picked mon.noname-e con 0x7ff848099a30 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:16.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient(hunting): picked mon.noname-c con 0x7ff848099eb0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:16.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff848046600 con 0x7ff84812cbd0 2021-05-26T16:41:16.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84809b5e0 con 0x7ff848099eb0 2021-05-26T16:41:16.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84812d8f0 con 0x7ff848099a30 2021-05-26T16:41:16.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:16.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff84d114700 10 monclient(hunting): authenticate will time out at 834.390885s 2021-05-26T16:41:16.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff847fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff84812cbd0 0x7ff84812d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51340/0 (socket says 172.21.15.3:51340) 2021-05-26T16:41:16.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff847fff700 1 -- 172.21.15.3:0/4269661647 learned_addr learned my addr 172.21.15.3:0/4269661647 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:16.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.758+0000 7ff8477fe700 1 --1- 172.21.15.3:0/4269661647 >> v1:172.21.15.3:6793/0 conn(0x7ff848099a30 0x7ff848131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52422/0 (socket says 172.21.15.3:52422) 2021-05-26T16:41:16.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff847fff700 1 -- 172.21.15.3:0/4269661647 >> v1:172.21.15.3:6789/0 conn(0x7ff84812cbd0 legacy=0x7ff84812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff8477fe700 1 -- 172.21.15.3:0/4269661647 >> v1:172.21.15.3:6793/0 conn(0x7ff848099a30 legacy=0x7ff848131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff84c913700 1 -- 172.21.15.3:0/4269661647 >> v1:172.21.15.3:6791/0 conn(0x7ff848099eb0 legacy=0x7ff848135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584521178 0 0) 0x7ff84812d8f0 con 0x7ff848099a30 2021-05-26T16:41:16.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): my global_id is 4409 2021-05-26T16:41:16.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82c003270 con 0x7ff848099a30 2021-05-26T16:41:16.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211391747 0 0) 0x7ff848046600 con 0x7ff84812cbd0 2021-05-26T16:41:16.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): my global_id is 4482 2021-05-26T16:41:16.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff84812d8f0 con 0x7ff84812cbd0 2021-05-26T16:41:16.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090446013 0 0) 0x7ff84809b5e0 con 0x7ff848099eb0 2021-05-26T16:41:16.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient(hunting): my global_id is 4441 2021-05-26T16:41:16.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff848046600 con 0x7ff848099eb0 2021-05-26T16:41:16.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947525877 0 0) 0x7ff848046600 con 0x7ff848099eb0 2021-05-26T16:41:16.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 >> v1:172.21.15.3:6793/0 conn(0x7ff848099a30 legacy=0x7ff848131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 >> v1:172.21.15.3:6789/0 conn(0x7ff84812cbd0 legacy=0x7ff84812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:16.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 monclient: found mon.noname-c 2021-05-26T16:41:16.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:16.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:16.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84809c2b0 con 0x7ff848099eb0 2021-05-26T16:41:16.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:16.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:16.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff83c001d50 con 0x7ff848099eb0 2021-05-26T16:41:16.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff84d114700 5 monclient: authenticate success, global_id 4441 2021-05-26T16:41:16.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff84d114700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:16.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:16.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: dump: 2021-05-26T16:41:16.787 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.787 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.787 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.787 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.787 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.788 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.788 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.788 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.788 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.789 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.789 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.789 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.789 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.789 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.790 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.790 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff84d114700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:16.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff83c002060 con 0x7ff848099eb0 2021-05-26T16:41:16.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:16.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 1 -- 172.21.15.3:0/4269661647 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff83c0025c0 con 0x7ff848099eb0 2021-05-26T16:41:16.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff84d114700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:16.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff84d114700 4 set_mon_vals no callback set 2021-05-26T16:41:16.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.761+0000 7ff846ffd700 10 monclient: dump: 2021-05-26T16:41:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.793 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.793 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.793 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.793 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.793 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.794 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.794 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.794 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.794 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.795 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.795 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.795 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.795 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 10 monclient: shutdown 2021-05-26T16:41:16.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:16.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 1 -- 172.21.15.3:0/4269661647 >> v1:172.21.15.3:6791/0 conn(0x7ff848099eb0 legacy=0x7ff848135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 1 -- 172.21.15.3:0/4269661647 shutdown_connections 2021-05-26T16:41:16.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 1 -- 172.21.15.3:0/4269661647 >> 172.21.15.3:0/4269661647 conn(0x7ff8480a00c0 msgr2=0x7ff8480a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:16.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 1 -- 172.21.15.3:0/4269661647 shutdown_connections 2021-05-26T16:41:16.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 1 -- 172.21.15.3:0/4269661647 wait complete. 2021-05-26T16:41:16.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 10 monclient: build_initial_monmap 2021-05-26T16:41:16.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.762+0000 7ff84d114700 10 monclient: monmap: 2021-05-26T16:41:16.797 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:16.798 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:16.798 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:16.798 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:16.798 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:16.798 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.799 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:16.799 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:16.799 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:16.799 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:16.799 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:16.800 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:16.800 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:16.800 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:16.800 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:16.800 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 1 Processor -- start 2021-05-26T16:41:16.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 1 -- start start 2021-05-26T16:41:16.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient: init 2021-05-26T16:41:16.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:16.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient: _add_conns ranks=[2,1,8,4,7,3,6,0,5] 2021-05-26T16:41:16.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient(hunting): picked mon.noname-b con 0x7ff848099a30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:16.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient(hunting): picked mon.noname-f con 0x7ff848099eb0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:16.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient(hunting): picked mon.noname-e con 0x7ff84812cbd0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:16.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff848095100 con 0x7ff848099eb0 2021-05-26T16:41:16.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8480967b0 con 0x7ff848099a30 2021-05-26T16:41:16.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff848093ae0 con 0x7ff84812cbd0 2021-05-26T16:41:16.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:16.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff84d114700 10 monclient(hunting): authenticate will time out at 834.395800s 2021-05-26T16:41:16.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff847fff700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7ff848099a30 0x7ff8481389f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53388/0 (socket says 172.21.15.3:53388) 2021-05-26T16:41:16.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.763+0000 7ff847fff700 1 -- 172.21.15.3:0/3055418125 learned_addr learned my addr 172.21.15.3:0/3055418125 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:16.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.766+0000 7ff847fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6790/0 conn(0x7ff848099a30 legacy=0x7ff8481389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.766+0000 7ff84c913700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff84812cbd0 legacy=0x7ff848144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.766+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 DispatchQueue::entry inject delay of 0.002000 2021-05-26T16:41:16.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.766+0000 7ff8477fe700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.137:6789/0 conn(0x7ff848099eb0 legacy=0x7ff848140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318119062 0 0) 0x7ff848093ae0 con 0x7ff84812cbd0 2021-05-26T16:41:16.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): my global_id is 4418 2021-05-26T16:41:16.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff828003270 con 0x7ff84812cbd0 2021-05-26T16:41:16.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330592909 0 0) 0x7ff8480967b0 con 0x7ff848099a30 2021-05-26T16:41:16.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): my global_id is 4430 2021-05-26T16:41:16.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff848093ae0 con 0x7ff848099a30 2021-05-26T16:41:16.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741008810 0 0) 0x7ff848095100 con 0x7ff848099eb0 2021-05-26T16:41:16.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): my global_id is 4357 2021-05-26T16:41:16.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8480967b0 con 0x7ff848099eb0 2021-05-26T16:41:16.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2192776757 0 0) 0x7ff828003270 con 0x7ff84812cbd0 2021-05-26T16:41:16.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff848095100 con 0x7ff84812cbd0 2021-05-26T16:41:16.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff83c0025c0 con 0x7ff84812cbd0 2021-05-26T16:41:16.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:16.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): dump: 2021-05-26T16:41:16.809 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.809 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.809 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.811 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.811 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.811 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.811 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.811 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.812 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.812 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.812 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:16.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1186069616 0 0) 0x7ff848093ae0 con 0x7ff848099a30 2021-05-26T16:41:16.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff828003270 con 0x7ff848099a30 2021-05-26T16:41:16.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff838001cb0 con 0x7ff848099a30 2021-05-26T16:41:16.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:16.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient(hunting): dump: 2021-05-26T16:41:16.814 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.814 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.814 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.814 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.817 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.817 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1389653990 0 0) 0x7ff848095100 con 0x7ff84812cbd0 2021-05-26T16:41:16.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6790/0 conn(0x7ff848099a30 legacy=0x7ff8481389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.137:6789/0 conn(0x7ff848099eb0 legacy=0x7ff848140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:16.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 monclient: found mon.e 2021-05-26T16:41:16.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:16.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480945c0 con 0x7ff84812cbd0 2021-05-26T16:41:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff84d114700 5 monclient: authenticate success, global_id 4418 2021-05-26T16:41:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff84d114700 10 monclient: _renew_subs 2021-05-26T16:41:16.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff84d114700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:16.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8480947b0 con 0x7ff84812cbd0 2021-05-26T16:41:16.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff84d114700 10 monclient: _renew_subs 2021-05-26T16:41:16.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff84d114700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:16.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8481392c0 con 0x7ff84812cbd0 2021-05-26T16:41:16.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff83c0016f0 con 0x7ff84812cbd0 2021-05-26T16:41:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff83c002ef0 con 0x7ff84812cbd0 2021-05-26T16:41:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff8467fc700 4 set_mon_vals no callback set 2021-05-26T16:41:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.768+0000 7ff833fff700 10 monclient: dump: 2021-05-26T16:41:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.823 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.823 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.823 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.823 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.825 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.769+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7ff83c00eca0 con 0x7ff84812cbd0 2021-05-26T16:41:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.769+0000 7ff84d114700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.769+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff8200065a0 con 0x7ff820002840 2021-05-26T16:41:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.769+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 3941+0+0 (unknown 1804037707 0 0) 0x7ff83c03de50 con 0x7ff84812cbd0 2021-05-26T16:41:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.769+0000 7ff8477fe700 10 monclient: get_auth_request con 0x7ff8280330f0 auth_method 0 2021-05-26T16:41:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.771+0000 7ff847fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff820002840 legacy=0x7ff820004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.771+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478011289 0 0) 0x7ff8200065a0 con 0x7ff820002840 2021-05-26T16:41:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.771+0000 7ff833fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.771+0000 7ff833fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.771+0000 7ff833fff700 10 monclient(hunting): my global_id is 4427 2021-05-26T16:41:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.771+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff848095100 con 0x7ff820002840 2021-05-26T16:41:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1889405319 0 0) 0x7ff848095100 con 0x7ff820002840 2021-05-26T16:41:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8200065a0 con 0x7ff820002840 2021-05-26T16:41:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff838004bb0 con 0x7ff820002840 2021-05-26T16:41:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:16.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 10 monclient: dump: 2021-05-26T16:41:16.829 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.829 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.829 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.830 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.830 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.830 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.830 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.830 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.831 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.831 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.831 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.831 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.831 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.832 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.832 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.832 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 742717334 0 0) 0x7ff8200065a0 con 0x7ff820002840 2021-05-26T16:41:16.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff820009e40 con 0x7ff820002840 2021-05-26T16:41:16.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7ff8380050a0 con 0x7ff820002840 2021-05-26T16:41:16.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:16.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:16.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff820002840 legacy=0x7ff820004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.772+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff820002840 legacy=0x7ff820004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.779+0000 7ff84d114700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:16.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.779+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff820007510 con 0x7ff8200068b0 2021-05-26T16:41:16.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff847fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff8200068b0 legacy=0x7ff820006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:16.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969344880 0 0) 0x7ff820007510 con 0x7ff8200068b0 2021-05-26T16:41:16.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:16.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:16.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 10 monclient(hunting): my global_id is 4436 2021-05-26T16:41:16.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8200065a0 con 0x7ff8200068b0 2021-05-26T16:41:16.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2714575755 0 0) 0x7ff8200065a0 con 0x7ff8200068b0 2021-05-26T16:41:16.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff820007510 con 0x7ff8200068b0 2021-05-26T16:41:16.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff838005880 con 0x7ff8200068b0 2021-05-26T16:41:16.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:16.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:16.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 10 monclient: dump: 2021-05-26T16:41:16.838 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:16.839 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:16.839 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.839 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:16.839 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:16.839 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:16.840 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:16.840 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:16.840 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:16.840 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:16.840 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:16.841 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:16.841 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:16.841 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:16.841 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:16.841 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:16.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1190066294 0 0) 0x7ff820007510 con 0x7ff8200068b0 2021-05-26T16:41:16.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.781+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 --> v1:172.21.15.3:6793/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff820008770 con 0x7ff8200068b0 2021-05-26T16:41:16.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 4070153884) 0x7ff838005dd0 con 0x7ff8200068b0 2021-05-26T16:41:16.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff833fff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:16.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff833fff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:16.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff8200068b0 legacy=0x7ff820006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff833fff700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff8200068b0 legacy=0x7ff820006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:16.843 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 25, 2021-05-26T16:41:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:16.897 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:16.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.137:6812/30003 conn(0x7ff8280330f0 legacy=0x7ff8280355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 10 monclient: shutdown 2021-05-26T16:41:16.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:16.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 >> v1:172.21.15.3:6793/0 conn(0x7ff84812cbd0 legacy=0x7ff848144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:16.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84c913700 1 -- 172.21.15.3:0/3055418125 reap_dead start 2021-05-26T16:41:16.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84c913700 1 -- 172.21.15.3:0/3055418125 reap_dead start 2021-05-26T16:41:16.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 shutdown_connections 2021-05-26T16:41:16.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 >> 172.21.15.3:0/3055418125 conn(0x7ff8480a00c0 msgr2=0x7ff848129ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:16.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 shutdown_connections 2021-05-26T16:41:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:16.782+0000 7ff84d114700 1 -- 172.21.15.3:0/3055418125 wait complete. 2021-05-26T16:41:16.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2021-05-26T16:41:17.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.014+0000 7fd29931a700 10 monclient: get_monmap_and_config 2021-05-26T16:41:17.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.014+0000 7fd29931a700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.014+0000 7fd29931a700 10 monclient: monmap: 2021-05-26T16:41:17.019 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.019 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.019 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:17.016470+0000 2021-05-26T16:41:17.019 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:17.016470+0000 2021-05-26T16:41:17.019 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.020 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.020 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.020 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.020 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.021 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.021 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.021 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.021 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.021 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.022 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.022 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.015+0000 7fd29931a700 1 Processor -- start 2021-05-26T16:41:17.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.015+0000 7fd29931a700 1 -- start start 2021-05-26T16:41:17.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.015+0000 7fd29931a700 10 monclient: init 2021-05-26T16:41:17.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 10 monclient: _add_conns ranks=[5,2,1,3,8,6,0,7,4] 2021-05-26T16:41:17.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 10 monclient(hunting): picked mon.noname-h con 0x7fd29412cbd0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:17.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 10 monclient(hunting): picked mon.noname-b con 0x7fd294099a30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:17.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 10 monclient(hunting): picked mon.noname-f con 0x7fd294099eb0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:17.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd294046600 con 0x7fd294099eb0 2021-05-26T16:41:17.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29409b5e0 con 0x7fd294099a30 2021-05-26T16:41:17.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29412d8f0 con 0x7fd29412cbd0 2021-05-26T16:41:17.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd29931a700 10 monclient(hunting): authenticate will time out at 834.648104s 2021-05-26T16:41:17.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd2937fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fd294099a30 0x7fd294131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53402/0 (socket says 172.21.15.3:53402) 2021-05-26T16:41:17.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.016+0000 7fd2937fe700 1 -- 172.21.15.3:0/2838121022 learned_addr learned my addr 172.21.15.3:0/2838121022 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd2937fe700 1 -- 172.21.15.3:0/2838121022 >> v1:172.21.15.3:6790/0 conn(0x7fd294099a30 legacy=0x7fd294131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084687956 0 0) 0x7fd29409b5e0 con 0x7fd294099a30 2021-05-26T16:41:17.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient(hunting): my global_id is 4439 2021-05-26T16:41:17.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd278003270 con 0x7fd294099a30 2021-05-26T16:41:17.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd293fff700 1 -- 172.21.15.3:0/2838121022 >> v1:172.21.15.137:6791/0 conn(0x7fd29412cbd0 legacy=0x7fd29412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd298b19700 1 -- 172.21.15.3:0/2838121022 >> v1:172.21.15.137:6789/0 conn(0x7fd294099eb0 legacy=0x7fd294135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1984895996 0 0) 0x7fd278003270 con 0x7fd294099a30 2021-05-26T16:41:17.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 >> v1:172.21.15.137:6791/0 conn(0x7fd29412cbd0 legacy=0x7fd29412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 >> v1:172.21.15.137:6789/0 conn(0x7fd294099eb0 legacy=0x7fd294135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 monclient: found mon.noname-b 2021-05-26T16:41:17.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:17.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29409c2b0 con 0x7fd294099a30 2021-05-26T16:41:17.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd280001a60 con 0x7fd294099a30 2021-05-26T16:41:17.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd29931a700 5 monclient: authenticate success, global_id 4439 2021-05-26T16:41:17.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd29931a700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:17.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:17.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd292ffd700 10 monclient: dump: 2021-05-26T16:41:17.040 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.041 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.041 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.041 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.041 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.041 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.042 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.042 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.042 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.042 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.042 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.043 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.043 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.043 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.043 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.043 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.018+0000 7fd29931a700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:17.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd280001d70 con 0x7fd294099a30 2021-05-26T16:41:17.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd292ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd292ffd700 1 -- 172.21.15.3:0/2838121022 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd280004930 con 0x7fd294099a30 2021-05-26T16:41:17.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:17.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 4 set_mon_vals no callback set 2021-05-26T16:41:17.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd292ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd292ffd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:17.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd292ffd700 10 monclient: dump: 2021-05-26T16:41:17.046 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.046 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.046 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.046 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.046 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.047 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.047 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.047 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.047 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.047 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.048 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.048 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.048 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.048 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.048 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.049 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 10 monclient: shutdown 2021-05-26T16:41:17.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 1 -- 172.21.15.3:0/2838121022 >> v1:172.21.15.3:6790/0 conn(0x7fd294099a30 legacy=0x7fd294131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 1 -- 172.21.15.3:0/2838121022 shutdown_connections 2021-05-26T16:41:17.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 1 -- 172.21.15.3:0/2838121022 >> 172.21.15.3:0/2838121022 conn(0x7fd2940a00c0 msgr2=0x7fd2940a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 1 -- 172.21.15.3:0/2838121022 shutdown_connections 2021-05-26T16:41:17.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.019+0000 7fd29931a700 1 -- 172.21.15.3:0/2838121022 wait complete. 2021-05-26T16:41:17.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient: monmap: 2021-05-26T16:41:17.051 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.051 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:17.051 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:17.051 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:17.052 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.052 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.052 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.052 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.052 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.053 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.053 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.053 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.053 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.053 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.054 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.054 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 1 Processor -- start 2021-05-26T16:41:17.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 1 -- start start 2021-05-26T16:41:17.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient: init 2021-05-26T16:41:17.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient: _add_conns ranks=[7,0,5,3,8,6,4,2,1] 2021-05-26T16:41:17.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient(hunting): picked mon.noname-i con 0x7fd294099a30 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:17.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient(hunting): picked mon.noname-a con 0x7fd294099eb0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:17.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient(hunting): picked mon.noname-h con 0x7fd29412cbd0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:17.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29409bd30 con 0x7fd294099eb0 2021-05-26T16:41:17.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd294119c40 con 0x7fd29412cbd0 2021-05-26T16:41:17.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd294119ee0 con 0x7fd294099a30 2021-05-26T16:41:17.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.020+0000 7fd29931a700 10 monclient(hunting): authenticate will time out at 834.652999s 2021-05-26T16:41:17.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.021+0000 7fd2937fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd294099eb0 0x7fd294140dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51366/0 (socket says 172.21.15.3:51366) 2021-05-26T16:41:17.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.021+0000 7fd2937fe700 1 -- 172.21.15.3:0/407040756 learned_addr learned my addr 172.21.15.3:0/407040756 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd2937fe700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.3:6789/0 conn(0x7fd294099eb0 legacy=0x7fd294140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd293fff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6792/0 conn(0x7fd294099a30 legacy=0x7fd294129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd298b19700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6791/0 conn(0x7fd29412cbd0 legacy=0x7fd2941444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768269055 0 0) 0x7fd29409bd30 con 0x7fd294099eb0 2021-05-26T16:41:17.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): my global_id is 4491 2021-05-26T16:41:17.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd274003270 con 0x7fd294099eb0 2021-05-26T16:41:17.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170450562 0 0) 0x7fd294119ee0 con 0x7fd294099a30 2021-05-26T16:41:17.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): my global_id is 4354 2021-05-26T16:41:17.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd29409bd30 con 0x7fd294099a30 2021-05-26T16:41:17.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 389209833 0 0) 0x7fd274003270 con 0x7fd294099eb0 2021-05-26T16:41:17.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd294119ee0 con 0x7fd294099eb0 2021-05-26T16:41:17.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd280004870 con 0x7fd294099eb0 2021-05-26T16:41:17.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:17.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): dump: 2021-05-26T16:41:17.061 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.062 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.062 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.062 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.062 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.063 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.063 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.063 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.063 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.063 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.064 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.064 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.064 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.064 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.065 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.065 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:17.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016658956 0 0) 0x7fd294119c40 con 0x7fd29412cbd0 2021-05-26T16:41:17.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient(hunting): my global_id is 4478 2021-05-26T16:41:17.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd274003270 con 0x7fd29412cbd0 2021-05-26T16:41:17.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 954840037 0 0) 0x7fd294119ee0 con 0x7fd294099eb0 2021-05-26T16:41:17.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6792/0 conn(0x7fd294099a30 legacy=0x7fd294129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6791/0 conn(0x7fd29412cbd0 legacy=0x7fd2941444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 monclient: found mon.a 2021-05-26T16:41:17.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:17.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd294117d90 con 0x7fd294099eb0 2021-05-26T16:41:17.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd29931a700 5 monclient: authenticate success, global_id 4491 2021-05-26T16:41:17.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd284001c40 con 0x7fd294099a30 2021-05-26T16:41:17.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd27ffff700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:41:17.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd29931a700 10 monclient: _renew_subs 2021-05-26T16:41:17.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd29931a700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:17.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.023+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29412dfb0 con 0x7fd294099eb0 2021-05-26T16:41:17.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd29931a700 10 monclient: _renew_subs 2021-05-26T16:41:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd29931a700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:41:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd294117790 con 0x7fd294099eb0 2021-05-26T16:41:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd280001a70 con 0x7fd294099eb0 2021-05-26T16:41:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd280005260 con 0x7fd294099eb0 2021-05-26T16:41:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd2927fc700 4 set_mon_vals no callback set 2021-05-26T16:41:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 10 monclient: dump: 2021-05-26T16:41:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.074 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.074 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.074 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.074 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.074 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.075 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fd28000e7d0 con 0x7fd294099eb0 2021-05-26T16:41:17.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd29931a700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd26c0065a0 con 0x7fd26c002840 2021-05-26T16:41:17.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.024+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 3941+0+0 (unknown 1804037707 0 0) 0x7fd28003dc00 con 0x7fd294099eb0 2021-05-26T16:41:17.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.025+0000 7fd298b19700 10 monclient: get_auth_request con 0x7fd274032820 auth_method 0 2021-05-26T16:41:17.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd293fff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6789/0 conn(0x7fd26c002840 legacy=0x7fd26c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158902897 0 0) 0x7fd26c0065a0 con 0x7fd26c002840 2021-05-26T16:41:17.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 10 monclient(hunting): my global_id is 4375 2021-05-26T16:41:17.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd294119ee0 con 0x7fd26c002840 2021-05-26T16:41:17.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2490104894 0 0) 0x7fd294119ee0 con 0x7fd26c002840 2021-05-26T16:41:17.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd26c0065a0 con 0x7fd26c002840 2021-05-26T16:41:17.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd284002660 con 0x7fd26c002840 2021-05-26T16:41:17.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:17.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.027+0000 7fd27ffff700 10 monclient: dump: 2021-05-26T16:41:17.078 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.079 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.079 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.079 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.079 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.079 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.080 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.080 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.080 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.080 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.080 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.081 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.081 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.081 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.081 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.081 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.028+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 347231354 0 0) 0x7fd26c0065a0 con 0x7fd26c002840 2021-05-26T16:41:17.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.028+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd26c009e40 con 0x7fd26c002840 2021-05-26T16:41:17.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.028+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fd284002c30 con 0x7fd26c002840 2021-05-26T16:41:17.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.028+0000 7fd27ffff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.028+0000 7fd27ffff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:17.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.028+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6789/0 conn(0x7fd26c002840 legacy=0x7fd26c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.028+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6789/0 conn(0x7fd26c002840 legacy=0x7fd26c004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.035+0000 7fd29931a700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:17.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.035+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd26c007510 con 0x7fd26c0068b0 2021-05-26T16:41:17.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.037+0000 7fd293fff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6789/0 conn(0x7fd26c0068b0 legacy=0x7fd26c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.037+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134132132 0 0) 0x7fd26c007510 con 0x7fd26c0068b0 2021-05-26T16:41:17.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.037+0000 7fd27ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.037+0000 7fd27ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.037+0000 7fd27ffff700 10 monclient(hunting): my global_id is 4384 2021-05-26T16:41:17.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.037+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c0065a0 con 0x7fd26c0068b0 2021-05-26T16:41:17.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2278244155 0 0) 0x7fd26c0065a0 con 0x7fd26c0068b0 2021-05-26T16:41:17.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd26c007510 con 0x7fd26c0068b0 2021-05-26T16:41:17.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd284005a40 con 0x7fd26c0068b0 2021-05-26T16:41:17.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:17.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 10 monclient: dump: 2021-05-26T16:41:17.088 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.089 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.089 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.089 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.089 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.089 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.090 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.090 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.090 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.090 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.090 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.091 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.091 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.091 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.091 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.092 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2877361412 0 0) 0x7fd26c007510 con 0x7fd26c0068b0 2021-05-26T16:41:17.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 --> v1:172.21.15.137:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd26c008770 con 0x7fd26c0068b0 2021-05-26T16:41:17.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 1330633446) 0x7fd284005ee0 con 0x7fd26c0068b0 2021-05-26T16:41:17.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:17.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:17.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6789/0 conn(0x7fd26c0068b0 legacy=0x7fd26c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.038+0000 7fd27ffff700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6789/0 conn(0x7fd26c0068b0 legacy=0x7fd26c006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.093 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 25, 2021-05-26T16:41:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:17.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.137:6812/30003 conn(0x7fd274032820 legacy=0x7fd274034ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 10 monclient: shutdown 2021-05-26T16:41:17.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 >> v1:172.21.15.3:6789/0 conn(0x7fd294099eb0 legacy=0x7fd294140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd298b19700 1 -- 172.21.15.3:0/407040756 reap_dead start 2021-05-26T16:41:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd298b19700 1 -- 172.21.15.3:0/407040756 reap_dead start 2021-05-26T16:41:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 shutdown_connections 2021-05-26T16:41:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 >> 172.21.15.3:0/407040756 conn(0x7fd2940a00c0 msgr2=0x7fd29409e110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 shutdown_connections 2021-05-26T16:41:17.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.039+0000 7fd29931a700 1 -- 172.21.15.3:0/407040756 wait complete. 2021-05-26T16:41:17.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2021-05-26T16:41:17.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.266+0000 7fce0d794700 10 monclient: get_monmap_and_config 2021-05-26T16:41:17.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.266+0000 7fce0d794700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.266+0000 7fce0d794700 10 monclient: monmap: 2021-05-26T16:41:17.270 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.271 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.271 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:17.267884+0000 2021-05-26T16:41:17.271 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:17.267884+0000 2021-05-26T16:41:17.271 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.271 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.272 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.272 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.272 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.272 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.273 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.273 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.273 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.273 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.273 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.274 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.266+0000 7fce0d794700 1 Processor -- start 2021-05-26T16:41:17.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.266+0000 7fce0d794700 1 -- start start 2021-05-26T16:41:17.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.266+0000 7fce0d794700 10 monclient: init 2021-05-26T16:41:17.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 10 monclient: _add_conns ranks=[1,4,0,7,6,8,5,3,2] 2021-05-26T16:41:17.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 10 monclient(hunting): picked mon.noname-f con 0x7fce08064a20 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:17.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 10 monclient(hunting): picked mon.noname-c con 0x7fce08063e30 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:17.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 10 monclient(hunting): picked mon.noname-a con 0x7fce080642e0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:17.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce08059750 con 0x7fce080642e0 2021-05-26T16:41:17.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce08064e00 con 0x7fce08064a20 2021-05-26T16:41:17.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0809c770 con 0x7fce08063e30 2021-05-26T16:41:17.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce0d794700 10 monclient(hunting): authenticate will time out at 834.899406s 2021-05-26T16:41:17.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce077fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fce080642e0 0x7fce081357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51378/0 (socket says 172.21.15.3:51378) 2021-05-26T16:41:17.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce067fc700 1 --1- 172.21.15.3:0/3721312151 >> v1:172.21.15.3:6791/0 conn(0x7fce08063e30 0x7fce08132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36892/0 (socket says 172.21.15.3:36892) 2021-05-26T16:41:17.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.267+0000 7fce077fe700 1 -- 172.21.15.3:0/3721312151 learned_addr learned my addr 172.21.15.3:0/3721312151 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce067fc700 1 -- 172.21.15.3:0/3721312151 >> v1:172.21.15.3:6791/0 conn(0x7fce08063e30 legacy=0x7fce08132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce077fe700 1 -- 172.21.15.3:0/3721312151 >> v1:172.21.15.3:6789/0 conn(0x7fce080642e0 legacy=0x7fce081357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce06ffd700 1 -- 172.21.15.3:0/3721312151 >> v1:172.21.15.137:6789/0 conn(0x7fce08064a20 legacy=0x7fce08099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242719583 0 0) 0x7fce08059750 con 0x7fce080642e0 2021-05-26T16:41:17.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 10 monclient(hunting): my global_id is 4500 2021-05-26T16:41:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf4003270 con 0x7fce080642e0 2021-05-26T16:41:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515653000 0 0) 0x7fce0809c770 con 0x7fce08063e30 2021-05-26T16:41:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 10 monclient(hunting): my global_id is 4450 2021-05-26T16:41:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.269+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce08059750 con 0x7fce08063e30 2021-05-26T16:41:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659030987 0 0) 0x7fcdf4003270 con 0x7fce080642e0 2021-05-26T16:41:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 >> v1:172.21.15.3:6791/0 conn(0x7fce08063e30 legacy=0x7fce08132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 >> v1:172.21.15.137:6789/0 conn(0x7fce08064a20 legacy=0x7fce08099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 monclient: found mon.noname-a 2021-05-26T16:41:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce080977a0 con 0x7fce080642e0 2021-05-26T16:41:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 5 monclient: authenticate success, global_id 4500 2021-05-26T16:41:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdf8001de0 con 0x7fce080642e0 2021-05-26T16:41:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: dump: 2021-05-26T16:41:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.292 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce077fe700 1 --1- 172.21.15.3:0/3721312151 >> v1:172.21.15.3:6789/0 conn(0x7fce080642e0 0x7fce081357b0 :-1 s=OPENED pgs=91 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7fcdf8004cb0 mon_map magic: 0 v1 2021-05-26T16:41:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcdf80020f0 con 0x7fce080642e0 2021-05-26T16:41:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 4 set_mon_vals no callback set 2021-05-26T16:41:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 10 monclient: shutdown 2021-05-26T16:41:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 1 -- 172.21.15.3:0/3721312151 >> v1:172.21.15.3:6789/0 conn(0x7fce080642e0 legacy=0x7fce081357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 1 -- 172.21.15.3:0/3721312151 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdf8004cb0 con 0x7fce080642e0 2021-05-26T16:41:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce05ffb700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:41:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 1 -- 172.21.15.3:0/3721312151 shutdown_connections 2021-05-26T16:41:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 1 -- 172.21.15.3:0/3721312151 >> 172.21.15.3:0/3721312151 conn(0x7fce080a0db0 msgr2=0x7fce0809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 1 -- 172.21.15.3:0/3721312151 shutdown_connections 2021-05-26T16:41:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.270+0000 7fce0d794700 1 -- 172.21.15.3:0/3721312151 wait complete. 2021-05-26T16:41:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.271+0000 7fce0d794700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.271+0000 7fce0d794700 10 monclient: monmap: 2021-05-26T16:41:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.299 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.299 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.299 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.299 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.271+0000 7fce0d794700 1 Processor -- start 2021-05-26T16:41:17.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.271+0000 7fce0d794700 1 -- start start 2021-05-26T16:41:17.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient: init 2021-05-26T16:41:17.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient: _add_conns ranks=[8,6,1,5,2,3,7,0,4] 2021-05-26T16:41:17.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient(hunting): picked mon.noname-e con 0x7fce08063e30 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:17.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient(hunting): picked mon.noname-d con 0x7fce080642e0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:17.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient(hunting): picked mon.noname-f con 0x7fce08064a20 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:17.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce08093da0 con 0x7fce08064a20 2021-05-26T16:41:17.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce08116c10 con 0x7fce080642e0 2021-05-26T16:41:17.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce08116eb0 con 0x7fce08063e30 2021-05-26T16:41:17.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce0d794700 10 monclient(hunting): authenticate will time out at 834.904459s 2021-05-26T16:41:17.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce06ffd700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fce08063e30 0x7fce08092f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52462/0 (socket says 172.21.15.3:52462) 2021-05-26T16:41:17.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.272+0000 7fce06ffd700 1 -- 172.21.15.3:0/1765716573 learned_addr learned my addr 172.21.15.3:0/1765716573 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.274+0000 7fce06ffd700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.3:6793/0 conn(0x7fce08063e30 legacy=0x7fce08092f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.274+0000 7fce067fc700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.3:6792/0 conn(0x7fce080642e0 legacy=0x7fce08093690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.274+0000 7fce077fe700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6789/0 conn(0x7fce08064a20 legacy=0x7fce08144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.286+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927847580 0 0) 0x7fce08116eb0 con 0x7fce08063e30 2021-05-26T16:41:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.286+0000 7fcdeeffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.286+0000 7fcdeeffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.286+0000 7fcdeeffd700 10 monclient(hunting): my global_id is 4445 2021-05-26T16:41:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.286+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde8003270 con 0x7fce08063e30 2021-05-26T16:41:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1847977732 0 0) 0x7fcde8003270 con 0x7fce08063e30 2021-05-26T16:41:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fce08116eb0 con 0x7fce08063e30 2021-05-26T16:41:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdf0001d60 con 0x7fce08063e30 2021-05-26T16:41:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 10 monclient(hunting): dump: 2021-05-26T16:41:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.311 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.311 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.311 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.311 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.312 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.312 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.312 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.312 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.313 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3476025854 0 0) 0x7fce08116eb0 con 0x7fce08063e30 2021-05-26T16:41:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.3:6792/0 conn(0x7fce080642e0 legacy=0x7fce08093690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6789/0 conn(0x7fce08064a20 legacy=0x7fce08144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 monclient: found mon.e 2021-05-26T16:41:17.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08096140 con 0x7fce08063e30 2021-05-26T16:41:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.287+0000 7fcdeeffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce0d794700 5 monclient: authenticate success, global_id 4445 2021-05-26T16:41:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce0d794700 10 monclient: _renew_subs 2021-05-26T16:41:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce0d794700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce080957b0 con 0x7fce08063e30 2021-05-26T16:41:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce0d794700 10 monclient: _renew_subs 2021-05-26T16:41:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce0d794700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fce08117430 con 0x7fce08063e30 2021-05-26T16:41:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcdf0002390 con 0x7fce08063e30 2021-05-26T16:41:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fcdeeffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdf0002840 con 0x7fce08063e30 2021-05-26T16:41:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fcdeeffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fce057fa700 4 set_mon_vals no callback set 2021-05-26T16:41:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fcdeeffd700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.289+0000 7fcdeeffd700 10 monclient: dump: 2021-05-26T16:41:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.321 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.321 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.321 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.321 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.322 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.290+0000 7fce0d794700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.290+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fcde00065a0 con 0x7fcde0002840 2021-05-26T16:41:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.290+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fcdf0002a50 con 0x7fce08063e30 2021-05-26T16:41:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.290+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 3941+0+0 (unknown 1019984006 0 0) 0x7fcdf003d9d0 con 0x7fce08063e30 2021-05-26T16:41:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.291+0000 7fce077fe700 10 monclient: get_auth_request con 0x7fcde8032990 auth_method 0 2021-05-26T16:41:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fce067fc700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6790/0 conn(0x7fcde0002840 legacy=0x7fcde0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097051125 0 0) 0x7fcde00065a0 con 0x7fcde0002840 2021-05-26T16:41:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 10 monclient(hunting): my global_id is 4413 2021-05-26T16:41:17.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce08116eb0 con 0x7fcde0002840 2021-05-26T16:41:17.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1530628615 0 0) 0x7fce08116eb0 con 0x7fcde0002840 2021-05-26T16:41:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcde00065a0 con 0x7fcde0002840 2021-05-26T16:41:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdfc001d30 con 0x7fcde0002840 2021-05-26T16:41:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.293+0000 7fcdeeffd700 10 monclient: dump: 2021-05-26T16:41:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.329 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.329 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.329 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.294+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1438160298 0 0) 0x7fcde00065a0 con 0x7fcde0002840 2021-05-26T16:41:17.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.294+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcde0009e40 con 0x7fcde0002840 2021-05-26T16:41:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.296+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fcdfc0046f0 con 0x7fcde0002840 2021-05-26T16:41:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.296+0000 7fcdeeffd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.296+0000 7fcdeeffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.296+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6790/0 conn(0x7fcde0002840 legacy=0x7fcde0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.296+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6790/0 conn(0x7fcde0002840 legacy=0x7fcde0004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.306+0000 7fce0d794700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.306+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fcde0007510 con 0x7fcde00068b0 2021-05-26T16:41:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fce067fc700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6790/0 conn(0x7fcde00068b0 legacy=0x7fcde0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167747675 0 0) 0x7fcde0007510 con 0x7fcde00068b0 2021-05-26T16:41:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 10 monclient(hunting): my global_id is 4422 2021-05-26T16:41:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde00065a0 con 0x7fcde00068b0 2021-05-26T16:41:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2249810855 0 0) 0x7fcde00065a0 con 0x7fcde00068b0 2021-05-26T16:41:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcde0007510 con 0x7fcde00068b0 2021-05-26T16:41:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcdfc004ef0 con 0x7fcde00068b0 2021-05-26T16:41:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 10 monclient: dump: 2021-05-26T16:41:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.337 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.337 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.337 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.337 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.337 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.338 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.338 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.338 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.338 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.339 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 589538672 0 0) 0x7fcde0007510 con 0x7fcde00068b0 2021-05-26T16:41:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.309+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 --> v1:172.21.15.137:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcde0008770 con 0x7fcde00068b0 2021-05-26T16:41:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 3284111882) 0x7fcdfc007290 con 0x7fcde00068b0 2021-05-26T16:41:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fcdeeffd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fcdeeffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6790/0 conn(0x7fcde00068b0 legacy=0x7fcde0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fcdeeffd700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6790/0 conn(0x7fcde00068b0 legacy=0x7fcde0006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.341 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 25, 2021-05-26T16:41:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:17.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.137:6812/30003 conn(0x7fcde8032990 legacy=0x7fcde8034e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fce0d794700 10 monclient: shutdown 2021-05-26T16:41:17.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fce0d794700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 >> v1:172.21.15.3:6793/0 conn(0x7fce08063e30 legacy=0x7fce08092f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.310+0000 7fce077fe700 1 -- 172.21.15.3:0/1765716573 reap_dead start 2021-05-26T16:41:17.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.311+0000 7fce077fe700 1 -- 172.21.15.3:0/1765716573 reap_dead start 2021-05-26T16:41:17.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.311+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 shutdown_connections 2021-05-26T16:41:17.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.311+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 >> 172.21.15.3:0/1765716573 conn(0x7fce080a0db0 msgr2=0x7fce08098710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.311+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 shutdown_connections 2021-05-26T16:41:17.401 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.311+0000 7fce0d794700 1 -- 172.21.15.3:0/1765716573 wait complete. 2021-05-26T16:41:17.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2021-05-26T16:41:17.402 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33053]: starting. 2021-05-26T16:41:17.402 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33053]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33052 2021-05-26T16:41:17.403 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33053]: created object 0... 2021-05-26T16:41:17.403 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33053]: created object 25... 2021-05-26T16:41:17.403 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33053]: created object 49... 2021-05-26T16:41:17.403 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33053]: finishing. 2021-05-26T16:41:17.403 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33053]: shutting down. 2021-05-26T16:41:17.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.515+0000 7fc79b59e700 10 monclient: get_monmap_and_config 2021-05-26T16:41:17.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.515+0000 7fc79b59e700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.515+0000 7fc79b59e700 10 monclient: monmap: 2021-05-26T16:41:17.519 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.520 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.520 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:17.517308+0000 2021-05-26T16:41:17.520 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:17.517308+0000 2021-05-26T16:41:17.520 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.523 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 1 Processor -- start 2021-05-26T16:41:17.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 1 -- start start 2021-05-26T16:41:17.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 10 monclient: init 2021-05-26T16:41:17.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 10 monclient: _add_conns ranks=[2,4,8,0,6,7,1,5,3] 2021-05-26T16:41:17.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 10 monclient(hunting): picked mon.noname-b con 0x7fc79c12cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:17.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 10 monclient(hunting): picked mon.noname-c con 0x7fc79c099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:17.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 10 monclient(hunting): picked mon.noname-e con 0x7fc79c099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:17.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.516+0000 7fc79b59e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c046600 con 0x7fc79c12cbd0 2021-05-26T16:41:17.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc79b59e700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c09b5e0 con 0x7fc79c099a30 2021-05-26T16:41:17.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc79b59e700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c12d8f0 con 0x7fc79c099eb0 2021-05-26T16:41:17.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc79b59e700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc79b59e700 10 monclient(hunting): authenticate will time out at 835.149045s 2021-05-26T16:41:17.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc799d9b700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fc79c099a30 0x7fc79c131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:36906/0 (socket says 172.21.15.3:36906) 2021-05-26T16:41:17.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc799d9b700 1 -- 172.21.15.3:0/1217585021 learned_addr learned my addr 172.21.15.3:0/1217585021 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc79ad9d700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fc79c099eb0 0x7fc79c135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52478/0 (socket says 172.21.15.3:52478) 2021-05-26T16:41:17.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.517+0000 7fc79a59c700 1 --1- 172.21.15.3:0/1217585021 >> v1:172.21.15.3:6790/0 conn(0x7fc79c12cbd0 0x7fc79c12d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53436/0 (socket says 172.21.15.3:53436) 2021-05-26T16:41:17.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc799d9b700 1 -- 172.21.15.3:0/1217585021 >> v1:172.21.15.3:6791/0 conn(0x7fc79c099a30 legacy=0x7fc79c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79a59c700 1 -- 172.21.15.3:0/1217585021 >> v1:172.21.15.3:6790/0 conn(0x7fc79c12cbd0 legacy=0x7fc79c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79ad9d700 1 -- 172.21.15.3:0/1217585021 >> v1:172.21.15.3:6793/0 conn(0x7fc79c099eb0 legacy=0x7fc79c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150230335 0 0) 0x7fc79c12d8f0 con 0x7fc79c099eb0 2021-05-26T16:41:17.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): my global_id is 4454 2021-05-26T16:41:17.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc780003270 con 0x7fc79c099eb0 2021-05-26T16:41:17.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288734879 0 0) 0x7fc79c046600 con 0x7fc79c12cbd0 2021-05-26T16:41:17.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): my global_id is 4448 2021-05-26T16:41:17.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc79c12d8f0 con 0x7fc79c12cbd0 2021-05-26T16:41:17.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991548137 0 0) 0x7fc79c09b5e0 con 0x7fc79c099a30 2021-05-26T16:41:17.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient(hunting): my global_id is 4459 2021-05-26T16:41:17.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc79c046600 con 0x7fc79c099a30 2021-05-26T16:41:17.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428860182 0 0) 0x7fc780003270 con 0x7fc79c099eb0 2021-05-26T16:41:17.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 >> v1:172.21.15.3:6791/0 conn(0x7fc79c099a30 legacy=0x7fc79c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 >> v1:172.21.15.3:6790/0 conn(0x7fc79c12cbd0 legacy=0x7fc79c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 monclient: found mon.noname-e 2021-05-26T16:41:17.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c09c2b0 con 0x7fc79c099eb0 2021-05-26T16:41:17.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc78c001de0 con 0x7fc79c099eb0 2021-05-26T16:41:17.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:17.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79959a700 10 monclient: dump: 2021-05-26T16:41:17.550 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.550 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.550 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.551 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.551 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.551 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.551 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.554 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79b59e700 5 monclient: authenticate success, global_id 4454 2021-05-26T16:41:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.519+0000 7fc79b59e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc78c0020f0 con 0x7fc79c099eb0 2021-05-26T16:41:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79959a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79959a700 1 -- 172.21.15.3:0/1217585021 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc78c004bf0 con 0x7fc79c099eb0 2021-05-26T16:41:17.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:17.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 4 set_mon_vals no callback set 2021-05-26T16:41:17.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79959a700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79959a700 10 monclient: dump: 2021-05-26T16:41:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.559 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.559 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.559 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.559 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.559 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 10 monclient: shutdown 2021-05-26T16:41:17.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 1 -- 172.21.15.3:0/1217585021 >> v1:172.21.15.3:6793/0 conn(0x7fc79c099eb0 legacy=0x7fc79c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 1 -- 172.21.15.3:0/1217585021 shutdown_connections 2021-05-26T16:41:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 1 -- 172.21.15.3:0/1217585021 >> 172.21.15.3:0/1217585021 conn(0x7fc79c0a00c0 msgr2=0x7fc79c0a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 1 -- 172.21.15.3:0/1217585021 shutdown_connections 2021-05-26T16:41:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.520+0000 7fc79b59e700 1 -- 172.21.15.3:0/1217585021 wait complete. 2021-05-26T16:41:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient: monmap: 2021-05-26T16:41:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.565 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.565 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.565 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 1 Processor -- start 2021-05-26T16:41:17.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 1 -- start start 2021-05-26T16:41:17.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient: init 2021-05-26T16:41:17.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient: _add_conns ranks=[7,3,6,8,1,2,4,5,0] 2021-05-26T16:41:17.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient(hunting): picked mon.noname-i con 0x7fc79c099a30 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:17.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient(hunting): picked mon.noname-g con 0x7fc79c099eb0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:17.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient(hunting): picked mon.noname-d con 0x7fc79c12cbd0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:17.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c1184a0 con 0x7fc79c099eb0 2021-05-26T16:41:17.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c118740 con 0x7fc79c12cbd0 2021-05-26T16:41:17.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c1189e0 con 0x7fc79c099a30 2021-05-26T16:41:17.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.521+0000 7fc79b59e700 10 monclient(hunting): authenticate will time out at 835.153980s 2021-05-26T16:41:17.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.522+0000 7fc79ad9d700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fc79c12cbd0 0x7fc79c1444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56804/0 (socket says 172.21.15.3:56804) 2021-05-26T16:41:17.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.522+0000 7fc79ad9d700 1 -- 172.21.15.3:0/1152120847 learned_addr learned my addr 172.21.15.3:0/1152120847 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79ad9d700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.3:6792/0 conn(0x7fc79c12cbd0 legacy=0x7fc79c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000993462 0 0) 0x7fc79c118740 con 0x7fc79c12cbd0 2021-05-26T16:41:17.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): my global_id is 4425 2021-05-26T16:41:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc778003270 con 0x7fc79c12cbd0 2021-05-26T16:41:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc799d9b700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6790/0 conn(0x7fc79c099eb0 legacy=0x7fc79c095950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79a59c700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6792/0 conn(0x7fc79c099a30 legacy=0x7fc79c095240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1371909544 0 0) 0x7fc778003270 con 0x7fc79c12cbd0 2021-05-26T16:41:17.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc79c118740 con 0x7fc79c12cbd0 2021-05-26T16:41:17.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc78c004bf0 con 0x7fc79c12cbd0 2021-05-26T16:41:17.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:17.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:17.572 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.572 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.575 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.575 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.575 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.575 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.576 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:17.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765595888 0 0) 0x7fc79c1184a0 con 0x7fc79c099eb0 2021-05-26T16:41:17.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): my global_id is 4431 2021-05-26T16:41:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc778003270 con 0x7fc79c099eb0 2021-05-26T16:41:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300052460 0 0) 0x7fc79c1189e0 con 0x7fc79c099a30 2021-05-26T16:41:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient(hunting): my global_id is 4363 2021-05-26T16:41:17.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc79c1184a0 con 0x7fc79c099a30 2021-05-26T16:41:17.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3359747217 0 0) 0x7fc79c118740 con 0x7fc79c12cbd0 2021-05-26T16:41:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6792/0 conn(0x7fc79c099a30 legacy=0x7fc79c095240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6790/0 conn(0x7fc79c099eb0 legacy=0x7fc79c095950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 monclient: found mon.d 2021-05-26T16:41:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c129610 con 0x7fc79c12cbd0 2021-05-26T16:41:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc78a7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79b59e700 5 monclient: authenticate success, global_id 4425 2021-05-26T16:41:17.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79b59e700 10 monclient: _renew_subs 2021-05-26T16:41:17.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79b59e700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:17.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c116940 con 0x7fc79c12cbd0 2021-05-26T16:41:17.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79b59e700 10 monclient: _renew_subs 2021-05-26T16:41:17.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79b59e700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:17.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.524+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c12a370 con 0x7fc79c12cbd0 2021-05-26T16:41:17.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc78c0051a0 con 0x7fc79c12cbd0 2021-05-26T16:41:17.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc78c001900 con 0x7fc79c12cbd0 2021-05-26T16:41:17.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc798d99700 4 set_mon_vals no callback set 2021-05-26T16:41:17.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:17.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 10 monclient: dump: 2021-05-26T16:41:17.584 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.585 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.585 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.585 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.585 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.586 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.586 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.586 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.586 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.586 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.587 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.587 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.587 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.588 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.588 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.588 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fc78c00ea60 con 0x7fc79c12cbd0 2021-05-26T16:41:17.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 3941+0+0 (unknown 1019984006 0 0) 0x7fc78c03dfa0 con 0x7fc79c12cbd0 2021-05-26T16:41:17.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc79b59e700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.525+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc77c0065a0 con 0x7fc77c002840 2021-05-26T16:41:17.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.526+0000 7fc79a59c700 10 monclient: get_auth_request con 0x7fc778032a40 auth_method 0 2021-05-26T16:41:17.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc799d9b700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6791/0 conn(0x7fc77c002840 legacy=0x7fc77c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029293627 0 0) 0x7fc77c0065a0 con 0x7fc77c002840 2021-05-26T16:41:17.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 10 monclient(hunting): my global_id is 4487 2021-05-26T16:41:17.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc79c118740 con 0x7fc77c002840 2021-05-26T16:41:17.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3912422121 0 0) 0x7fc79c118740 con 0x7fc77c002840 2021-05-26T16:41:17.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc77c0065a0 con 0x7fc77c002840 2021-05-26T16:41:17.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc790001bd0 con 0x7fc77c002840 2021-05-26T16:41:17.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:17.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 10 monclient: dump: 2021-05-26T16:41:17.592 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.592 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.593 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.593 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.593 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.593 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.594 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.594 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.594 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.594 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.595 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.596 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.596 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.596 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.596 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.597 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3783088015 0 0) 0x7fc77c0065a0 con 0x7fc77c002840 2021-05-26T16:41:17.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.528+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc77c009e40 con 0x7fc77c002840 2021-05-26T16:41:17.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.529+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fc790005620 con 0x7fc77c002840 2021-05-26T16:41:17.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.529+0000 7fc78a7fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.529+0000 7fc78a7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:17.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.529+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6791/0 conn(0x7fc77c002840 legacy=0x7fc77c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.529+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6791/0 conn(0x7fc77c002840 legacy=0x7fc77c004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.535+0000 7fc79b59e700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:17.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.535+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc77c007510 con 0x7fc77c0068b0 2021-05-26T16:41:17.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc799d9b700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6791/0 conn(0x7fc77c0068b0 legacy=0x7fc77c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149106511 0 0) 0x7fc77c007510 con 0x7fc77c0068b0 2021-05-26T16:41:17.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 10 monclient(hunting): my global_id is 4496 2021-05-26T16:41:17.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc77c0065a0 con 0x7fc77c0068b0 2021-05-26T16:41:17.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2329245644 0 0) 0x7fc77c0065a0 con 0x7fc77c0068b0 2021-05-26T16:41:17.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc77c007510 con 0x7fc77c0068b0 2021-05-26T16:41:17.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc790004d70 con 0x7fc77c0068b0 2021-05-26T16:41:17.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:17.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.538+0000 7fc78a7fc700 10 monclient: dump: 2021-05-26T16:41:17.604 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.604 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.604 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.605 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.605 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.605 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.605 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.606 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.606 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.606 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.606 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.607 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.607 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.607 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.607 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.608 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 583510169 0 0) 0x7fc77c007510 con 0x7fc77c0068b0 2021-05-26T16:41:17.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 --> v1:172.21.15.137:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc77c008770 con 0x7fc77c0068b0 2021-05-26T16:41:17.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 133623717) 0x7fc790005180 con 0x7fc77c0068b0 2021-05-26T16:41:17.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc78a7fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:17.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc78a7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:17.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6791/0 conn(0x7fc77c0068b0 legacy=0x7fc77c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc78a7fc700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6791/0 conn(0x7fc77c0068b0 legacy=0x7fc77c006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.610 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:17.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:17.610 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:17.611 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:17.611 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:17.611 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:17.611 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:17.612 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:17.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:17.612 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:17.612 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:17.613 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:17.613 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:17.613 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:17.613 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:17.613 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.614 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 26, 2021-05-26T16:41:17.614 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.614 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:17.614 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:17.615 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.615 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.615 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.615 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.616 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.616 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.616 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.616 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.617 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.617 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.617 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:17.617 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:17.618 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.618 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.618 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.618 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.619 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.619 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.619 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.619 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.619 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.620 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.620 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:17.620 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:17.621 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:17.621 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:17.621 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:17.621 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:17.622 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.622 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.622 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:17.622 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:17.622 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:17.623 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:17.623 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:17.623 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.623 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:17.624 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.624 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.624 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.624 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.625 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.625 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.625 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.625 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.626 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.626 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.626 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:17.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.626 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:17.627 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.627 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:17.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:17.627 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.628 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.628 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.628 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.628 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:17.629 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.629 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.629 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.630 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.630 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.630 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.630 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:17.669 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:17.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.137:6812/30003 conn(0x7fc778032a40 legacy=0x7fc778034f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 10 monclient: shutdown 2021-05-26T16:41:17.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 >> v1:172.21.15.3:6792/0 conn(0x7fc79c12cbd0 legacy=0x7fc79c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79ad9d700 1 -- 172.21.15.3:0/1152120847 reap_dead start 2021-05-26T16:41:17.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79ad9d700 1 -- 172.21.15.3:0/1152120847 reap_dead start 2021-05-26T16:41:17.672 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 shutdown_connections 2021-05-26T16:41:17.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 >> 172.21.15.3:0/1152120847 conn(0x7fc79c0a00c0 msgr2=0x7fc79c12b280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 shutdown_connections 2021-05-26T16:41:17.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.539+0000 7fc79b59e700 1 -- 172.21.15.3:0/1152120847 wait complete. 2021-05-26T16:41:17.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2021-05-26T16:41:17.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.788+0000 7f448bc0b700 10 monclient: get_monmap_and_config 2021-05-26T16:41:17.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.788+0000 7f448bc0b700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.788+0000 7f448bc0b700 10 monclient: monmap: 2021-05-26T16:41:17.792 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.793 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.793 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:17.789915+0000 2021-05-26T16:41:17.793 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:17.789915+0000 2021-05-26T16:41:17.793 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.794 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.794 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.794 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.794 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.795 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.795 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.795 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.795 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.796 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.796 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.796 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.788+0000 7f448bc0b700 1 Processor -- start 2021-05-26T16:41:17.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 1 -- start start 2021-05-26T16:41:17.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient: init 2021-05-26T16:41:17.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient: _add_conns ranks=[8,1,2,7,6,0,3,5,4] 2021-05-26T16:41:17.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient(hunting): picked mon.noname-e con 0x7f4484064aa0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:17.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient(hunting): picked mon.noname-f con 0x7f4484099c40 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:17.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient(hunting): picked mon.noname-b con 0x7f448409a0c0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:17.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484059750 con 0x7f4484099c40 2021-05-26T16:41:17.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448409a530 con 0x7f448409a0c0 2021-05-26T16:41:17.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448409c4e0 con 0x7f4484064aa0 2021-05-26T16:41:17.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448bc0b700 10 monclient(hunting): authenticate will time out at 835.421512s 2021-05-26T16:41:17.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f44899a7700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f4484064aa0 0x7f4484063f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52492/0 (socket says 172.21.15.3:52492) 2021-05-26T16:41:17.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f448a1a8700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f448409a0c0 0x7f44841357a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53454/0 (socket says 172.21.15.3:53454) 2021-05-26T16:41:17.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.789+0000 7f44899a7700 1 -- 172.21.15.3:0/1869259845 learned_addr learned my addr 172.21.15.3:0/1869259845 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.791+0000 7f44899a7700 1 -- 172.21.15.3:0/1869259845 >> v1:172.21.15.3:6793/0 conn(0x7f4484064aa0 legacy=0x7f4484063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.791+0000 7f448a1a8700 1 -- 172.21.15.3:0/1869259845 >> v1:172.21.15.3:6790/0 conn(0x7f448409a0c0 legacy=0x7f44841357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44891a6700 1 -- 172.21.15.3:0/1869259845 >> v1:172.21.15.137:6789/0 conn(0x7f4484099c40 legacy=0x7f4484132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785005038 0 0) 0x7f448409c4e0 con 0x7f4484064aa0 2021-05-26T16:41:17.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): my global_id is 4463 2021-05-26T16:41:17.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c003270 con 0x7f4484064aa0 2021-05-26T16:41:17.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297891718 0 0) 0x7f44800017d0 con 0x7f448409a0c0 2021-05-26T16:41:17.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): my global_id is 4457 2021-05-26T16:41:17.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f448409c4e0 con 0x7f448409a0c0 2021-05-26T16:41:17.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817806138 0 0) 0x7f4484059750 con 0x7f4484099c40 2021-05-26T16:41:17.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient(hunting): my global_id is 4393 2021-05-26T16:41:17.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44800017d0 con 0x7f4484099c40 2021-05-26T16:41:17.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2189796272 0 0) 0x7f446c003270 con 0x7f4484064aa0 2021-05-26T16:41:17.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 >> v1:172.21.15.3:6790/0 conn(0x7f448409a0c0 legacy=0x7f44841357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 >> v1:172.21.15.137:6789/0 conn(0x7f4484099c40 legacy=0x7f4484132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 monclient: found mon.noname-e 2021-05-26T16:41:17.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448409c780 con 0x7f4484064aa0 2021-05-26T16:41:17.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4478001a60 con 0x7f4484064aa0 2021-05-26T16:41:17.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f448bc0b700 5 monclient: authenticate success, global_id 4463 2021-05-26T16:41:17.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:17.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: dump: 2021-05-26T16:41:17.819 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.819 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.819 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.820 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.820 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.820 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.820 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.821 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.821 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.821 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.821 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.821 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.822 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.822 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.822 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.822 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f448bc0b700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:17.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4478001d70 con 0x7f4484064aa0 2021-05-26T16:41:17.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 1 -- 172.21.15.3:0/1869259845 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4478004930 con 0x7f4484064aa0 2021-05-26T16:41:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f448bc0b700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f448bc0b700 4 set_mon_vals no callback set 2021-05-26T16:41:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:17.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.792+0000 7f44889a5700 10 monclient: dump: 2021-05-26T16:41:17.825 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.825 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.825 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.828 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 10 monclient: shutdown 2021-05-26T16:41:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 1 -- 172.21.15.3:0/1869259845 >> v1:172.21.15.3:6793/0 conn(0x7f4484064aa0 legacy=0x7f4484063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 1 -- 172.21.15.3:0/1869259845 shutdown_connections 2021-05-26T16:41:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 1 -- 172.21.15.3:0/1869259845 >> 172.21.15.3:0/1869259845 conn(0x7f448405e1e0 msgr2=0x7f448409cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 1 -- 172.21.15.3:0/1869259845 shutdown_connections 2021-05-26T16:41:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 1 -- 172.21.15.3:0/1869259845 wait complete. 2021-05-26T16:41:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 10 monclient: build_initial_monmap 2021-05-26T16:41:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.793+0000 7f448bc0b700 10 monclient: monmap: 2021-05-26T16:41:17.831 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:17.831 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:17.831 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:17.831 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:17.831 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:17.832 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.832 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:17.832 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:17.832 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:17.834 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:17.834 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 1 Processor -- start 2021-05-26T16:41:17.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 1 -- start start 2021-05-26T16:41:17.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient: init 2021-05-26T16:41:17.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:17.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient: _add_conns ranks=[8,5,0,4,1,7,2,3,6] 2021-05-26T16:41:17.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient(hunting): picked mon.noname-e con 0x7f4484099c40 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:17.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient(hunting): picked mon.noname-h con 0x7f448409a0c0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient(hunting): picked mon.noname-a con 0x7f4484117920 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484116a70 con 0x7f4484117920 2021-05-26T16:41:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484116d10 con 0x7f448409a0c0 2021-05-26T16:41:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484116fb0 con 0x7f4484099c40 2021-05-26T16:41:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f448bc0b700 10 monclient(hunting): authenticate will time out at 835.426579s 2021-05-26T16:41:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f44899a7700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f4484099c40 0x7f44841294e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:52496/0 (socket says 172.21.15.3:52496) 2021-05-26T16:41:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.794+0000 7f44899a7700 1 -- 172.21.15.3:0/1962437006 learned_addr learned my addr 172.21.15.3:0/1962437006 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f44899a7700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.3:6793/0 conn(0x7f4484099c40 legacy=0x7f44841294e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f448a1a8700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.3:6789/0 conn(0x7f4484117920 legacy=0x7f44841445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f44891a6700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6791/0 conn(0x7f448409a0c0 legacy=0x7f4484140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743639858 0 0) 0x7f4484116fb0 con 0x7f4484099c40 2021-05-26T16:41:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f4471ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f4471ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f4471ffb700 10 monclient(hunting): my global_id is 4472 2021-05-26T16:41:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4464003270 con 0x7f4484099c40 2021-05-26T16:41:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240482182 0 0) 0x7f4484116a70 con 0x7f4484117920 2021-05-26T16:41:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.796+0000 7f4471ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): my global_id is 4509 2021-05-26T16:41:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4484116fb0 con 0x7f4484117920 2021-05-26T16:41:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2574964971 0 0) 0x7f4464003270 con 0x7f4484099c40 2021-05-26T16:41:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4484116a70 con 0x7f4484099c40 2021-05-26T16:41:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4478004870 con 0x7f4484099c40 2021-05-26T16:41:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.845 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037985498 0 0) 0x7f4484116d10 con 0x7f448409a0c0 2021-05-26T16:41:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): my global_id is 4505 2021-05-26T16:41:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4464003270 con 0x7f448409a0c0 2021-05-26T16:41:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1878067868 0 0) 0x7f4484116fb0 con 0x7f4484117920 2021-05-26T16:41:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4484116d10 con 0x7f4484117920 2021-05-26T16:41:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4480001e40 con 0x7f4484117920 2021-05-26T16:41:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient(hunting): dump: 2021-05-26T16:41:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.852 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3342510366 0 0) 0x7f4484116a70 con 0x7f4484099c40 2021-05-26T16:41:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6791/0 conn(0x7f448409a0c0 legacy=0x7f4484140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.3:6789/0 conn(0x7f4484117920 legacy=0x7f44841445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 monclient: found mon.e 2021-05-26T16:41:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484129bf0 con 0x7f4484099c40 2021-05-26T16:41:17.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:17.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:17.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f448bc0b700 5 monclient: authenticate success, global_id 4472 2021-05-26T16:41:17.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f448bc0b700 10 monclient: _renew_subs 2021-05-26T16:41:17.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f448bc0b700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448412f290 con 0x7f4484099c40 2021-05-26T16:41:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4478001a70 con 0x7f4484099c40 2021-05-26T16:41:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4478005220 con 0x7f4484099c40 2021-05-26T16:41:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4471ffb700 10 monclient: dump: 2021-05-26T16:41:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.858 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.858 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.858 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.858 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.859 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.859 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.859 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.859 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.860 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f4473fff700 4 set_mon_vals no callback set 2021-05-26T16:41:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f448bc0b700 10 monclient: _renew_subs 2021-05-26T16:41:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f448bc0b700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.797+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f448412e890 con 0x7f4484099c40 2021-05-26T16:41:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.798+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f447800e790 con 0x7f4484099c40 2021-05-26T16:41:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.798+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 3941+0+0 (unknown 1019984006 0 0) 0x7f447803db20 con 0x7f4484099c40 2021-05-26T16:41:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.798+0000 7f448bc0b700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.798+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f448412fd70 con 0x7f448405e1e0 2021-05-26T16:41:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.798+0000 7f44891a6700 10 monclient: get_auth_request con 0x7f44640331f0 auth_method 0 2021-05-26T16:41:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.800+0000 7f448a1a8700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6792/0 conn(0x7f448405e1e0 legacy=0x7f4484058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420862097 0 0) 0x7f448412fd70 con 0x7f448405e1e0 2021-05-26T16:41:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient(hunting): my global_id is 4372 2021-05-26T16:41:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4484116a70 con 0x7f448405e1e0 2021-05-26T16:41:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3430433563 0 0) 0x7f4484116a70 con 0x7f448405e1e0 2021-05-26T16:41:17.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f448412fd70 con 0x7f448405e1e0 2021-05-26T16:41:17.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4480005120 con 0x7f448405e1e0 2021-05-26T16:41:17.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:41:17.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient: dump: 2021-05-26T16:41:17.865 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.865 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.865 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.866 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.866 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.866 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.866 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.866 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.867 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.867 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.867 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.867 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.868 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.868 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.868 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.868 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 735621005 0 0) 0x7f448412fd70 con 0x7f448405e1e0 2021-05-26T16:41:17.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f448409e870 con 0x7f448405e1e0 2021-05-26T16:41:17.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f4480005520 con 0x7f448405e1e0 2021-05-26T16:41:17.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:17.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:17.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6792/0 conn(0x7f448405e1e0 legacy=0x7f4484058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.801+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6792/0 conn(0x7f448405e1e0 legacy=0x7f4484058d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.808+0000 7f448bc0b700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:17.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.808+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f448406c030 con 0x7f4484094a60 2021-05-26T16:41:17.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.810+0000 7f448a1a8700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6792/0 conn(0x7f4484094a60 legacy=0x7f4484149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:17.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466464782 0 0) 0x7f448406c030 con 0x7f4484094a60 2021-05-26T16:41:17.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:17.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:17.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 10 monclient(hunting): my global_id is 4381 2021-05-26T16:41:17.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f448412fd70 con 0x7f4484094a60 2021-05-26T16:41:17.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 656221952 0 0) 0x7f448412fd70 con 0x7f4484094a60 2021-05-26T16:41:17.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f448406c030 con 0x7f4484094a60 2021-05-26T16:41:17.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4480005ce0 con 0x7f4484094a60 2021-05-26T16:41:17.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:17.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:41:17.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 10 monclient: dump: 2021-05-26T16:41:17.875 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:17.875 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:17.876 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.876 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:17.876 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:17.876 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:17.877 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:17.877 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:17.877 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:17.877 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:17.878 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:17.878 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:17.878 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:17.878 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:17.878 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:17.879 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:17.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 649925976 0 0) 0x7f448406c030 con 0x7f4484094a60 2021-05-26T16:41:17.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.811+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 --> v1:172.21.15.137:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f448412a6c0 con 0x7f4484094a60 2021-05-26T16:41:17.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 2649352339) 0x7f4480006120 con 0x7f4484094a60 2021-05-26T16:41:17.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f4471ffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:17.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f4471ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:17.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6792/0 conn(0x7f4484094a60 legacy=0x7f4484149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f4471ffb700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6792/0 conn(0x7f4484094a60 legacy=0x7f4484149d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:17.881 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 4, 2021-05-26T16:41:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:41:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:41:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:41:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:41:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 26, 2021-05-26T16:41:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": [ 2021-05-26T16:41:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:17.941 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:17.942 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.137:6812/30003 conn(0x7f44640331f0 legacy=0x7f44640356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 10 monclient: shutdown 2021-05-26T16:41:17.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:17.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 >> v1:172.21.15.3:6793/0 conn(0x7f4484099c40 legacy=0x7f44841294e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:17.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448a1a8700 1 -- 172.21.15.3:0/1962437006 reap_dead start 2021-05-26T16:41:17.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448a1a8700 1 -- 172.21.15.3:0/1962437006 reap_dead start 2021-05-26T16:41:17.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 shutdown_connections 2021-05-26T16:41:17.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 >> 172.21.15.3:0/1962437006 conn(0x7f4484064aa0 msgr2=0x7f448409f610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:17.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 shutdown_connections 2021-05-26T16:41:17.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:17.812+0000 7f448bc0b700 1 -- 172.21.15.3:0/1962437006 wait complete. 2021-05-26T16:41:17.946 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['i', 'e', 'a'] 2021-05-26T16:41:17.946 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2021-05-26T16:41:17.946 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2021-05-26T16:41:17.947 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2021-05-26T16:41:17.947 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2021-05-26T16:41:17.947 INFO:teuthology.orchestra.run:waiting for 300 2021-05-26T16:41:17.958 INFO:tasks.ceph.mon.i:Stopped 2021-05-26T16:41:17.958 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2021-05-26T16:41:17.959 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e store 2021-05-26T16:41:17.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e sync_force --yes-i-really-mean-it 2021-05-26T16:41:18.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.073+0000 7fe91f330700 10 monclient: get_monmap_and_config 2021-05-26T16:41:18.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.073+0000 7fe91f330700 10 monclient: build_initial_monmap 2021-05-26T16:41:18.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.073+0000 7fe91f330700 10 monclient: monmap: 2021-05-26T16:41:18.077 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:18.078 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.078 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:18.074628+0000 2021-05-26T16:41:18.078 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:18.074628+0000 2021-05-26T16:41:18.078 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:18.079 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.079 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:18.079 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:18.079 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:18.080 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:18.080 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:18.080 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:18.080 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:18.080 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:18.081 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:18.081 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.073+0000 7fe91f330700 1 Processor -- start 2021-05-26T16:41:18.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.073+0000 7fe91f330700 1 -- start start 2021-05-26T16:41:18.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.073+0000 7fe91f330700 10 monclient: init 2021-05-26T16:41:18.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:18.091 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 10 monclient: _add_conns ranks=[3,6,7,4,2,0,8,5,1] 2021-05-26T16:41:18.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 10 monclient(hunting): picked mon.noname-g con 0x7fe918064a20 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:18.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 10 monclient(hunting): picked mon.noname-d con 0x7fe918063e30 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:18.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 10 monclient(hunting): picked mon.noname-i con 0x7fe9180642e0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:18.092 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe918059750 con 0x7fe918064a20 2021-05-26T16:41:18.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe918064e00 con 0x7fe918063e30 2021-05-26T16:41:18.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91809c770 con 0x7fe9180642e0 2021-05-26T16:41:18.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:18.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91f330700 10 monclient(hunting): authenticate will time out at 835.706337s 2021-05-26T16:41:18.093 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91c8cb700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fe918063e30 0x7fe918132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:56830/0 (socket says 172.21.15.3:56830) 2021-05-26T16:41:18.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91c8cb700 1 -- 172.21.15.3:0/245012268 learned_addr learned my addr 172.21.15.3:0/245012268 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:18.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.074+0000 7fe91d8cd700 1 -- 172.21.15.3:0/245012268 >> v1:172.21.15.137:6792/0 conn(0x7fe9180642e0 legacy=0x7fe9181357b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:18.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe91c8cb700 1 -- 172.21.15.3:0/245012268 >> v1:172.21.15.3:6792/0 conn(0x7fe918063e30 legacy=0x7fe918132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013620396 0 0) 0x7fe918064e00 con 0x7fe918063e30 2021-05-26T16:41:18.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe907fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:18.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe907fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:18.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe907fff700 10 monclient(hunting): my global_id is 4434 2021-05-26T16:41:18.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe900003270 con 0x7fe918063e30 2021-05-26T16:41:18.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe91d0cc700 1 -- 172.21.15.3:0/245012268 >> v1:172.21.15.137:6790/0 conn(0x7fe918064a20 legacy=0x7fe918099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.076+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 894064825 0 0) 0x7fe900003270 con 0x7fe918063e30 2021-05-26T16:41:18.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 >> v1:172.21.15.137:6792/0 conn(0x7fe9180642e0 legacy=0x7fe9181357b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:18.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 >> v1:172.21.15.137:6790/0 conn(0x7fe918064a20 legacy=0x7fe918099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:18.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 1 monclient: found mon.noname-d 2021-05-26T16:41:18.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:18.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:18.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9180977a0 con 0x7fe918063e30 2021-05-26T16:41:18.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:18.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:18.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 5 monclient: authenticate success, global_id 4434 2021-05-26T16:41:18.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:18.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe908001a60 con 0x7fe918063e30 2021-05-26T16:41:18.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:18.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:18.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: dump: 2021-05-26T16:41:18.099 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:18.099 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.100 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.100 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.100 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:18.100 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.101 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:18.101 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:18.101 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:18.101 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:18.102 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:18.102 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:18.102 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:18.102 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:18.102 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:18.103 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe908001d70 con 0x7fe918063e30 2021-05-26T16:41:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 1 -- 172.21.15.3:0/245012268 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe908004930 con 0x7fe918063e30 2021-05-26T16:41:18.104 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:18.104 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 4 set_mon_vals no callback set 2021-05-26T16:41:18.104 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:18.104 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:18.105 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe907fff700 10 monclient: dump: 2021-05-26T16:41:18.105 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:18.105 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.105 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.105 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.106 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:18.106 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.106 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:18.106 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:18.106 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:18.107 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:18.107 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:18.107 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:18.107 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:18.107 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:18.108 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:18.108 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 10 monclient: shutdown 2021-05-26T16:41:18.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:18.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 1 -- 172.21.15.3:0/245012268 >> v1:172.21.15.3:6792/0 conn(0x7fe918063e30 legacy=0x7fe918132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 1 -- 172.21.15.3:0/245012268 shutdown_connections 2021-05-26T16:41:18.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 1 -- 172.21.15.3:0/245012268 >> 172.21.15.3:0/245012268 conn(0x7fe9180a0db0 msgr2=0x7fe91809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:18.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 1 -- 172.21.15.3:0/245012268 shutdown_connections 2021-05-26T16:41:18.109 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.077+0000 7fe91f330700 1 -- 172.21.15.3:0/245012268 wait complete. 2021-05-26T16:41:18.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.078+0000 7fe91f330700 10 monclient: build_initial_monmap 2021-05-26T16:41:18.110 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.078+0000 7fe91f330700 10 monclient: monmap: 2021-05-26T16:41:18.110 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:18.110 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:18.110 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:18.111 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:18.111 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:18.111 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.111 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:18.112 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:18.112 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:18.112 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:18.112 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:18.112 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:18.113 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:18.113 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:18.113 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:18.113 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.113 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.078+0000 7fe91f330700 1 Processor -- start 2021-05-26T16:41:18.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.078+0000 7fe91f330700 1 -- start start 2021-05-26T16:41:18.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.078+0000 7fe91f330700 10 monclient: init 2021-05-26T16:41:18.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:18.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 10 monclient: _add_conns ranks=[0,8,1,3,2,7,4,6,5] 2021-05-26T16:41:18.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 10 monclient(hunting): picked mon.noname-a con 0x7fe918063e30 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:18.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 10 monclient(hunting): picked mon.noname-e con 0x7fe9180642e0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:18.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 10 monclient(hunting): picked mon.noname-f con 0x7fe918064a20 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:18.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe918129db0 con 0x7fe918063e30 2021-05-26T16:41:18.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91812fe50 con 0x7fe918064a20 2021-05-26T16:41:18.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe918116900 con 0x7fe9180642e0 2021-05-26T16:41:18.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:18.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91f330700 10 monclient(hunting): authenticate will time out at 835.711212s 2021-05-26T16:41:18.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91d0cc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe918063e30 0x7fe9181296a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51434/0 (socket says 172.21.15.3:51434) 2021-05-26T16:41:18.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.079+0000 7fe91d0cc700 1 -- 172.21.15.3:0/1335053639 learned_addr learned my addr 172.21.15.3:0/1335053639 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:18.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe91d0cc700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6789/0 conn(0x7fe918063e30 legacy=0x7fe9181296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe91c8cb700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe9180642e0 legacy=0x7fe9181410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460746411 0 0) 0x7fe918129db0 con 0x7fe918063e30 2021-05-26T16:41:18.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:18.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:18.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): my global_id is 4518 2021-05-26T16:41:18.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f8003270 con 0x7fe918063e30 2021-05-26T16:41:18.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959064149 0 0) 0x7fe918116900 con 0x7fe9180642e0 2021-05-26T16:41:18.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:18.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:18.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): my global_id is 4481 2021-05-26T16:41:18.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe918129db0 con 0x7fe9180642e0 2021-05-26T16:41:18.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe91d8cd700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.137:6789/0 conn(0x7fe918064a20 legacy=0x7fe918144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 758066996 0 0) 0x7fe918129db0 con 0x7fe9180642e0 2021-05-26T16:41:18.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe918116900 con 0x7fe9180642e0 2021-05-26T16:41:18.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe908004870 con 0x7fe9180642e0 2021-05-26T16:41:18.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:18.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:41:18.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): dump: 2021-05-26T16:41:18.121 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:18.121 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.121 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.121 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.122 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:18.122 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.122 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:18.122 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:18.122 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:18.123 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:18.123 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:18.123 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:18.123 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:18.123 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:18.124 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:18.124 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.081+0000 7fe9057fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:18.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 341835122 0 0) 0x7fe8f8003270 con 0x7fe918063e30 2021-05-26T16:41:18.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe918129db0 con 0x7fe918063e30 2021-05-26T16:41:18.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe90c001ca0 con 0x7fe918063e30 2021-05-26T16:41:18.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:18.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:18.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient(hunting): dump: 2021-05-26T16:41:18.125 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:18.126 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.126 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.126 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.126 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:18.127 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.127 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:18.127 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:18.127 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:18.127 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:18.128 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:18.128 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:18.128 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:18.128 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:18.128 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:18.129 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2387656570 0 0) 0x7fe918116900 con 0x7fe9180642e0 2021-05-26T16:41:18.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.137:6789/0 conn(0x7fe918064a20 legacy=0x7fe918144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6789/0 conn(0x7fe918063e30 legacy=0x7fe9181296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:18.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 monclient: found mon.e 2021-05-26T16:41:18.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:18.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:18.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918116ba0 con 0x7fe9180642e0 2021-05-26T16:41:18.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:18.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:18.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe91f330700 5 monclient: authenticate success, global_id 4481 2021-05-26T16:41:18.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe91f330700 10 monclient: _renew_subs 2021-05-26T16:41:18.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe91f330700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:18.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe918116e40 con 0x7fe9180642e0 2021-05-26T16:41:18.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe91f330700 10 monclient: _renew_subs 2021-05-26T16:41:18.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe91f330700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:41:18.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91813cbb0 con 0x7fe9180642e0 2021-05-26T16:41:18.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe908001a50 con 0x7fe9180642e0 2021-05-26T16:41:18.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:18.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe908005260 con 0x7fe9180642e0 2021-05-26T16:41:18.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:18.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9077fe700 4 set_mon_vals no callback set 2021-05-26T16:41:18.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:18.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.082+0000 7fe9057fa700 10 monclient: dump: 2021-05-26T16:41:18.134 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:18.134 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.134 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.135 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.135 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:18.135 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.135 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:18.135 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:18.136 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:18.136 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:18.136 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:18.136 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:18.136 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:18.137 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.083+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fe90800e7d0 con 0x7fe9180642e0 2021-05-26T16:41:18.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.083+0000 7fe91f330700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:18.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.083+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe8f00065a0 con 0x7fe8f0002840 2021-05-26T16:41:18.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.083+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 3941+0+0 (unknown 1019984006 0 0) 0x7fe90803db00 con 0x7fe9180642e0 2021-05-26T16:41:18.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.083+0000 7fe91d8cd700 10 monclient: get_auth_request con 0x7fe8f8032fc0 auth_method 0 2021-05-26T16:41:18.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe91d0cc700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe8f0002840 legacy=0x7fe8f0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069503102 0 0) 0x7fe8f00065a0 con 0x7fe8f0002840 2021-05-26T16:41:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 10 monclient(hunting): my global_id is 4490 2021-05-26T16:41:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe918116900 con 0x7fe8f0002840 2021-05-26T16:41:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4105639787 0 0) 0x7fe918116900 con 0x7fe8f0002840 2021-05-26T16:41:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8f00065a0 con 0x7fe8f0002840 2021-05-26T16:41:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe90c002590 con 0x7fe8f0002840 2021-05-26T16:41:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:18.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 10 monclient: dump: 2021-05-26T16:41:18.141 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:18.141 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.141 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.142 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.142 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:18.142 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.142 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:18.142 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:18.144 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1646064155 0 0) 0x7fe8f00065a0 con 0x7fe8f0002840 2021-05-26T16:41:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.085+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8f0009e40 con 0x7fe8f0002840 2021-05-26T16:41:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.086+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe90c0029b0 con 0x7fe8f0002840 2021-05-26T16:41:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.086+0000 7fe9057fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.086+0000 7fe9057fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.086+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe8f0002840 legacy=0x7fe8f0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.086+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe8f0002840 legacy=0x7fe8f0004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:18.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.093+0000 7fe91f330700 10 start_mon_command cmd=[{"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}] 2021-05-26T16:41:18.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.093+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe8f0002320 con 0x7fe8f0000de0 2021-05-26T16:41:18.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe91d0cc700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe8f0000de0 legacy=0x7fe8f0001bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500086478 0 0) 0x7fe8f0002320 con 0x7fe8f0000de0 2021-05-26T16:41:18.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:18.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:18.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 10 monclient(hunting): my global_id is 4499 2021-05-26T16:41:18.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f00065a0 con 0x7fe8f0000de0 2021-05-26T16:41:18.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3658966202 0 0) 0x7fe8f00065a0 con 0x7fe8f0000de0 2021-05-26T16:41:18.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8f0002320 con 0x7fe8f0000de0 2021-05-26T16:41:18.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe90c005850 con 0x7fe8f0000de0 2021-05-26T16:41:18.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:18.151 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:41:18.151 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 10 monclient: dump: 2021-05-26T16:41:18.151 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:18.151 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.151 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.152 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:18.152 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:18.152 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.152 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:18.152 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:18.153 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:18.153 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:18.153 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:18.153 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:18.153 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:18.154 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:18.154 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:18.154 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 6413859 0 0) 0x7fe8f0002320 con 0x7fe8f0000de0 2021-05-26T16:41:18.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.096+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 --> v1:172.21.15.3:6793/0 -- command(tid 2: {"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}) v1 -- 0x7fe8f0008780 con 0x7fe8f0000de0 2021-05-26T16:41:18.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+83 (unknown 0 0 2946029456) 0x7fe90c006060 con 0x7fe8f0000de0 2021-05-26T16:41:18.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe9057fa700 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}] 2021-05-26T16:41:18.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe9057fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:18.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe8f0000de0 legacy=0x7fe8f0001bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe9057fa700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe8f0000de0 legacy=0x7fe8f0001bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:18.156 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: "ret": 0, 2021-05-26T16:41:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: "msg": "forcing store sync the next time the monitor starts" 2021-05-26T16:41:18.157 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:18.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.137:6812/30003 conn(0x7fe8f8032fc0 legacy=0x7fe8f8035480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 10 monclient: shutdown 2021-05-26T16:41:18.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:18.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 >> v1:172.21.15.3:6793/0 conn(0x7fe9180642e0 legacy=0x7fe9181410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:18.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91d8cd700 1 -- 172.21.15.3:0/1335053639 reap_dead start 2021-05-26T16:41:18.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91d8cd700 1 -- 172.21.15.3:0/1335053639 reap_dead start 2021-05-26T16:41:18.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 shutdown_connections 2021-05-26T16:41:18.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 >> 172.21.15.3:0/1335053639 conn(0x7fe9180a0db0 msgr2=0x7fe918099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:18.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 shutdown_connections 2021-05-26T16:41:18.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.097+0000 7fe91f330700 1 -- 172.21.15.3:0/1335053639 wait complete. 2021-05-26T16:41:18.161 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2021-05-26T16:41:18.161 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2021-05-26T16:41:18.162 INFO:teuthology.orchestra.run:waiting for 300 2021-05-26T16:41:18.171 INFO:tasks.ceph.mon.e:Stopped 2021-05-26T16:41:18.171 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2021-05-26T16:41:18.171 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a store 2021-05-26T16:41:18.172 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a sync_force --yes-i-really-mean-it 2021-05-26T16:41:18.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.326+0000 7fedfb59e700 10 monclient: get_monmap_and_config 2021-05-26T16:41:18.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.326+0000 7fedfb59e700 10 monclient: build_initial_monmap 2021-05-26T16:41:18.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.326+0000 7fedfb59e700 10 monclient: monmap: 2021-05-26T16:41:18.331 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:18.331 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:18.331 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:18.328176+0000 2021-05-26T16:41:18.332 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:18.328176+0000 2021-05-26T16:41:18.332 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:18.332 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:18.332 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:18.332 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:18.333 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:18.333 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:18.333 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:18.333 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:18.333 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:18.334 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:18.334 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:18.334 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:18.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 1 Processor -- start 2021-05-26T16:41:18.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 1 -- start start 2021-05-26T16:41:18.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient: init 2021-05-26T16:41:18.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:18.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient: _add_conns ranks=[2,3,5,7,4,0,1,8,6] 2021-05-26T16:41:18.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient(hunting): picked mon.noname-b con 0x7fedfc12cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:18.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient(hunting): picked mon.noname-g con 0x7fedfc099a30 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:18.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient(hunting): picked mon.noname-h con 0x7fedfc099eb0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:18.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc046600 con 0x7fedfc12cbd0 2021-05-26T16:41:18.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc09b5e0 con 0x7fedfc099a30 2021-05-26T16:41:18.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc12d8f0 con 0x7fedfc099eb0 2021-05-26T16:41:18.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:18.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfb59e700 10 monclient(hunting): authenticate will time out at 835.959783s 2021-05-26T16:41:18.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfa59c700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fedfc12cbd0 0x7fedfc12d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53510/0 (socket says 172.21.15.3:53510) 2021-05-26T16:41:18.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.327+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 learned_addr learned my addr 172.21.15.3:0/1093379987 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:18.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.330+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6790/0 conn(0x7fedfc12cbd0 legacy=0x7fedfc12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.330+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6791/0 conn(0x7fedfc099eb0 legacy=0x7fedfc135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:18.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:18.330+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6790/0 conn(0x7fedfc099a30 legacy=0x7fedfc131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:21.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 10 monclient(hunting): tick 2021-05-26T16:41:21.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 1 monclient(hunting): continuing hunt 2021-05-26T16:41:21.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:41:21.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6791/0 conn(0x7fedfc099eb0 legacy=0x7fedfc135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:21.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6790/0 conn(0x7fedfc099a30 legacy=0x7fedfc131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:21.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6790/0 conn(0x7fedfc12cbd0 legacy=0x7fedfc12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:21.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 10 monclient: _add_conns ranks=[4,8,1,7,6,0] 2021-05-26T16:41:21.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-c con 0x7fedd8003680 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:21.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-e con 0x7fedd8007310 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:21.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-f con 0x7fedd800b0a0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:21.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc09c2b0 con 0x7fedd800b0a0 2021-05-26T16:41:21.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.327+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd800feb0 con 0x7fedd8003680 2021-05-26T16:41:21.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd80110e0 con 0x7fedd8007310 2021-05-26T16:41:21.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.328+0000 7fedebfff700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:21.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.328+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd8007310 legacy=0x7fedd80097d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:21.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.330+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6791/0 conn(0x7fedd8003680 legacy=0x7fedd8005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:21.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.330+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6789/0 conn(0x7fedd800b0a0 legacy=0x7fedd800d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:21.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.529+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd8007310 legacy=0x7fedd80097d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:21.930+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd8007310 legacy=0x7fedd80097d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:22.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:22.731+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd8007310 legacy=0x7fedd80097d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 10 monclient(hunting): tick 2021-05-26T16:41:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 1 monclient(hunting): continuing hunt 2021-05-26T16:41:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:41:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd8007310 legacy=0x7fedd80097d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6791/0 conn(0x7fedd8003680 legacy=0x7fedd8005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6789/0 conn(0x7fedd800b0a0 legacy=0x7fedd800d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 10 monclient: _add_conns ranks=[7,6,0] 2021-05-26T16:41:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-i con 0x7fedd800f110 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 reap_dead start 2021-05-26T16:41:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-d con 0x7fedd8010040 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-a con 0x7fedd8017690 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd8012370 con 0x7fedd8017690 2021-05-26T16:41:24.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd80110e0 con 0x7fedd8010040 2021-05-26T16:41:24.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 reap_dead start 2021-05-26T16:41:24.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd80062f0 con 0x7fedd800f110 2021-05-26T16:41:24.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedebfff700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:24.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.328+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6792/0 conn(0x7fedd800f110 legacy=0x7fedd800f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:24.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.330+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6789/0 conn(0x7fedd8017690 legacy=0x7fedd8019a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:24.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.330+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6792/0 conn(0x7fedd8010040 legacy=0x7fedd80104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:24.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.529+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6792/0 conn(0x7fedd800f110 legacy=0x7fedd800f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:24.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:24.930+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6792/0 conn(0x7fedd800f110 legacy=0x7fedd800f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:25.731+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6792/0 conn(0x7fedd800f110 legacy=0x7fedd800f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:27.293 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:41:27.293 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.293 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.293 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.294 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.294 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:41:27.294 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.295 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.295 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.295 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.296 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:41:27.296 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.296 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.296 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.297 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.297 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:41:27.297 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.297 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.298 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.298 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.298 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:41:27.299 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.299 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.299 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.299 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.300 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:41:27.300 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.300 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.300 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.301 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.301 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:41:27.301 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.302 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.302 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.302 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.302 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:41:27.303 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.303 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:27.303 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:27.303 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:27.304 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:41:27.304 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.305 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.305 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.305 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.305 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:41:27.306 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.306 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.306 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.306 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.307 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:41:27.307 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.307 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.307 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.308 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.308 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:41:27.308 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.308 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.309 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.309 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.309 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:41:27.309 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.310 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.310 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.310 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.311 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:41:27.311 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.311 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.311 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.311 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.312 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:41:27.312 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.312 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.313 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.313 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.313 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:41:27.313 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.314 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.314 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.314 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.327 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:41:27.327 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:27.327 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:27.328 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:27.328 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 10 monclient(hunting): tick 2021-05-26T16:41:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 1 monclient(hunting): continuing hunt 2021-05-26T16:41:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:41:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6792/0 conn(0x7fedd800f110 legacy=0x7fedd800f510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6792/0 conn(0x7fedd8010040 legacy=0x7fedd80104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6789/0 conn(0x7fedd8017690 legacy=0x7fedd8019a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 10 monclient: _add_conns ranks=[1,4,2,8,0,6,3,7,5] 2021-05-26T16:41:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-f con 0x7fedd80066b0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-c con 0x7fedd8006b30 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-b con 0x7fedd8003a60 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd8006480 con 0x7fedd80066b0 2021-05-26T16:41:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd80062f0 con 0x7fedd8003a60 2021-05-26T16:41:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd8005f00 con 0x7fedd8006b30 2021-05-26T16:41:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.328+0000 7fedebfff700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:27.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.331+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6791/0 conn(0x7fedd8006b30 legacy=0x7fedd8009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.331+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 DispatchQueue::entry inject delay of 0.002000 2021-05-26T16:41:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.331+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6790/0 conn(0x7fedd8003a60 legacy=0x7fedd801b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:27.331+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6789/0 conn(0x7fedd80066b0 legacy=0x7fedd800d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:30.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 10 monclient(hunting): tick 2021-05-26T16:41:30.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 1 monclient(hunting): continuing hunt 2021-05-26T16:41:30.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:41:30.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6791/0 conn(0x7fedd8006b30 legacy=0x7fedd8009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:30.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6790/0 conn(0x7fedd8003a60 legacy=0x7fedd801b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:30.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.137:6789/0 conn(0x7fedd80066b0 legacy=0x7fedd800d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:30.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 10 monclient: _add_conns ranks=[0,8,6,5,7,3] 2021-05-26T16:41:30.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 reap_dead start 2021-05-26T16:41:30.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-a con 0x7fedd8017690 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:30.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-e con 0x7fedd80066b0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:30.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 reap_dead start 2021-05-26T16:41:30.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 10 monclient(hunting): picked mon.noname-d con 0x7fedd8006b30 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:30.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd801f8f0 con 0x7fedd8017690 2021-05-26T16:41:30.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd8003a60 con 0x7fedd8006b30 2021-05-26T16:41:30.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd8003bf0 con 0x7fedd80066b0 2021-05-26T16:41:30.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedebfff700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:30.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.329+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd80066b0 legacy=0x7fedd8009770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:30.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.331+0000 7fedfa59c700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6789/0 conn(0x7fedd8017690 legacy=0x7fedd801eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:30.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.331+0000 7fedfad9d700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6792/0 conn(0x7fedd8006b30 legacy=0x7fedd800f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:30.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.530+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd80066b0 legacy=0x7fedd8009770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:30.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:30.931+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd80066b0 legacy=0x7fedd8009770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:31.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:31.732+0000 7fedf9d9b700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd80066b0 legacy=0x7fedd8009770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:32.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.302+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875205368 0 0) 0x7fedd801f8f0 con 0x7fedd8017690 2021-05-26T16:41:32.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.302+0000 7fedf959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.302+0000 7fedf959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.302+0000 7fedf959a700 10 monclient(hunting): my global_id is 4527 2021-05-26T16:41:32.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.302+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede0003270 con 0x7fedd8017690 2021-05-26T16:41:32.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1241001464 0 0) 0x7fede0003270 con 0x7fedd8017690 2021-05-26T16:41:32.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6793/0 conn(0x7fedd80066b0 legacy=0x7fedd8009770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:32.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6792/0 conn(0x7fedd8006b30 legacy=0x7fedd800f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: _finish_hunting 0 2021-05-26T16:41:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 monclient: found mon.noname-a 2021-05-26T16:41:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:32.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:41:32.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd801f200 con 0x7fedd8017690 2021-05-26T16:41:32.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: _finish_auth 0 2021-05-26T16:41:32.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:32.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fede4001a20 con 0x7fedd8017690 2021-05-26T16:41:32.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:41:32.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: dump: 2021-05-26T16:41:32.313 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.313 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.313 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.313 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.315 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.315 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.315 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.315 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.315 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.316 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.316 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.316 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fede4001cd0 con 0x7fedd8017690 2021-05-26T16:41:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 1 -- 172.21.15.3:0/1093379987 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fede4004930 con 0x7fedd8017690 2021-05-26T16:41:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedf959a700 10 monclient: dump: 2021-05-26T16:41:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.319 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.319 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.319 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.319 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.321 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedfb59e700 5 monclient: authenticate success, global_id 4527 2021-05-26T16:41:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.303+0000 7fedfb59e700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.304+0000 7fedfb59e700 4 set_mon_vals no callback set 2021-05-26T16:41:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.305+0000 7fedfb59e700 10 monclient: shutdown 2021-05-26T16:41:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.305+0000 7fedfb59e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.305+0000 7fedfb59e700 1 -- 172.21.15.3:0/1093379987 >> v1:172.21.15.3:6789/0 conn(0x7fedd8017690 legacy=0x7fedd801eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.305+0000 7fedfb59e700 1 -- 172.21.15.3:0/1093379987 shutdown_connections 2021-05-26T16:41:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.305+0000 7fedfb59e700 1 -- 172.21.15.3:0/1093379987 >> 172.21.15.3:0/1093379987 conn(0x7fedfc0a00c0 msgr2=0x7fedfc0a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.305+0000 7fedfb59e700 1 -- 172.21.15.3:0/1093379987 shutdown_connections 2021-05-26T16:41:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.305+0000 7fedfb59e700 1 -- 172.21.15.3:0/1093379987 wait complete. 2021-05-26T16:41:32.324 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33054]: starting. 2021-05-26T16:41:32.325 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33054]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33052 2021-05-26T16:41:32.325 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33054]: shutting down. 2021-05-26T16:41:32.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.307+0000 7fedfb59e700 10 monclient: build_initial_monmap 2021-05-26T16:41:32.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.308+0000 7fedfb59e700 10 monclient: monmap: 2021-05-26T16:41:32.332 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.308+0000 7fedfb59e700 1 Processor -- start 2021-05-26T16:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.308+0000 7fedfb59e700 1 -- start start 2021-05-26T16:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.308+0000 7fedfb59e700 10 monclient: init 2021-05-26T16:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.309+0000 7fedfb59e700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.309+0000 7fedfb59e700 10 monclient: _add_conns ranks=[5,2,1,6,0,4,7,8,3] 2021-05-26T16:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.309+0000 7fedfb59e700 10 monclient(hunting): picked mon.noname-h con 0x7fedd80066b0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:32.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfb59e700 10 monclient(hunting): picked mon.noname-b con 0x7fedd8006b30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:32.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfa59c700 1 --1- >> v1:172.21.15.137:6791/0 conn(0x7fedd80066b0 0x7fedfc128b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6791/0 says I am v1:172.21.15.3:56480/0 (socket says 172.21.15.3:56480) 2021-05-26T16:41:32.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfa59c700 1 -- 172.21.15.3:0/3399415633 learned_addr learned my addr 172.21.15.3:0/3399415633 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:32.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfb59e700 10 monclient(hunting): picked mon.noname-f con 0x7fedd8017690 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc0953b0 con 0x7fedd8017690 2021-05-26T16:41:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc116ba0 con 0x7fedd8006b30 2021-05-26T16:41:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc116e40 con 0x7fedd80066b0 2021-05-26T16:41:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfb59e700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.310+0000 7fedfb59e700 10 monclient(hunting): authenticate will time out at 849.942319s 2021-05-26T16:41:32.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedfa59c700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.137:6791/0 conn(0x7fedd80066b0 legacy=0x7fedfc128b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedf9d9b700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6790/0 conn(0x7fedd8006b30 legacy=0x7fedfc129220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277807596 0 0) 0x7fedfc116ba0 con 0x7fedd8006b30 2021-05-26T16:41:32.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): my global_id is 4466 2021-05-26T16:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd8006110 con 0x7fedd8006b30 2021-05-26T16:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255774713 0 0) 0x7fedfc116e40 con 0x7fedd80066b0 2021-05-26T16:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): my global_id is 4514 2021-05-26T16:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc116ba0 con 0x7fedd80066b0 2021-05-26T16:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedfad9d700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.137:6789/0 conn(0x7fedd8017690 legacy=0x7fedfc144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859538542 0 0) 0x7fedfc0953b0 con 0x7fedd8017690 2021-05-26T16:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): my global_id is 4402 2021-05-26T16:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc116e40 con 0x7fedd8017690 2021-05-26T16:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1353960896 0 0) 0x7fedd8006110 con 0x7fedd8006b30 2021-05-26T16:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fedfc0953b0 con 0x7fedd8006b30 2021-05-26T16:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fedf0001d30 con 0x7fedd8006b30 2021-05-26T16:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.312+0000 7fedea7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.348 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 708430418 0 0) 0x7fedfc116ba0 con 0x7fedd80066b0 2021-05-26T16:41:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fedd8006110 con 0x7fedd80066b0 2021-05-26T16:41:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fede40019a0 con 0x7fedd80066b0 2021-05-26T16:41:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.351 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.351 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.351 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.351 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.352 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.352 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.352 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.352 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.352 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.353 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.353 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.353 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.353 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 28702976 0 0) 0x7fedfc116e40 con 0x7fedd8017690 2021-05-26T16:41:32.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fedfc116ba0 con 0x7fedd8017690 2021-05-26T16:41:32.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fedec001ee0 con 0x7fedd8017690 2021-05-26T16:41:32.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:32.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:32.355 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.355 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.355 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.356 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.356 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.356 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.356 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.356 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.357 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.357 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.357 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.357 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.357 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.358 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.358 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.358 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1769073202 0 0) 0x7fedfc0953b0 con 0x7fedd8006b30 2021-05-26T16:41:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.137:6791/0 conn(0x7fedd80066b0 legacy=0x7fedfc128b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.137:6789/0 conn(0x7fedd8017690 legacy=0x7fedfc144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 monclient: found mon.b 2021-05-26T16:41:32.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:32.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:32.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc09bd30 con 0x7fedd8006b30 2021-05-26T16:41:32.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:32.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:32.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedfb59e700 5 monclient: authenticate success, global_id 4466 2021-05-26T16:41:32.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedfb59e700 10 monclient: _renew_subs 2021-05-26T16:41:32.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedfb59e700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:32.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc096950 con 0x7fedd8006b30 2021-05-26T16:41:32.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fedf0002480 con 0x7fedd8006b30 2021-05-26T16:41:32.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:32.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fedf0002930 con 0x7fedd8006b30 2021-05-26T16:41:32.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedfb59e700 10 monclient: _renew_subs 2021-05-26T16:41:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedfb59e700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc095ff0 con 0x7fedd8006b30 2021-05-26T16:41:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedf8d99700 4 set_mon_vals no callback set 2021-05-26T16:41:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:32.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.313+0000 7fedea7fc700 10 monclient: dump: 2021-05-26T16:41:32.364 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.364 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.364 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.364 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.365 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.365 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.365 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.365 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.366 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.366 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.366 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.366 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.367 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.367 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.367 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.367 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.314+0000 7fedfb59e700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.314+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fedf0002b50 con 0x7fedd8006b30 2021-05-26T16:41:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.314+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fedfc097930 con 0x7fedfc094710 2021-05-26T16:41:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.314+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 3549+0+0 (unknown 3700065029 0 0) 0x7fedf003d870 con 0x7fedd8006b30 2021-05-26T16:41:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.315+0000 7fedfad9d700 10 monclient: get_auth_request con 0x7fedd8036600 auth_method 0 2021-05-26T16:41:32.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.316+0000 7fedfa59c700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6789/0 conn(0x7fedfc094710 legacy=0x7fedfc12db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740856595 0 0) 0x7fedfc097930 con 0x7fedfc094710 2021-05-26T16:41:32.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 10 monclient(hunting): my global_id is 4536 2021-05-26T16:41:32.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc0953b0 con 0x7fedfc094710 2021-05-26T16:41:32.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2210409785 0 0) 0x7fedfc0953b0 con 0x7fedfc094710 2021-05-26T16:41:32.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fedfc097930 con 0x7fedfc094710 2021-05-26T16:41:32.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fede4004ea0 con 0x7fedfc094710 2021-05-26T16:41:32.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:32.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 10 monclient: dump: 2021-05-26T16:41:32.371 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.373 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.373 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.373 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.373 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.375 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2714536207 0 0) 0x7fedfc097930 con 0x7fedfc094710 2021-05-26T16:41:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.319+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedfc116a00 con 0x7fedfc094710 2021-05-26T16:41:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.320+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fede40051c0 con 0x7fedfc094710 2021-05-26T16:41:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.320+0000 7fedea7fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.320+0000 7fedea7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.320+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6789/0 conn(0x7fedfc094710 legacy=0x7fedfc12db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.320+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6789/0 conn(0x7fedfc094710 legacy=0x7fedfc12db70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:32.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.328+0000 7fedfb59e700 10 start_mon_command cmd=[{"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}] 2021-05-26T16:41:32.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.328+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fedfc06c030 con 0x7fedfc027d00 2021-05-26T16:41:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.331+0000 7fedfa59c700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6789/0 conn(0x7fedfc027d00 legacy=0x7fedfc12e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447807660 0 0) 0x7fedfc06c030 con 0x7fedfc027d00 2021-05-26T16:41:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 10 monclient(hunting): my global_id is 4572 2021-05-26T16:41:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc097930 con 0x7fedfc027d00 2021-05-26T16:41:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3481860834 0 0) 0x7fedfc097930 con 0x7fedfc027d00 2021-05-26T16:41:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fedfc06c030 con 0x7fedfc027d00 2021-05-26T16:41:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fede4005780 con 0x7fedfc027d00 2021-05-26T16:41:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:41:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 10 monclient: dump: 2021-05-26T16:41:32.382 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.382 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.382 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.382 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.383 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.383 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.383 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.383 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.385 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3507257293 0 0) 0x7fedfc06c030 con 0x7fedfc027d00 2021-05-26T16:41:32.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.370+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 --> v1:172.21.15.3:6789/0 -- command(tid 2: {"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}) v1 -- 0x7fedfc069b10 con 0x7fedfc027d00 2021-05-26T16:41:32.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+83 (unknown 0 0 2946029456) 0x7fede4006060 con 0x7fedfc027d00 2021-05-26T16:41:32.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedea7fc700 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}] 2021-05-26T16:41:32.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedea7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:32.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6789/0 conn(0x7fedfc027d00 legacy=0x7fedfc12e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedea7fc700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6789/0 conn(0x7fedfc027d00 legacy=0x7fedfc12e280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:32.387 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:32.388 INFO:teuthology.orchestra.run.smithi003.stdout: "ret": 0, 2021-05-26T16:41:32.388 INFO:teuthology.orchestra.run.smithi003.stdout: "msg": "forcing store sync the next time the monitor starts" 2021-05-26T16:41:32.388 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:32.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.137:6812/30003 conn(0x7fedd8036600 legacy=0x7fedd8038ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfb59e700 10 monclient: shutdown 2021-05-26T16:41:32.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfb59e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:32.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 >> v1:172.21.15.3:6790/0 conn(0x7fedd8006b30 legacy=0x7fedfc129220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfad9d700 1 -- 172.21.15.3:0/3399415633 reap_dead start 2021-05-26T16:41:32.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfad9d700 1 -- 172.21.15.3:0/3399415633 reap_dead start 2021-05-26T16:41:32.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 shutdown_connections 2021-05-26T16:41:32.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.371+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 >> 172.21.15.3:0/3399415633 conn(0x7fedfc0a00c0 msgr2=0x7fedfc098640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:32.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.372+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 shutdown_connections 2021-05-26T16:41:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.372+0000 7fedfb59e700 1 -- 172.21.15.3:0/3399415633 wait complete. 2021-05-26T16:41:32.392 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2021-05-26T16:41:32.392 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-05-26T16:41:32.393 INFO:teuthology.orchestra.run:waiting for 300 2021-05-26T16:41:32.403 INFO:tasks.ceph.mon.a:Stopped 2021-05-26T16:41:32.403 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2021-05-26T16:41:32.404 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:41:32.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.555+0000 7fa0da731700 10 monclient: get_monmap_and_config 2021-05-26T16:41:32.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.555+0000 7fa0da731700 10 monclient: build_initial_monmap 2021-05-26T16:41:32.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.556+0000 7fa0da731700 10 monclient: monmap: 2021-05-26T16:41:32.560 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:32.560 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.560 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:32.557568+0000 2021-05-26T16:41:32.561 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:32.557568+0000 2021-05-26T16:41:32.561 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:32.561 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.561 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:32.561 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:32.562 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:32.562 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:32.562 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:32.562 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:32.563 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:32.563 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:32.563 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:32.563 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.556+0000 7fa0da731700 1 Processor -- start 2021-05-26T16:41:32.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.556+0000 7fa0da731700 1 -- start start 2021-05-26T16:41:32.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.556+0000 7fa0da731700 10 monclient: init 2021-05-26T16:41:32.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:32.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 10 monclient: _add_conns ranks=[5,0,2,1,7,3,6,8,4] 2021-05-26T16:41:32.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 10 monclient(hunting): picked mon.noname-h con 0x7fa0d4096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 10 monclient(hunting): picked mon.noname-a con 0x7fa0d4099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 10 monclient(hunting): picked mon.noname-b con 0x7fa0d409a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d4059750 con 0x7fa0d4099db0 2021-05-26T16:41:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d4064620 con 0x7fa0d409a260 2021-05-26T16:41:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d4064e50 con 0x7fa0d4096ca0 2021-05-26T16:41:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0da731700 10 monclient(hunting): authenticate will time out at 850.189301s 2021-05-26T16:41:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0d37fe700 1 -- >> v1:172.21.15.3:6789/0 conn(0x7fa0d4099db0 legacy=0x7fa0d4132080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6789/0 2021-05-26T16:41:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0d8cce700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fa0d409a260 0x7fa0d41357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53702/0 (socket says 172.21.15.3:53702) 2021-05-26T16:41:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.557+0000 7fa0d8cce700 1 -- 172.21.15.3:0/3993224771 learned_addr learned my addr 172.21.15.3:0/3993224771 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.559+0000 7fa0d8cce700 1 -- 172.21.15.3:0/3993224771 >> v1:172.21.15.3:6790/0 conn(0x7fa0d409a260 legacy=0x7fa0d41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.559+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621320582 0 0) 0x7fa0d4064620 con 0x7fa0d409a260 2021-05-26T16:41:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.559+0000 7fa0d2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.559+0000 7fa0d2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.559+0000 7fa0d2ffd700 10 monclient(hunting): my global_id is 4475 2021-05-26T16:41:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.559+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b8003270 con 0x7fa0d409a260 2021-05-26T16:41:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.559+0000 7fa0d3fff700 1 -- 172.21.15.3:0/3993224771 >> v1:172.21.15.137:6791/0 conn(0x7fa0d4096ca0 legacy=0x7fa0d4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1278935902 0 0) 0x7fa0b8003270 con 0x7fa0d409a260 2021-05-26T16:41:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 >> v1:172.21.15.137:6791/0 conn(0x7fa0d4096ca0 legacy=0x7fa0d4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 >> v1:172.21.15.3:6789/0 conn(0x7fa0d4099db0 legacy=0x7fa0d4132080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 monclient: found mon.noname-b 2021-05-26T16:41:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d409c390 con 0x7fa0d409a260 2021-05-26T16:41:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 5 monclient: authenticate success, global_id 4475 2021-05-26T16:41:32.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa0c8001de0 con 0x7fa0d409a260 2021-05-26T16:41:32.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:32.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: dump: 2021-05-26T16:41:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.585 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.585 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.585 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:32.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa0c80020f0 con 0x7fa0d409a260 2021-05-26T16:41:32.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:32.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 1 -- 172.21.15.3:0/3993224771 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa0c8004cb0 con 0x7fa0d409a260 2021-05-26T16:41:32.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 4 set_mon_vals no callback set 2021-05-26T16:41:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0d2ffd700 10 monclient: dump: 2021-05-26T16:41:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.590 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.590 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.590 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.590 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.591 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.591 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.591 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.591 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 10 monclient: shutdown 2021-05-26T16:41:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 1 -- 172.21.15.3:0/3993224771 >> v1:172.21.15.3:6790/0 conn(0x7fa0d409a260 legacy=0x7fa0d41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 1 -- 172.21.15.3:0/3993224771 shutdown_connections 2021-05-26T16:41:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 1 -- 172.21.15.3:0/3993224771 >> 172.21.15.3:0/3993224771 conn(0x7fa0d409cc00 msgr2=0x7fa0d409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 1 -- 172.21.15.3:0/3993224771 shutdown_connections 2021-05-26T16:41:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.560+0000 7fa0da731700 1 -- 172.21.15.3:0/3993224771 wait complete. 2021-05-26T16:41:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.561+0000 7fa0da731700 10 monclient: build_initial_monmap 2021-05-26T16:41:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.561+0000 7fa0da731700 10 monclient: monmap: 2021-05-26T16:41:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:32.594 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:32.594 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:32.594 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:32.594 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.595 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:32.595 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:32.595 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:32.595 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:32.596 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:32.596 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:32.596 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:32.596 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:32.596 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:32.597 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.561+0000 7fa0da731700 1 Processor -- start 2021-05-26T16:41:32.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.561+0000 7fa0da731700 1 -- start start 2021-05-26T16:41:32.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.561+0000 7fa0da731700 10 monclient: init 2021-05-26T16:41:32.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:32.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 10 monclient: _add_conns ranks=[1,4,3,2,7,6,0,5,8] 2021-05-26T16:41:32.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 10 monclient(hunting): picked mon.noname-f con 0x7fa0d4096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:32.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 10 monclient(hunting): picked mon.noname-c con 0x7fa0d4099db0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:32.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 10 monclient(hunting): picked mon.noname-g con 0x7fa0d409a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:32.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d409bfb0 con 0x7fa0d4096ca0 2021-05-26T16:41:32.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d411ced0 con 0x7fa0d409a260 2021-05-26T16:41:32.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d411d170 con 0x7fa0d4099db0 2021-05-26T16:41:32.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:32.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0da731700 10 monclient(hunting): authenticate will time out at 850.194290s 2021-05-26T16:41:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0d37fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fa0d4099db0 0x7fa0d413c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37176/0 (socket says 172.21.15.3:37176) 2021-05-26T16:41:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.562+0000 7fa0d37fe700 1 -- 172.21.15.3:0/761418128 learned_addr learned my addr 172.21.15.3:0/761418128 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0d37fe700 1 -- 172.21.15.3:0/761418128 >> v1:172.21.15.3:6791/0 conn(0x7fa0d4099db0 legacy=0x7fa0d413c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0d3fff700 1 -- 172.21.15.3:0/761418128 >> v1:172.21.15.137:6789/0 conn(0x7fa0d4096ca0 legacy=0x7fa0d413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0d8cce700 1 -- 172.21.15.3:0/761418128 >> v1:172.21.15.137:6790/0 conn(0x7fa0d409a260 legacy=0x7fa0d4143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151768235 0 0) 0x7fa0d411d170 con 0x7fa0d4099db0 2021-05-26T16:41:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): my global_id is 4486 2021-05-26T16:41:32.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b4003270 con 0x7fa0d4099db0 2021-05-26T16:41:32.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173309700 0 0) 0x7fa0d409bfb0 con 0x7fa0d4096ca0 2021-05-26T16:41:32.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): my global_id is 4420 2021-05-26T16:41:32.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d411d170 con 0x7fa0d4096ca0 2021-05-26T16:41:32.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512172111 0 0) 0x7fa0d411ced0 con 0x7fa0d409a260 2021-05-26T16:41:32.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:32.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): my global_id is 4458 2021-05-26T16:41:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d409bfb0 con 0x7fa0d409a260 2021-05-26T16:41:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 660737391 0 0) 0x7fa0b4003270 con 0x7fa0d4099db0 2021-05-26T16:41:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0d411ced0 con 0x7fa0d4099db0 2021-05-26T16:41:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa0c0004380 con 0x7fa0d4099db0 2021-05-26T16:41:32.605 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.605 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:32.605 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.564+0000 7fa0bffff700 10 monclient(hunting): dump: 2021-05-26T16:41:32.605 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.606 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.606 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.606 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.606 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.607 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.607 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.607 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.607 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.607 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.608 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.608 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.608 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.608 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.608 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.609 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 353538101 0 0) 0x7fa0d411ced0 con 0x7fa0d4099db0 2021-05-26T16:41:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 >> v1:172.21.15.137:6790/0 conn(0x7fa0d409a260 legacy=0x7fa0d4143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 >> v1:172.21.15.137:6789/0 conn(0x7fa0d4096ca0 legacy=0x7fa0d413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 monclient: found mon.c 2021-05-26T16:41:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d411b000 con 0x7fa0d4099db0 2021-05-26T16:41:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient: _finish_auth 0 2021-05-26T16:41:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0da731700 5 monclient: authenticate success, global_id 4486 2021-05-26T16:41:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0da731700 10 monclient: _renew_subs 2021-05-26T16:41:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0da731700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d411db20 con 0x7fa0d4099db0 2021-05-26T16:41:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0da731700 10 monclient: _renew_subs 2021-05-26T16:41:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0da731700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d411a4a0 con 0x7fa0d4099db0 2021-05-26T16:41:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa0c0004690 con 0x7fa0d4099db0 2021-05-26T16:41:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa0c0004b40 con 0x7fa0d4099db0 2021-05-26T16:41:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0d27fc700 4 set_mon_vals no callback set 2021-05-26T16:41:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 10 monclient: dump: 2021-05-26T16:41:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:32.618 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.565+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fa0c0004d20 con 0x7fa0d4099db0 2021-05-26T16:41:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.566+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 3549+0+0 (unknown 3700065029 0 0) 0x7fa0c003d990 con 0x7fa0d4099db0 2021-05-26T16:41:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.566+0000 7fa0da731700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.566+0000 7fa0da731700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.566+0000 7fa0da731700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.566+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac004db0 con 0x7fa0d4099db0 2021-05-26T16:41:32.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.566+0000 7fa0d3fff700 10 monclient: get_auth_request con 0x7fa0b4032c00 auth_method 0 2021-05-26T16:41:32.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.570+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fa0c0005520 con 0x7fa0d4099db0 2021-05-26T16:41:32.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.570+0000 7fa0bffff700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:32.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.570+0000 7fa0bffff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:32.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.788+0000 7fa0da731700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:41:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.788+0000 7fa0da731700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.788+0000 7fa0da731700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.788+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa0ac0055e0 con 0x7fa0d4099db0 2021-05-26T16:41:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.788+0000 7fa0bffff700 1 -- 172.21.15.3:0/761418128 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2631 (unknown 254746657 0 4049665904) 0x7fa0c0013250 con 0x7fa0d4099db0 2021-05-26T16:41:32.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.788+0000 7fa0bffff700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:32.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.788+0000 7fa0bffff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:32.794 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":8,"quorum":[0,1,2,3,4,5,6],"quorum_names":["a","f","b","g","c","h","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:41:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 >> v1:172.21.15.137:6812/30003 conn(0x7fa0b4032c00 legacy=0x7fa0b40350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 10 monclient: shutdown 2021-05-26T16:41:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 >> v1:172.21.15.3:6791/0 conn(0x7fa0d4099db0 legacy=0x7fa0d413c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 shutdown_connections 2021-05-26T16:41:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 >> 172.21.15.3:0/761418128 conn(0x7fa0d409cc00 msgr2=0x7fa0d4097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 shutdown_connections 2021-05-26T16:41:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:32.790+0000 7fa0da731700 1 -- 172.21.15.3:0/761418128 wait complete. 2021-05-26T16:41:35.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:41:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.931+0000 7f3b0e7eb700 10 monclient: get_monmap_and_config 2021-05-26T16:41:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.931+0000 7f3b0e7eb700 10 monclient: build_initial_monmap 2021-05-26T16:41:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.931+0000 7f3b0e7eb700 10 monclient: monmap: 2021-05-26T16:41:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:35.936 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:35.936 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:35.933160+0000 2021-05-26T16:41:35.936 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:35.933160+0000 2021-05-26T16:41:35.936 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:35.936 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:35.937 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:35.937 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:35.937 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:35.937 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:35.939 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:35.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 1 Processor -- start 2021-05-26T16:41:35.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 1 -- start start 2021-05-26T16:41:35.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient: init 2021-05-26T16:41:35.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:35.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient: _add_conns ranks=[4,5,3,7,8,0,6,2,1] 2021-05-26T16:41:35.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient(hunting): picked mon.noname-c con 0x7f3b08096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:35.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient(hunting): picked mon.noname-h con 0x7f3b08099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:35.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient(hunting): picked mon.noname-g con 0x7f3b0809a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:35.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08059750 con 0x7f3b0809a260 2021-05-26T16:41:35.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08064620 con 0x7f3b08096ca0 2021-05-26T16:41:35.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08064e50 con 0x7f3b08099db0 2021-05-26T16:41:35.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:35.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b0e7eb700 10 monclient(hunting): authenticate will time out at 853.564856s 2021-05-26T16:41:35.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.932+0000 7f3b07fff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f3b08096ca0 0x7f3b08063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37208/0 (socket says 172.21.15.3:37208) 2021-05-26T16:41:35.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.933+0000 7f3b07fff700 1 -- 172.21.15.3:0/757939245 learned_addr learned my addr 172.21.15.3:0/757939245 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:35.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b07fff700 1 -- 172.21.15.3:0/757939245 >> v1:172.21.15.3:6791/0 conn(0x7f3b08096ca0 legacy=0x7f3b08063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:35.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680831358 0 0) 0x7f3b08064620 con 0x7f3b08096ca0 2021-05-26T16:41:35.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:35.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b077fe700 1 -- 172.21.15.3:0/757939245 >> v1:172.21.15.137:6791/0 conn(0x7f3b08099db0 legacy=0x7f3b08132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): my global_id is 4495 2021-05-26T16:41:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec003270 con 0x7f3b08096ca0 2021-05-26T16:41:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0cd88700 1 -- 172.21.15.3:0/757939245 >> v1:172.21.15.137:6790/0 conn(0x7f3b0809a260 legacy=0x7f3b081357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397041590 0 0) 0x7f3b08064e50 con 0x7f3b08099db0 2021-05-26T16:41:35.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:35.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:35.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): my global_id is 4559 2021-05-26T16:41:35.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b08064620 con 0x7f3b08099db0 2021-05-26T16:41:35.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847870878 0 0) 0x7f3b08059750 con 0x7f3b0809a260 2021-05-26T16:41:35.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:35.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:35.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient(hunting): my global_id is 4467 2021-05-26T16:41:35.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b08064e50 con 0x7f3b0809a260 2021-05-26T16:41:35.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1539266788 0 0) 0x7f3aec003270 con 0x7f3b08096ca0 2021-05-26T16:41:35.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 >> v1:172.21.15.137:6791/0 conn(0x7f3b08099db0 legacy=0x7f3b08132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:35.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 >> v1:172.21.15.137:6790/0 conn(0x7f3b0809a260 legacy=0x7f3b081357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:35.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:35.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 monclient: found mon.noname-c 2021-05-26T16:41:35.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:35.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:35.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0809c390 con 0x7f3b08096ca0 2021-05-26T16:41:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 5 monclient: authenticate success, global_id 4495 2021-05-26T16:41:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3af8001a60 con 0x7f3b08096ca0 2021-05-26T16:41:35.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:35.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:35.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:35.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: dump: 2021-05-26T16:41:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:35.967 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3af8001cf0 con 0x7f3b08096ca0 2021-05-26T16:41:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 1 -- 172.21.15.3:0/757939245 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3af8004930 con 0x7f3b08096ca0 2021-05-26T16:41:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 4 set_mon_vals no callback set 2021-05-26T16:41:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b06ffd700 10 monclient: dump: 2021-05-26T16:41:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:35.973 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:35.973 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:35.973 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 10 monclient: shutdown 2021-05-26T16:41:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/757939245 >> v1:172.21.15.3:6791/0 conn(0x7f3b08096ca0 legacy=0x7f3b08063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/757939245 shutdown_connections 2021-05-26T16:41:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/757939245 >> 172.21.15.3:0/757939245 conn(0x7f3b0809cc00 msgr2=0x7f3b0809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/757939245 shutdown_connections 2021-05-26T16:41:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/757939245 wait complete. 2021-05-26T16:41:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 10 monclient: build_initial_monmap 2021-05-26T16:41:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.936+0000 7f3b0e7eb700 10 monclient: monmap: 2021-05-26T16:41:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:35.977 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:35.977 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:35.977 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:35.977 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:35.977 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:35.979 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:35.979 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:35.979 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:35.979 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:35.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 1 Processor -- start 2021-05-26T16:41:35.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 1 -- start start 2021-05-26T16:41:35.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 10 monclient: init 2021-05-26T16:41:35.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:35.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 10 monclient: _add_conns ranks=[1,7,2,6,0,3,4,5,8] 2021-05-26T16:41:35.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 10 monclient(hunting): picked mon.noname-f con 0x7f3b08096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:35.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 10 monclient(hunting): picked mon.noname-i con 0x7f3b08099db0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:35.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 10 monclient(hunting): picked mon.noname-b con 0x7f3b0809a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:35.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.937+0000 7f3b0e7eb700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08116f20 con 0x7f3b08096ca0 2021-05-26T16:41:35.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.938+0000 7f3b0e7eb700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b081171c0 con 0x7f3b0809a260 2021-05-26T16:41:35.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.938+0000 7f3b0e7eb700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0813cee0 con 0x7f3b08099db0 2021-05-26T16:41:35.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.938+0000 7f3b0e7eb700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:35.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.938+0000 7f3b0e7eb700 10 monclient(hunting): authenticate will time out at 853.570019s 2021-05-26T16:41:35.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.938+0000 7f3b077fe700 1 -- >> v1:172.21.15.137:6792/0 conn(0x7f3b08099db0 legacy=0x7f3b081413a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:35.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.938+0000 7f3b0cd88700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f3b0809a260 0x7f3b08144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53748/0 (socket says 172.21.15.3:53748) 2021-05-26T16:41:35.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.938+0000 7f3b0cd88700 1 -- 172.21.15.3:0/4104430915 learned_addr learned my addr 172.21.15.3:0/4104430915 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:35.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3b0cd88700 1 -- 172.21.15.3:0/4104430915 >> v1:172.21.15.3:6790/0 conn(0x7f3b0809a260 legacy=0x7f3b08144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:35.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3b07fff700 1 -- 172.21.15.3:0/4104430915 >> v1:172.21.15.137:6789/0 conn(0x7f3b08096ca0 legacy=0x7f3b08129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:35.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249549680 0 0) 0x7f3b081171c0 con 0x7f3b0809a260 2021-05-26T16:41:35.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:35.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): my global_id is 4484 2021-05-26T16:41:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae8003270 con 0x7f3b0809a260 2021-05-26T16:41:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234464954 0 0) 0x7f3b08116f20 con 0x7f3b08096ca0 2021-05-26T16:41:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:35.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): my global_id is 4429 2021-05-26T16:41:35.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b081171c0 con 0x7f3b08096ca0 2021-05-26T16:41:35.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2286651124 0 0) 0x7f3ae8003270 con 0x7f3b0809a260 2021-05-26T16:41:35.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b08116f20 con 0x7f3b0809a260 2021-05-26T16:41:35.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3afc002050 con 0x7f3b0809a260 2021-05-26T16:41:35.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:35.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:35.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): dump: 2021-05-26T16:41:35.988 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:35.988 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:35.988 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.988 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.988 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:35.989 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:35.989 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:35.989 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:35.989 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:35.990 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:35.990 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:35.990 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:35.990 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:35.991 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:35.991 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:35.991 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:35.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:35.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1444776992 0 0) 0x7f3b081171c0 con 0x7f3b08096ca0 2021-05-26T16:41:35.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ae8003270 con 0x7f3b08096ca0 2021-05-26T16:41:35.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3af8004870 con 0x7f3b08096ca0 2021-05-26T16:41:35.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:35.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:35.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 10 monclient(hunting): dump: 2021-05-26T16:41:35.993 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:35.993 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:35.993 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.994 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:35.994 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:35.994 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:35.994 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:35.995 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:35.995 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:35.995 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:35.995 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:35.996 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:35.996 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:35.996 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:35.996 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:35.997 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:35.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.940+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1686280388 0 0) 0x7f3b08116f20 con 0x7f3b0809a260 2021-05-26T16:41:35.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 >> v1:172.21.15.137:6792/0 conn(0x7f3b08099db0 legacy=0x7f3b081413a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-05-26T16:41:35.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 >> v1:172.21.15.137:6789/0 conn(0x7f3b08096ca0 legacy=0x7f3b08129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:35.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:35.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 1 monclient: found mon.b 2021-05-26T16:41:35.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:35.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:35.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0812f020 con 0x7f3b0809a260 2021-05-26T16:41:35.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 10 monclient: _finish_auth 0 2021-05-26T16:41:35.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:35.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b0e7eb700 5 monclient: authenticate success, global_id 4484 2021-05-26T16:41:35.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b0e7eb700 10 monclient: _renew_subs 2021-05-26T16:41:36.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b0e7eb700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:36.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0812e540 con 0x7f3b0809a260 2021-05-26T16:41:36.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b0e7eb700 10 monclient: _renew_subs 2021-05-26T16:41:36.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b0e7eb700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:36.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b08131690 con 0x7f3b0809a260 2021-05-26T16:41:36.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3afc0026b0 con 0x7f3b0809a260 2021-05-26T16:41:36.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:36.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3afc002be0 con 0x7f3b0809a260 2021-05-26T16:41:36.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:36.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3b067fc700 4 set_mon_vals no callback set 2021-05-26T16:41:36.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:36.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 10 monclient: dump: 2021-05-26T16:41:36.003 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:36.003 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:36.003 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:36.003 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:36.003 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:36.004 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:36.004 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:36.004 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:36.004 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:36.005 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:36.005 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:36.005 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:36.005 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:36.006 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:36.006 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:36.006 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:36.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.941+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f3afc002d40 con 0x7f3b0809a260 2021-05-26T16:41:36.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.942+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 3549+0+0 (unknown 3700065029 0 0) 0x7f3afc03db40 con 0x7f3b0809a260 2021-05-26T16:41:36.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.942+0000 7f3b0e7eb700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:36.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.942+0000 7f3b0e7eb700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:36.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.942+0000 7f3b0e7eb700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:36.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.942+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae0004db0 con 0x7f3b0809a260 2021-05-26T16:41:36.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.942+0000 7f3b07fff700 10 monclient: get_auth_request con 0x7f3ae8032e30 auth_method 0 2021-05-26T16:41:36.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.946+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f3afc013830 con 0x7f3b0809a260 2021-05-26T16:41:36.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.946+0000 7f3af3fff700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:36.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:35.946+0000 7f3af3fff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:36.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.166+0000 7f3b0e7eb700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:41:36.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.166+0000 7f3b0e7eb700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:36.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.166+0000 7f3b0e7eb700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:36.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.166+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3ae00055e0 con 0x7f3b0809a260 2021-05-26T16:41:36.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.166+0000 7f3af3fff700 1 -- 172.21.15.3:0/4104430915 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2631 (unknown 254746657 0 4045506245) 0x7f3afc013420 con 0x7f3b0809a260 2021-05-26T16:41:36.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.166+0000 7f3af3fff700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:36.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.166+0000 7f3af3fff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:36.172 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":8,"quorum":[0,1,2,3,4,5,6],"quorum_names":["a","f","b","g","c","h","d"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:41:36.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 >> v1:172.21.15.137:6812/30003 conn(0x7f3ae8032e30 legacy=0x7f3ae80352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:36.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 10 monclient: shutdown 2021-05-26T16:41:36.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:36.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 >> v1:172.21.15.3:6790/0 conn(0x7f3b0809a260 legacy=0x7f3b08144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:36.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 shutdown_connections 2021-05-26T16:41:36.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 >> 172.21.15.3:0/4104430915 conn(0x7f3b0809cc00 msgr2=0x7f3b0809ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:36.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 shutdown_connections 2021-05-26T16:41:36.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:36.168+0000 7f3b0e7eb700 1 -- 172.21.15.3:0/4104430915 wait complete. 2021-05-26T16:41:39.183 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:41:39.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.310+0000 7f7883757700 10 monclient: get_monmap_and_config 2021-05-26T16:41:39.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.310+0000 7f7883757700 10 monclient: build_initial_monmap 2021-05-26T16:41:39.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.311+0000 7f7883757700 10 monclient: monmap: 2021-05-26T16:41:39.314 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:39.314 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:39.314 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:39.311598+0000 2021-05-26T16:41:39.314 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:39.311598+0000 2021-05-26T16:41:39.315 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:39.315 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:39.315 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:39.315 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:39.316 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:39.316 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:39.316 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:39.316 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:39.317 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:39.317 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:39.317 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:39.317 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:39.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.311+0000 7f7883757700 1 Processor -- start 2021-05-26T16:41:39.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.311+0000 7f7883757700 1 -- start start 2021-05-26T16:41:39.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.311+0000 7f7883757700 10 monclient: init 2021-05-26T16:41:39.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:39.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 10 monclient: _add_conns ranks=[0,2,4,5,6,1,7,3,8] 2021-05-26T16:41:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 10 monclient(hunting): picked mon.noname-a con 0x7f787c064a20 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 10 monclient(hunting): picked mon.noname-b con 0x7f787c063e30 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 10 monclient(hunting): picked mon.noname-c con 0x7f787c0642e0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c059750 con 0x7f787c064a20 2021-05-26T16:41:39.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c064e00 con 0x7f787c063e30 2021-05-26T16:41:39.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c09c770 con 0x7f787c0642e0 2021-05-26T16:41:39.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:39.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7883757700 10 monclient(hunting): authenticate will time out at 856.943438s 2021-05-26T16:41:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f78814f3700 1 -- >> v1:172.21.15.3:6789/0 conn(0x7f787c064a20 legacy=0x7f787c099f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6789/0 2021-05-26T16:41:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7880cf2700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f787c063e30 0x7f787c132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53760/0 (socket says 172.21.15.3:53760) 2021-05-26T16:41:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7881cf4700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f787c0642e0 0x7f787c1357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37232/0 (socket says 172.21.15.3:37232) 2021-05-26T16:41:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.312+0000 7f7880cf2700 1 -- 172.21.15.3:0/2082026434 learned_addr learned my addr 172.21.15.3:0/2082026434 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.314+0000 7f7880cf2700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6790/0 conn(0x7f787c063e30 legacy=0x7f787c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:39.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.314+0000 7f7881cf4700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6791/0 conn(0x7f787c0642e0 legacy=0x7f787c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:39.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.513+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6789/0 conn(0x7f787c064a20 legacy=0x7f787c099f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6789/0 2021-05-26T16:41:39.916 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:39.914+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6789/0 conn(0x7f787c064a20 legacy=0x7f787c099f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6789/0 2021-05-26T16:41:40.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:40.715+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6789/0 conn(0x7f787c064a20 legacy=0x7f787c099f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6789/0 2021-05-26T16:41:42.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 10 monclient(hunting): tick 2021-05-26T16:41:42.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 1 monclient(hunting): continuing hunt 2021-05-26T16:41:42.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:41:42.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6791/0 conn(0x7f787c0642e0 legacy=0x7f787c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:42.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6790/0 conn(0x7f787c063e30 legacy=0x7f787c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:42.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6789/0 conn(0x7f787c064a20 legacy=0x7f787c099f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:42.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 10 monclient: _add_conns ranks=[8,6,1,7,3,5] 2021-05-26T16:41:42.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 10 monclient(hunting): picked mon.noname-e con 0x7f785c0035e0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:42.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 10 monclient(hunting): picked mon.noname-d con 0x7f785c007250 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:42.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 10 monclient(hunting): picked mon.noname-f con 0x7f785c00afc0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:42.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0977a0 con 0x7f785c00afc0 2021-05-26T16:41:42.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c059750 con 0x7f785c007250 2021-05-26T16:41:42.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c010e20 con 0x7f785c0035e0 2021-05-26T16:41:42.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6793/0 conn(0x7f785c0035e0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:42.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.312+0000 7f786affd700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:42.319 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:41:42.319 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.319 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:42.320 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:42.320 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:42.320 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:41:42.320 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.321 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:42.321 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:42.321 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:42.321 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:41:42.322 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.322 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:42.322 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:42.322 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:42.323 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:41:42.323 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.323 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:42.324 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:42.324 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:42.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.315+0000 7f7880cf2700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6792/0 conn(0x7f785c007250 legacy=0x7f785c0096f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:42.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.315+0000 7f7881cf4700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6789/0 conn(0x7f785c00afc0 legacy=0x7f785c00d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:42.328 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:41:42.328 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.328 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:42.329 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:42.329 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:42.330 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:41:42.330 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.330 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:42.330 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:42.331 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:42.331 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:41:42.331 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.331 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:42.332 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:42.332 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:42.332 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:41:42.333 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.333 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:42.333 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:42.333 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:42.334 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:41:42.334 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.334 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:42.334 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:42.335 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:42.335 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:41:42.335 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.336 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:41:42.336 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:41:42.336 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:41:42.336 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:41:42.336 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.337 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:42.337 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:42.337 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:42.337 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:41:42.337 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:41:42.338 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:41:42.338 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:41:42.338 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:41:42.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.513+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6793/0 conn(0x7f785c0035e0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:42.916 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:42.914+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6793/0 conn(0x7f785c0035e0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:43.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:43.715+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6793/0 conn(0x7f785c0035e0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:45.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 10 monclient(hunting): tick 2021-05-26T16:41:45.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 1 monclient(hunting): continuing hunt 2021-05-26T16:41:45.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:41:45.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6793/0 conn(0x7f785c0035e0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:45.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.3:6792/0 conn(0x7f785c007250 legacy=0x7f785c0096f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:45.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6789/0 conn(0x7f785c00afc0 legacy=0x7f785c00d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:45.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 10 monclient: _add_conns ranks=[5,7,3] 2021-05-26T16:41:45.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f7881cf4700 1 -- 172.21.15.3:0/2082026434 reap_dead start 2021-05-26T16:41:45.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 10 monclient(hunting): picked mon.noname-h con 0x7f785c00eed0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:45.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f7881cf4700 1 -- 172.21.15.3:0/2082026434 reap_dead start 2021-05-26T16:41:45.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 10 monclient(hunting): picked mon.noname-i con 0x7f785c009ec0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:45.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 10 monclient(hunting): picked mon.noname-g con 0x7f785c00a2a0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:45.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c012130 con 0x7f785c00a2a0 2021-05-26T16:41:45.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c010e20 con 0x7f785c00eed0 2021-05-26T16:41:45.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c00a7c0 con 0x7f785c009ec0 2021-05-26T16:41:45.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f786affd700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:45.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.313+0000 7f7880cf2700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6792/0 conn(0x7f785c009ec0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:45.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.315+0000 7f78814f3700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6791/0 conn(0x7f785c00eed0 legacy=0x7f785c00f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:45.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.315+0000 7f7881cf4700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6790/0 conn(0x7f785c00a2a0 legacy=0x7f785c00d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.514+0000 7f7880cf2700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6792/0 conn(0x7f785c009ec0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:45.917 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:45.915+0000 7f7880cf2700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6792/0 conn(0x7f785c009ec0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:46.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:46.716+0000 7f7880cf2700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6792/0 conn(0x7f785c009ec0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:47.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.332+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657127229 0 0) 0x7f785c010e20 con 0x7f785c00eed0 2021-05-26T16:41:47.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.332+0000 7f786bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:47.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.332+0000 7f786bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:47.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.332+0000 7f786bfff700 10 monclient(hunting): my global_id is 4568 2021-05-26T16:41:47.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.332+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7864003270 con 0x7f785c00eed0 2021-05-26T16:41:47.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1016189856 0 0) 0x7f7864003270 con 0x7f785c00eed0 2021-05-26T16:41:47.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6792/0 conn(0x7f785c009ec0 legacy=0x7f785c005a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:47.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6790/0 conn(0x7f785c00a2a0 legacy=0x7f785c00d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:47.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: _finish_hunting 0 2021-05-26T16:41:47.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 monclient: found mon.noname-h 2021-05-26T16:41:47.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:47.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.137:6791/0 2021-05-26T16:41:47.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c00aa00 con 0x7f785c00eed0 2021-05-26T16:41:47.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: _finish_auth 0 2021-05-26T16:41:47.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:47.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7878004720 con 0x7f785c00eed0 2021-05-26T16:41:47.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:47.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2021-05-26T16:41:47.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: dump: 2021-05-26T16:41:47.342 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:47.343 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:47.343 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:47.343 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:47.343 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:47.343 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:47.344 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:47.344 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:47.344 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:47.344 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:47.344 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:47.345 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:47.345 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:47.345 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:47.345 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:47.345 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f7883757700 5 monclient: authenticate success, global_id 4568 2021-05-26T16:41:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f7883757700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 <== mon.5 v1:172.21.15.137:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7878004a70 con 0x7f785c00eed0 2021-05-26T16:41:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:47.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 1 -- 172.21.15.3:0/2082026434 <== mon.5 v1:172.21.15.137:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7878004f20 con 0x7f785c00eed0 2021-05-26T16:41:47.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:47.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:47.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f786bfff700 10 monclient: dump: 2021-05-26T16:41:47.348 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:47.348 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:47.348 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:47.348 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:47.348 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:47.349 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:47.349 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:47.349 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:47.349 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:47.349 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:47.350 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:47.350 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:47.350 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:47.350 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:47.351 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:47.351 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:47.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f7883757700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:47.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.333+0000 7f7883757700 4 set_mon_vals no callback set 2021-05-26T16:41:47.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.334+0000 7f7883757700 10 monclient: shutdown 2021-05-26T16:41:47.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.334+0000 7f7883757700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:47.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.334+0000 7f7883757700 1 -- 172.21.15.3:0/2082026434 >> v1:172.21.15.137:6791/0 conn(0x7f785c00eed0 legacy=0x7f785c00f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:47.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.334+0000 7f7883757700 1 -- 172.21.15.3:0/2082026434 shutdown_connections 2021-05-26T16:41:47.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.334+0000 7f7883757700 1 -- 172.21.15.3:0/2082026434 >> 172.21.15.3:0/2082026434 conn(0x7f787c0a0db0 msgr2=0x7f787c09cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:47.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.334+0000 7f7883757700 1 -- 172.21.15.3:0/2082026434 shutdown_connections 2021-05-26T16:41:47.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.334+0000 7f7883757700 1 -- 172.21.15.3:0/2082026434 wait complete. 2021-05-26T16:41:47.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.335+0000 7f7883757700 10 monclient: build_initial_monmap 2021-05-26T16:41:47.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.335+0000 7f7883757700 10 monclient: monmap: 2021-05-26T16:41:47.355 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:47.356 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:47.356 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:47.357 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:47.357 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:47.357 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:47.358 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:47.358 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:47.359 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:47.359 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:47.359 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:47.360 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:47.360 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:47.360 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:47.361 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:47.361 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:47.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.335+0000 7f7883757700 1 Processor -- start 2021-05-26T16:41:47.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 1 -- start start 2021-05-26T16:41:47.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 10 monclient: init 2021-05-26T16:41:47.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:47.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 10 monclient: _add_conns ranks=[8,6,4,0,5,1,2,3,7] 2021-05-26T16:41:47.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 10 monclient(hunting): picked mon.noname-e con 0x7f785c009ec0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:47.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 10 monclient(hunting): picked mon.noname-d con 0x7f785c00a2a0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:47.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 10 monclient(hunting): picked mon.noname-c con 0x7f785c00eed0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:47.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c116c80 con 0x7f785c00eed0 2021-05-26T16:41:47.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f78814f3700 1 -- >> v1:172.21.15.3:6793/0 conn(0x7f785c009ec0 legacy=0x7f787c129780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:47.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.336+0000 7f7883757700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c116f20 con 0x7f785c00a2a0 2021-05-26T16:41:47.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.337+0000 7f7883757700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c1171c0 con 0x7f785c009ec0 2021-05-26T16:41:47.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.337+0000 7f7883757700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:47.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.337+0000 7f7883757700 10 monclient(hunting): authenticate will time out at 864.968052s 2021-05-26T16:41:47.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.337+0000 7f7880cf2700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f785c00a2a0 0x7f787c141400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57174/0 (socket says 172.21.15.3:57174) 2021-05-26T16:41:47.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.337+0000 7f7881cf4700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f785c00eed0 0x7f787c144b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37288/0 (socket says 172.21.15.3:37288) 2021-05-26T16:41:47.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.337+0000 7f7880cf2700 1 -- 172.21.15.3:0/4085956098 learned_addr learned my addr 172.21.15.3:0/4085956098 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:47.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.339+0000 7f7881cf4700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.3:6791/0 conn(0x7f785c00eed0 legacy=0x7f787c144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:47.367 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.339+0000 7f7880cf2700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.3:6792/0 conn(0x7f785c00a2a0 legacy=0x7f787c141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:47.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702453509 0 0) 0x7f787c116c80 con 0x7f785c00eed0 2021-05-26T16:41:47.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:47.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:47.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 10 monclient(hunting): my global_id is 4504 2021-05-26T16:41:47.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f785c0032e0 con 0x7f785c00eed0 2021-05-26T16:41:47.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450277474 0 0) 0x7f787c116f20 con 0x7f785c00a2a0 2021-05-26T16:41:47.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:47.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:47.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 10 monclient(hunting): my global_id is 4461 2021-05-26T16:41:47.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.417+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f787c116c80 con 0x7f785c00a2a0 2021-05-26T16:41:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.537+0000 7f78814f3700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.3:6793/0 conn(0x7f785c009ec0 legacy=0x7f787c129780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:47.940 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:47.938+0000 7f78814f3700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.3:6793/0 conn(0x7f785c009ec0 legacy=0x7f787c129780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:48.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.042+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1843519332 0 0) 0x7f787c116c80 con 0x7f785c00a2a0 2021-05-26T16:41:48.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.042+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f787c116f20 con 0x7f785c00a2a0 2021-05-26T16:41:48.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.042+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7870001d90 con 0x7f785c00a2a0 2021-05-26T16:41:48.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.042+0000 7f78697fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.042+0000 7f78697fa700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:48.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.042+0000 7f78697fa700 10 monclient(hunting): dump: 2021-05-26T16:41:48.046 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.047 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.047 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.047 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.047 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.047 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.048 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.048 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.048 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.048 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.049 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.049 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.049 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.050 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.050 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.050 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.042+0000 7f78697fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:48.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.047+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3697936415 0 0) 0x7f785c0032e0 con 0x7f785c00eed0 2021-05-26T16:41:48.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.047+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f787c116c80 con 0x7f785c00eed0 2021-05-26T16:41:48.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.047+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f786c001b10 con 0x7f785c00eed0 2021-05-26T16:41:48.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.047+0000 7f78697fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.047+0000 7f78697fa700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.047+0000 7f78697fa700 10 monclient(hunting): dump: 2021-05-26T16:41:48.053 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.053 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.053 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.053 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.054 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.054 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.054 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.054 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.055 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.055 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.055 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.055 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.056 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.056 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.056 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.056 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1710159347 0 0) 0x7f787c116c80 con 0x7f785c00eed0 2021-05-26T16:41:48.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.3:6793/0 conn(0x7f785c009ec0 legacy=0x7f787c129780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-05-26T16:41:48.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.3:6792/0 conn(0x7f785c00a2a0 legacy=0x7f787c141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 10 monclient: _finish_hunting 0 2021-05-26T16:41:48.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 1 monclient: found mon.c 2021-05-26T16:41:48.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:48.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c095910 con 0x7f785c00eed0 2021-05-26T16:41:48.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 10 monclient: _finish_auth 0 2021-05-26T16:41:48.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:48.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f7883757700 5 monclient: authenticate success, global_id 4504 2021-05-26T16:41:48.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f7883757700 10 monclient: _renew_subs 2021-05-26T16:41:48.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f7883757700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c094e30 con 0x7f785c00eed0 2021-05-26T16:41:48.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f7883757700 10 monclient: _renew_subs 2021-05-26T16:41:48.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f7883757700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c131720 con 0x7f785c00eed0 2021-05-26T16:41:48.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f786c001d70 con 0x7f785c00eed0 2021-05-26T16:41:48.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:48.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f786c004b20 con 0x7f785c00eed0 2021-05-26T16:41:48.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f786b7fe700 4 set_mon_vals no callback set 2021-05-26T16:41:48.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.051+0000 7f78697fa700 10 monclient: dump: 2021-05-26T16:41:48.065 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.065 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.066 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.067 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.068 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.068 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.068 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.069 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.069 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.069 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.069 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.069 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.070 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.070 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.070 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.070 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.052+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f786c004c80 con 0x7f785c00eed0 2021-05-26T16:41:48.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.052+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 3941+0+0 (unknown 2454852892 0 0) 0x7f786c03d410 con 0x7f785c00eed0 2021-05-26T16:41:48.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.052+0000 7f78814f3700 10 monclient: get_auth_request con 0x7f785c034dd0 auth_method 0 2021-05-26T16:41:48.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.052+0000 7f7883757700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:48.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.052+0000 7f7883757700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:48.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.052+0000 7f7883757700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.052+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858004db0 con 0x7f785c00eed0 2021-05-26T16:41:48.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.057+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f786c012fb0 con 0x7f785c00eed0 2021-05-26T16:41:48.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.057+0000 7f78697fa700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:48.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.057+0000 7f78697fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:48.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.284+0000 7f7883757700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:41:48.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.284+0000 7f7883757700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:48.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.284+0000 7f7883757700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.284+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f78580055e0 con 0x7f785c00eed0 2021-05-26T16:41:48.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.285+0000 7f78697fa700 1 -- 172.21.15.3:0/4085956098 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2626 (unknown 254746657 0 2330431275) 0x7f786c012ba0 con 0x7f785c00eed0 2021-05-26T16:41:48.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.285+0000 7f78697fa700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:41:48.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.285+0000 7f78697fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:48.289 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":10,"quorum":[1,2,3,4,5,6],"quorum_names":["f","b","g","c","h","d"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:41:48.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.286+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.137:6812/30003 conn(0x7f785c034dd0 legacy=0x7f785c037290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.286+0000 7f7883757700 10 monclient: shutdown 2021-05-26T16:41:48.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.286+0000 7f7883757700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:48.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.286+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 >> v1:172.21.15.3:6791/0 conn(0x7f785c00eed0 legacy=0x7f787c144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.287+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 shutdown_connections 2021-05-26T16:41:48.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.287+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 >> 172.21.15.3:0/4085956098 conn(0x7f787c0a0db0 msgr2=0x7f787c098420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:48.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.287+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 shutdown_connections 2021-05-26T16:41:48.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.287+0000 7f7883757700 1 -- 172.21.15.3:0/4085956098 wait complete. 2021-05-26T16:41:48.300 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2021-05-26T16:41:48.301 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-05-26T16:41:48.416 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.414+0000 7f15a885c700 10 monclient: get_monmap_and_config 2021-05-26T16:41:48.417 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.414+0000 7f15a885c700 10 monclient: build_initial_monmap 2021-05-26T16:41:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.414+0000 7f15a885c700 10 monclient: monmap: 2021-05-26T16:41:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:48.415142+0000 2021-05-26T16:41:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:48.415142+0000 2021-05-26T16:41:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:48.421 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 1 Processor -- start 2021-05-26T16:41:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 1 -- start start 2021-05-26T16:41:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient: init 2021-05-26T16:41:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient: _add_conns ranks=[6,4,8,7,3,1,5,0,2] 2021-05-26T16:41:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient(hunting): picked mon.noname-d con 0x7f15a412cbd0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient(hunting): picked mon.noname-c con 0x7f15a4099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient(hunting): picked mon.noname-e con 0x7f15a4099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a4046600 con 0x7f15a4099a30 2021-05-26T16:41:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a409b5e0 con 0x7f15a412cbd0 2021-05-26T16:41:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a412d8f0 con 0x7f15a4099eb0 2021-05-26T16:41:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a885c700 10 monclient(hunting): authenticate will time out at 866.046801s 2021-05-26T16:41:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a3fff700 1 -- >> v1:172.21.15.3:6793/0 conn(0x7f15a4099eb0 legacy=0x7f15a4135650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a37fe700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f15a412cbd0 0x7f15a412d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57184/0 (socket says 172.21.15.3:57184) 2021-05-26T16:41:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a37fe700 1 -- 172.21.15.3:0/513375561 learned_addr learned my addr 172.21.15.3:0/513375561 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.415+0000 7f15a2ffd700 1 --1- 172.21.15.3:0/513375561 >> v1:172.21.15.3:6791/0 conn(0x7f15a4099a30 0x7f15a4131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37296/0 (socket says 172.21.15.3:37296) 2021-05-26T16:41:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a37fe700 1 -- 172.21.15.3:0/513375561 >> v1:172.21.15.3:6792/0 conn(0x7f15a412cbd0 legacy=0x7f15a412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a2ffd700 1 -- 172.21.15.3:0/513375561 >> v1:172.21.15.3:6791/0 conn(0x7f15a4099a30 legacy=0x7f15a4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502335153 0 0) 0x7f15a409b5e0 con 0x7f15a412cbd0 2021-05-26T16:41:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient(hunting): my global_id is 4470 2021-05-26T16:41:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1588003270 con 0x7f15a412cbd0 2021-05-26T16:41:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842829859 0 0) 0x7f15a4046600 con 0x7f15a4099a30 2021-05-26T16:41:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient(hunting): my global_id is 4513 2021-05-26T16:41:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a409b5e0 con 0x7f15a4099a30 2021-05-26T16:41:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180687154 0 0) 0x7f15a409b5e0 con 0x7f15a4099a30 2021-05-26T16:41:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 >> v1:172.21.15.3:6793/0 conn(0x7f15a4099eb0 legacy=0x7f15a4135650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 >> v1:172.21.15.3:6792/0 conn(0x7f15a412cbd0 legacy=0x7f15a412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 monclient: found mon.noname-c 2021-05-26T16:41:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a409c2b0 con 0x7f15a4099a30 2021-05-26T16:41:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1590001a60 con 0x7f15a4099a30 2021-05-26T16:41:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a885c700 5 monclient: authenticate success, global_id 4513 2021-05-26T16:41:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: dump: 2021-05-26T16:41:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.446 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.446 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.446 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.446 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.447 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a885c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1590001d70 con 0x7f15a4099a30 2021-05-26T16:41:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 1 -- 172.21.15.3:0/513375561 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1590004870 con 0x7f15a4099a30 2021-05-26T16:41:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a885c700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a885c700 4 set_mon_vals no callback set 2021-05-26T16:41:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.418+0000 7f15a27fc700 10 monclient: dump: 2021-05-26T16:41:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.453 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.453 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.453 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 10 monclient: shutdown 2021-05-26T16:41:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 1 -- 172.21.15.3:0/513375561 >> v1:172.21.15.3:6791/0 conn(0x7f15a4099a30 legacy=0x7f15a4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 1 -- 172.21.15.3:0/513375561 shutdown_connections 2021-05-26T16:41:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 1 -- 172.21.15.3:0/513375561 >> 172.21.15.3:0/513375561 conn(0x7f15a40a00c0 msgr2=0x7f15a40a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 1 -- 172.21.15.3:0/513375561 shutdown_connections 2021-05-26T16:41:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 1 -- 172.21.15.3:0/513375561 wait complete. 2021-05-26T16:41:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 10 monclient: build_initial_monmap 2021-05-26T16:41:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.419+0000 7f15a885c700 10 monclient: monmap: 2021-05-26T16:41:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:48.459 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 1 Processor -- start 2021-05-26T16:41:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 1 -- start start 2021-05-26T16:41:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient: init 2021-05-26T16:41:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:48.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient: _add_conns ranks=[4,3,0,8,5,7,6,1,2] 2021-05-26T16:41:48.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient(hunting): picked mon.noname-c con 0x7f15a4099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:48.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient(hunting): picked mon.noname-g con 0x7f15a4099eb0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:48.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient(hunting): picked mon.noname-a con 0x7f15a412cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:48.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a409bd30 con 0x7f15a412cbd0 2021-05-26T16:41:48.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a409b850 con 0x7f15a4099eb0 2021-05-26T16:41:48.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a4118830 con 0x7f15a4099a30 2021-05-26T16:41:48.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:48.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a885c700 10 monclient(hunting): authenticate will time out at 866.051692s 2021-05-26T16:41:48.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a3fff700 1 -- >> v1:172.21.15.3:6789/0 conn(0x7f15a412cbd0 legacy=0x7f15a4144550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.3:6789/0 2021-05-26T16:41:48.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a37fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f15a4099a30 0x7f15a4129de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37300/0 (socket says 172.21.15.3:37300) 2021-05-26T16:41:48.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.420+0000 7f15a37fe700 1 -- 172.21.15.3:0/1697780931 learned_addr learned my addr 172.21.15.3:0/1697780931 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:48.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.422+0000 7f15a37fe700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6791/0 conn(0x7f15a4099a30 legacy=0x7f15a4129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261828421 0 0) 0x7f15a4118830 con 0x7f15a4099a30 2021-05-26T16:41:48.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient(hunting): my global_id is 4522 2021-05-26T16:41:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1584003270 con 0x7f15a4099a30 2021-05-26T16:41:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 592607598 0 0) 0x7f1584003270 con 0x7f15a4099a30 2021-05-26T16:41:48.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15a4118830 con 0x7f15a4099a30 2021-05-26T16:41:48.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1594001cb0 con 0x7f15a4099a30 2021-05-26T16:41:48.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a2ffd700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.137:6790/0 conn(0x7f15a4099eb0 legacy=0x7f15a4140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient(hunting): dump: 2021-05-26T16:41:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.471 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3906218833 0 0) 0x7f15a4118830 con 0x7f15a4099a30 2021-05-26T16:41:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.137:6790/0 conn(0x7f15a4099eb0 legacy=0x7f15a4140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6789/0 conn(0x7f15a412cbd0 legacy=0x7f15a4144550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-05-26T16:41:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 monclient: found mon.c 2021-05-26T16:41:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a412a4f0 con 0x7f15a4099a30 2021-05-26T16:41:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a885c700 5 monclient: authenticate success, global_id 4522 2021-05-26T16:41:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a885c700 10 monclient: _renew_subs 2021-05-26T16:41:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a885c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4117130 con 0x7f15a4099a30 2021-05-26T16:41:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a885c700 10 monclient: _renew_subs 2021-05-26T16:41:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a885c700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a4138e00 con 0x7f15a4099a30 2021-05-26T16:41:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1594004b20 con 0x7f15a4099a30 2021-05-26T16:41:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:48.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1594004fd0 con 0x7f15a4099a30 2021-05-26T16:41:48.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f15a1ffb700 4 set_mon_vals no callback set 2021-05-26T16:41:48.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.423+0000 7f158f7fe700 10 monclient: dump: 2021-05-26T16:41:48.480 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.480 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.480 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.480 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.483 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.424+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f159400e540 con 0x7f15a4099a30 2021-05-26T16:41:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.424+0000 7f15a885c700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.424+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f157c0065a0 con 0x7f157c002840 2021-05-26T16:41:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.424+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 3941+0+0 (unknown 2454852892 0 0) 0x7f159403da90 con 0x7f15a4099a30 2021-05-26T16:41:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.424+0000 7f15a3fff700 10 monclient: get_auth_request con 0x7f1584032970 auth_method 0 2021-05-26T16:41:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.426+0000 7f15a2ffd700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6790/0 conn(0x7f157c002840 legacy=0x7f157c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.426+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744444426 0 0) 0x7f157c0065a0 con 0x7f157c002840 2021-05-26T16:41:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient(hunting): my global_id is 4493 2021-05-26T16:41:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a4118830 con 0x7f157c002840 2021-05-26T16:41:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1839267744 0 0) 0x7f15a4118830 con 0x7f157c002840 2021-05-26T16:41:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f157c0065a0 con 0x7f157c002840 2021-05-26T16:41:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1590001880 con 0x7f157c002840 2021-05-26T16:41:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient: dump: 2021-05-26T16:41:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.491 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.491 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.491 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1160461818 0 0) 0x7f157c0065a0 con 0x7f157c002840 2021-05-26T16:41:48.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f157c009e40 con 0x7f157c002840 2021-05-26T16:41:48.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f15900047d0 con 0x7f157c002840 2021-05-26T16:41:48.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:48.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:48.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6790/0 conn(0x7f157c002840 legacy=0x7f157c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.427+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6790/0 conn(0x7f157c002840 legacy=0x7f157c004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.434+0000 7f15a885c700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.434+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f157c009ad0 con 0x7f157c008d90 2021-05-26T16:41:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.436+0000 7f15a2ffd700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6790/0 conn(0x7f157c008d90 legacy=0x7f157c009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.436+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238844821 0 0) 0x7f157c009ad0 con 0x7f157c008d90 2021-05-26T16:41:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.436+0000 7f158f7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.436+0000 7f158f7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.436+0000 7f158f7fe700 10 monclient(hunting): my global_id is 4502 2021-05-26T16:41:48.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.436+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f157c0065a0 con 0x7f157c008d90 2021-05-26T16:41:48.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3078059488 0 0) 0x7f157c0065a0 con 0x7f157c008d90 2021-05-26T16:41:48.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f157c009ad0 con 0x7f157c008d90 2021-05-26T16:41:48.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1590005060 con 0x7f157c008d90 2021-05-26T16:41:48.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:48.499 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 10 monclient: dump: 2021-05-26T16:41:48.500 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.500 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.500 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.500 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.500 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.502 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.502 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.502 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.502 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.503 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.503 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1997888278 0 0) 0x7f157c009ad0 con 0x7f157c008d90 2021-05-26T16:41:48.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 --> v1:172.21.15.3:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f157c008740 con 0x7f157c008d90 2021-05-26T16:41:48.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7459 (unknown 0 0 1005759968) 0x7f15900073e0 con 0x7f157c008d90 2021-05-26T16:41:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6790/0 conn(0x7f157c008d90 legacy=0x7f157c009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.437+0000 7f158f7fe700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6790/0 conn(0x7f157c008d90 legacy=0x7f157c009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:48.505 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 10, 2021-05-26T16:41:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: 6 2021-05-26T16:41:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:41:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:48.563 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:48.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.137:6812/30003 conn(0x7f1584032970 legacy=0x7f1584034e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 10 monclient: shutdown 2021-05-26T16:41:48.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:48.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 >> v1:172.21.15.3:6791/0 conn(0x7f15a4099a30 legacy=0x7f15a4129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a3fff700 1 -- 172.21.15.3:0/1697780931 reap_dead start 2021-05-26T16:41:48.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a3fff700 1 -- 172.21.15.3:0/1697780931 reap_dead start 2021-05-26T16:41:48.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 shutdown_connections 2021-05-26T16:41:48.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 >> 172.21.15.3:0/1697780931 conn(0x7f15a40a00c0 msgr2=0x7f15a409f570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:48.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 shutdown_connections 2021-05-26T16:41:48.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.438+0000 7f15a885c700 1 -- 172.21.15.3:0/1697780931 wait complete. 2021-05-26T16:41:48.568 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-05-26T16:41:48.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.682+0000 7fa2d9238700 10 monclient: get_monmap_and_config 2021-05-26T16:41:48.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.682+0000 7fa2d9238700 10 monclient: build_initial_monmap 2021-05-26T16:41:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.682+0000 7fa2d9238700 10 monclient: monmap: 2021-05-26T16:41:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:48.682846+0000 2021-05-26T16:41:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:48.682846+0000 2021-05-26T16:41:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:48.688 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:48.689 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:48.689 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:48.689 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.682+0000 7fa2d9238700 1 Processor -- start 2021-05-26T16:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.682+0000 7fa2d9238700 1 -- start start 2021-05-26T16:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.682+0000 7fa2d9238700 10 monclient: init 2021-05-26T16:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 10 monclient: _add_conns ranks=[8,5,2,6,1,0,4,3,7] 2021-05-26T16:41:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 10 monclient(hunting): picked mon.noname-e con 0x7fa2d4096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:41:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 10 monclient(hunting): picked mon.noname-h con 0x7fa2d4099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 10 monclient(hunting): picked mon.noname-b con 0x7fa2d409a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d4059750 con 0x7fa2d409a260 2021-05-26T16:41:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d4064620 con 0x7fa2d4099db0 2021-05-26T16:41:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d4064e50 con 0x7fa2d4096ca0 2021-05-26T16:41:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d9238700 10 monclient(hunting): authenticate will time out at 866.314353s 2021-05-26T16:41:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d2d9d700 1 -- >> v1:172.21.15.3:6793/0 conn(0x7fa2d4096ca0 legacy=0x7fa2d4063f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6793/0 2021-05-26T16:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d359e700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fa2d409a260 0x7fa2d41357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53846/0 (socket says 172.21.15.3:53846) 2021-05-26T16:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.683+0000 7fa2d359e700 1 -- 172.21.15.3:0/595013201 learned_addr learned my addr 172.21.15.3:0/595013201 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.685+0000 7fa2d359e700 1 -- 172.21.15.3:0/595013201 >> v1:172.21.15.3:6790/0 conn(0x7fa2d409a260 legacy=0x7fa2d41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.685+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287370792 0 0) 0x7fa2d4059750 con 0x7fa2d409a260 2021-05-26T16:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.685+0000 7fa2d1d9b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.685+0000 7fa2d1d9b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.685+0000 7fa2d1d9b700 10 monclient(hunting): my global_id is 4511 2021-05-26T16:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.685+0000 7fa2d259c700 1 -- 172.21.15.3:0/595013201 >> v1:172.21.15.137:6791/0 conn(0x7fa2d4099db0 legacy=0x7fa2d4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.685+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c0003270 con 0x7fa2d409a260 2021-05-26T16:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2293742746 0 0) 0x7fa2c0003270 con 0x7fa2d409a260 2021-05-26T16:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 >> v1:172.21.15.3:6793/0 conn(0x7fa2d4096ca0 legacy=0x7fa2d4063f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 >> v1:172.21.15.137:6791/0 conn(0x7fa2d4099db0 legacy=0x7fa2d4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: _finish_hunting 0 2021-05-26T16:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 monclient: found mon.noname-b 2021-05-26T16:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d409c390 con 0x7fa2d409a260 2021-05-26T16:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: _finish_auth 0 2021-05-26T16:41:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 5 monclient: authenticate success, global_id 4511 2021-05-26T16:41:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa2c4001dd0 con 0x7fa2d409a260 2021-05-26T16:41:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: dump: 2021-05-26T16:41:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.711 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.711 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.711 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.711 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.712 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa2c40020e0 con 0x7fa2d409a260 2021-05-26T16:41:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:48.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:48.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/595013201 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa2c4004cb0 con 0x7fa2d409a260 2021-05-26T16:41:48.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 4 set_mon_vals no callback set 2021-05-26T16:41:48.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:48.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d1d9b700 10 monclient: dump: 2021-05-26T16:41:48.714 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.714 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.714 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.717 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 10 monclient: shutdown 2021-05-26T16:41:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 1 -- 172.21.15.3:0/595013201 >> v1:172.21.15.3:6790/0 conn(0x7fa2d409a260 legacy=0x7fa2d41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 1 -- 172.21.15.3:0/595013201 shutdown_connections 2021-05-26T16:41:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 1 -- 172.21.15.3:0/595013201 >> 172.21.15.3:0/595013201 conn(0x7fa2d409cc00 msgr2=0x7fa2d409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 1 -- 172.21.15.3:0/595013201 shutdown_connections 2021-05-26T16:41:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.686+0000 7fa2d9238700 1 -- 172.21.15.3:0/595013201 wait complete. 2021-05-26T16:41:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.687+0000 7fa2d9238700 10 monclient: build_initial_monmap 2021-05-26T16:41:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.687+0000 7fa2d9238700 10 monclient: monmap: 2021-05-26T16:41:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:48.723 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.687+0000 7fa2d9238700 1 Processor -- start 2021-05-26T16:41:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.687+0000 7fa2d9238700 1 -- start start 2021-05-26T16:41:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.687+0000 7fa2d9238700 10 monclient: init 2021-05-26T16:41:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 10 monclient: _add_conns ranks=[4,3,5,6,2,8,7,1,0] 2021-05-26T16:41:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 10 monclient(hunting): picked mon.noname-c con 0x7fa2d4096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 10 monclient(hunting): picked mon.noname-g con 0x7fa2d4099db0 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 10 monclient(hunting): picked mon.noname-h con 0x7fa2d409a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:48.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d4129d40 con 0x7fa2d4099db0 2021-05-26T16:41:48.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d412fe50 con 0x7fa2d4096ca0 2021-05-26T16:41:48.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d4116890 con 0x7fa2d409a260 2021-05-26T16:41:48.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:48.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d9238700 10 monclient(hunting): authenticate will time out at 866.319212s 2021-05-26T16:41:48.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d2d9d700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fa2d4096ca0 0x7fa2d4129630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37320/0 (socket says 172.21.15.3:37320) 2021-05-26T16:41:48.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.688+0000 7fa2d2d9d700 1 -- 172.21.15.3:0/3498323625 learned_addr learned my addr 172.21.15.3:0/3498323625 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:48.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2d2d9d700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2d4096ca0 legacy=0x7fa2d4129630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2d259c700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.137:6790/0 conn(0x7fa2d4099db0 legacy=0x7fa2d41410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551690454 0 0) 0x7fa2d412fe50 con 0x7fa2d4096ca0 2021-05-26T16:41:48.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2d359e700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.137:6791/0 conn(0x7fa2d409a260 legacy=0x7fa2d4144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): my global_id is 4531 2021-05-26T16:41:48.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b4003270 con 0x7fa2d4096ca0 2021-05-26T16:41:48.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150144918 0 0) 0x7fa2d4129d40 con 0x7fa2d4099db0 2021-05-26T16:41:48.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): my global_id is 4485 2021-05-26T16:41:48.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d412fe50 con 0x7fa2d4099db0 2021-05-26T16:41:48.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467669355 0 0) 0x7fa2d4116890 con 0x7fa2d409a260 2021-05-26T16:41:48.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): my global_id is 4586 2021-05-26T16:41:48.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d4129d40 con 0x7fa2d409a260 2021-05-26T16:41:48.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2586633918 0 0) 0x7fa2b4003270 con 0x7fa2d4096ca0 2021-05-26T16:41:48.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2d4116890 con 0x7fa2d4096ca0 2021-05-26T16:41:48.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa2bc004350 con 0x7fa2d4096ca0 2021-05-26T16:41:48.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:48.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): dump: 2021-05-26T16:41:48.734 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.735 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.735 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.735 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.735 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.735 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.736 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.736 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.736 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.736 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.737 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.737 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.737 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.737 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.737 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.738 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.690+0000 7fa2baffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:48.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4155896970 0 0) 0x7fa2d412fe50 con 0x7fa2d4099db0 2021-05-26T16:41:48.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2b4003270 con 0x7fa2d4099db0 2021-05-26T16:41:48.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2061971626 0 0) 0x7fa2d4116890 con 0x7fa2d4096ca0 2021-05-26T16:41:48.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.137:6791/0 conn(0x7fa2d409a260 legacy=0x7fa2d4144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.137:6790/0 conn(0x7fa2d4099db0 legacy=0x7fa2d41410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:48.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 monclient: found mon.c 2021-05-26T16:41:48.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:48.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d4116b30 con 0x7fa2d4096ca0 2021-05-26T16:41:48.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 10 monclient: _finish_auth 0 2021-05-26T16:41:48.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:48.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d9238700 5 monclient: authenticate success, global_id 4531 2021-05-26T16:41:48.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d9238700 10 monclient: _renew_subs 2021-05-26T16:41:48.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d9238700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d4116dd0 con 0x7fa2d4096ca0 2021-05-26T16:41:48.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d9238700 10 monclient: _renew_subs 2021-05-26T16:41:48.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d9238700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d413cbb0 con 0x7fa2d4096ca0 2021-05-26T16:41:48.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa2bc004660 con 0x7fa2d4096ca0 2021-05-26T16:41:48.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:48.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa2bc004b10 con 0x7fa2d4096ca0 2021-05-26T16:41:48.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2d159a700 4 set_mon_vals no callback set 2021-05-26T16:41:48.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 10 monclient: dump: 2021-05-26T16:41:48.744 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.744 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.744 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.744 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.745 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.745 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.745 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.745 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.745 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.746 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.746 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.746 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.746 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.746 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.747 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.747 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.691+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fa2bc004c70 con 0x7fa2d4096ca0 2021-05-26T16:41:48.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.692+0000 7fa2d9238700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:48.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.692+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa2ac0065a0 con 0x7fa2ac002840 2021-05-26T16:41:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.692+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 3941+0+0 (unknown 2454852892 0 0) 0x7fa2bc03da70 con 0x7fa2d4096ca0 2021-05-26T16:41:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.692+0000 7fa2d359e700 10 monclient: get_auth_request con 0x7fa2b4032d60 auth_method 0 2021-05-26T16:41:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2d259c700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2ac002840 legacy=0x7fa2ac004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255788870 0 0) 0x7fa2ac0065a0 con 0x7fa2ac002840 2021-05-26T16:41:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 10 monclient(hunting): my global_id is 4540 2021-05-26T16:41:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d4116890 con 0x7fa2ac002840 2021-05-26T16:41:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1877015470 0 0) 0x7fa2d4116890 con 0x7fa2ac002840 2021-05-26T16:41:48.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2ac0065a0 con 0x7fa2ac002840 2021-05-26T16:41:48.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa2c8002480 con 0x7fa2ac002840 2021-05-26T16:41:48.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 10 monclient: dump: 2021-05-26T16:41:48.751 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.751 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.751 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.751 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.751 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.752 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.752 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.752 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.752 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.752 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.753 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.753 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.753 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.753 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.754 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.754 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2106623803 0 0) 0x7fa2ac0065a0 con 0x7fa2ac002840 2021-05-26T16:41:48.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.694+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2ac009e40 con 0x7fa2ac002840 2021-05-26T16:41:48.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.695+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fa2c8002970 con 0x7fa2ac002840 2021-05-26T16:41:48.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.695+0000 7fa2baffd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:48.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.695+0000 7fa2baffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:48.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.695+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2ac002840 legacy=0x7fa2ac004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.695+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2ac002840 legacy=0x7fa2ac004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:48.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.701+0000 7fa2d9238700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:48.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.701+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa2ac007510 con 0x7fa2ac0068b0 2021-05-26T16:41:48.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2d259c700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2ac0068b0 legacy=0x7fa2ac006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129835101 0 0) 0x7fa2ac007510 con 0x7fa2ac0068b0 2021-05-26T16:41:48.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 10 monclient(hunting): my global_id is 4549 2021-05-26T16:41:48.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2ac0065a0 con 0x7fa2ac0068b0 2021-05-26T16:41:48.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1112270513 0 0) 0x7fa2ac0065a0 con 0x7fa2ac0068b0 2021-05-26T16:41:48.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2ac007510 con 0x7fa2ac0068b0 2021-05-26T16:41:48.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa2c8005850 con 0x7fa2ac0068b0 2021-05-26T16:41:48.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 10 monclient: dump: 2021-05-26T16:41:48.760 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.761 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.761 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.761 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.761 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.762 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.762 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.762 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.762 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.762 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.763 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.763 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.763 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.763 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.764 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.764 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2675981842 0 0) 0x7fa2ac007510 con 0x7fa2ac0068b0 2021-05-26T16:41:48.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.704+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 --> v1:172.21.15.3:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa2ac008770 con 0x7fa2ac0068b0 2021-05-26T16:41:48.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7459 (unknown 0 0 1058770808) 0x7fa2c8007aa0 con 0x7fa2ac0068b0 2021-05-26T16:41:48.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2baffd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:48.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2baffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:48.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2ac0068b0 legacy=0x7fa2ac006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2baffd700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2ac0068b0 legacy=0x7fa2ac006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:48.766 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 10, 2021-05-26T16:41:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: 6 2021-05-26T16:41:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:41:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:48.821 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:48.821 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:48.821 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:48.821 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:48.822 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:48.822 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:48.822 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:48.823 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:48.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.137:6812/30003 conn(0x7fa2b4032d60 legacy=0x7fa2b4035220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 10 monclient: shutdown 2021-05-26T16:41:48.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:48.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 >> v1:172.21.15.3:6791/0 conn(0x7fa2d4096ca0 legacy=0x7fa2d4129630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d359e700 1 -- 172.21.15.3:0/3498323625 reap_dead start 2021-05-26T16:41:48.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d359e700 1 -- 172.21.15.3:0/3498323625 reap_dead start 2021-05-26T16:41:48.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 shutdown_connections 2021-05-26T16:41:48.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 >> 172.21.15.3:0/3498323625 conn(0x7fa2d409cc00 msgr2=0x7fa2d4098c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:48.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 shutdown_connections 2021-05-26T16:41:48.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.705+0000 7fa2d9238700 1 -- 172.21.15.3:0/3498323625 wait complete. 2021-05-26T16:41:48.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2021-05-26T16:41:48.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.941+0000 7f04bd914700 10 monclient: get_monmap_and_config 2021-05-26T16:41:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.941+0000 7f04bd914700 10 monclient: build_initial_monmap 2021-05-26T16:41:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.941+0000 7f04bd914700 10 monclient: monmap: 2021-05-26T16:41:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:48.942194+0000 2021-05-26T16:41:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:48.942194+0000 2021-05-26T16:41:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:48.948 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 1 Processor -- start 2021-05-26T16:41:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 1 -- start start 2021-05-26T16:41:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient: init 2021-05-26T16:41:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient: _add_conns ranks=[7,1,6,0,2,4,5,8,3] 2021-05-26T16:41:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient(hunting): picked mon.noname-i con 0x7f04b812cbd0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient(hunting): picked mon.noname-f con 0x7f04b8099a30 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient(hunting): picked mon.noname-d con 0x7f04b8099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b8046600 con 0x7f04b8099a30 2021-05-26T16:41:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b809b5e0 con 0x7f04b8099eb0 2021-05-26T16:41:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b812d8f0 con 0x7f04b812cbd0 2021-05-26T16:41:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd914700 10 monclient(hunting): authenticate will time out at 866.573847s 2021-05-26T16:41:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bc912700 1 -- >> v1:172.21.15.137:6792/0 conn(0x7f04b812cbd0 legacy=0x7f04b812d1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.942+0000 7f04bd113700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f04b8099eb0 0x7f04b8135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57218/0 (socket says 172.21.15.3:57218) 2021-05-26T16:41:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.943+0000 7f04bd113700 1 -- 172.21.15.3:0/718944436 learned_addr learned my addr 172.21.15.3:0/718944436 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04bd113700 1 -- 172.21.15.3:0/718944436 >> v1:172.21.15.3:6792/0 conn(0x7f04b8099eb0 legacy=0x7f04b8135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196344914 0 0) 0x7f04b809b5e0 con 0x7f04b8099eb0 2021-05-26T16:41:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient(hunting): my global_id is 4479 2021-05-26T16:41:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a4003270 con 0x7f04b8099eb0 2021-05-26T16:41:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04affff700 1 -- 172.21.15.3:0/718944436 >> v1:172.21.15.137:6789/0 conn(0x7f04b8099a30 legacy=0x7f04b8131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1066123241 0 0) 0x7f04a4003270 con 0x7f04b8099eb0 2021-05-26T16:41:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 >> v1:172.21.15.137:6792/0 conn(0x7f04b812cbd0 legacy=0x7f04b812d1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 >> v1:172.21.15.137:6789/0 conn(0x7f04b8099a30 legacy=0x7f04b8131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:41:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 monclient: found mon.noname-d 2021-05-26T16:41:48.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:48.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:48.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b809c2b0 con 0x7f04b8099eb0 2021-05-26T16:41:48.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: _finish_auth 0 2021-05-26T16:41:48.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04bd914700 5 monclient: authenticate success, global_id 4479 2021-05-26T16:41:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04bd914700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f04b4001de0 con 0x7f04b8099eb0 2021-05-26T16:41:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: dump: 2021-05-26T16:41:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.972 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04bd914700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f04b40020f0 con 0x7f04b8099eb0 2021-05-26T16:41:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04bd914700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04bd914700 4 set_mon_vals no callback set 2021-05-26T16:41:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 1 -- 172.21.15.3:0/718944436 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f04b4004d30 con 0x7f04b8099eb0 2021-05-26T16:41:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.945+0000 7f04af7fe700 10 monclient: dump: 2021-05-26T16:41:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.976 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.976 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.976 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.976 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.976 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.977 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.977 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.977 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.977 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 10 monclient: shutdown 2021-05-26T16:41:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 1 -- 172.21.15.3:0/718944436 >> v1:172.21.15.3:6792/0 conn(0x7f04b8099eb0 legacy=0x7f04b8135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 1 -- 172.21.15.3:0/718944436 shutdown_connections 2021-05-26T16:41:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 1 -- 172.21.15.3:0/718944436 >> 172.21.15.3:0/718944436 conn(0x7f04b80a00c0 msgr2=0x7f04b80a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 1 -- 172.21.15.3:0/718944436 shutdown_connections 2021-05-26T16:41:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 1 -- 172.21.15.3:0/718944436 wait complete. 2021-05-26T16:41:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 10 monclient: build_initial_monmap 2021-05-26T16:41:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.946+0000 7f04bd914700 10 monclient: monmap: 2021-05-26T16:41:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:48.983 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 1 Processor -- start 2021-05-26T16:41:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 1 -- start start 2021-05-26T16:41:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient: init 2021-05-26T16:41:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient: _add_conns ranks=[3,4,1,0,2,6,5,8,7] 2021-05-26T16:41:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient(hunting): picked mon.noname-g con 0x7f04b8099a30 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient(hunting): picked mon.noname-c con 0x7f04b8099eb0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient(hunting): picked mon.noname-f con 0x7f04b812cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b809b850 con 0x7f04b812cbd0 2021-05-26T16:41:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b81176d0 con 0x7f04b8099a30 2021-05-26T16:41:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b8116ba0 con 0x7f04b8099eb0 2021-05-26T16:41:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04bd914700 10 monclient(hunting): authenticate will time out at 866.578698s 2021-05-26T16:41:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04affff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f04b8099eb0 0x7f04b813c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37334/0 (socket says 172.21.15.3:37334) 2021-05-26T16:41:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.947+0000 7f04affff700 1 -- 172.21.15.3:0/2050923397 learned_addr learned my addr 172.21.15.3:0/2050923397 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.949+0000 7f04affff700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6791/0 conn(0x7f04b8099eb0 legacy=0x7f04b813c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604215394 0 0) 0x7f04b8116ba0 con 0x7f04b8099eb0 2021-05-26T16:41:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): my global_id is 4558 2021-05-26T16:41:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0498003270 con 0x7f04b8099eb0 2021-05-26T16:41:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd113700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.137:6789/0 conn(0x7f04b812cbd0 legacy=0x7f04b8143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bc912700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.137:6790/0 conn(0x7f04b8099a30 legacy=0x7f04b813bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2166651415 0 0) 0x7f0498003270 con 0x7f04b8099eb0 2021-05-26T16:41:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f04b8116ba0 con 0x7f04b8099eb0 2021-05-26T16:41:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f04a0001d40 con 0x7f04b8099eb0 2021-05-26T16:41:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): dump: 2021-05-26T16:41:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:48.991 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:48.991 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:48.991 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:48.991 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:48.991 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:48.992 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239867570 0 0) 0x7f04b809b850 con 0x7f04b812cbd0 2021-05-26T16:41:48.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): my global_id is 4447 2021-05-26T16:41:48.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0498003270 con 0x7f04b812cbd0 2021-05-26T16:41:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209909217 0 0) 0x7f04b81176d0 con 0x7f04b8099a30 2021-05-26T16:41:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient(hunting): my global_id is 4494 2021-05-26T16:41:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b809b850 con 0x7f04b8099a30 2021-05-26T16:41:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 458883028 0 0) 0x7f04b8116ba0 con 0x7f04b8099eb0 2021-05-26T16:41:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.137:6790/0 conn(0x7f04b8099a30 legacy=0x7f04b813bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.137:6789/0 conn(0x7f04b812cbd0 legacy=0x7f04b8143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient: _finish_hunting 0 2021-05-26T16:41:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 monclient: found mon.c 2021-05-26T16:41:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8116e40 con 0x7f04b8099eb0 2021-05-26T16:41:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient: _finish_auth 0 2021-05-26T16:41:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd914700 5 monclient: authenticate success, global_id 4558 2021-05-26T16:41:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd914700 10 monclient: _renew_subs 2021-05-26T16:41:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd914700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b8095300 con 0x7f04b8099eb0 2021-05-26T16:41:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd914700 10 monclient: _renew_subs 2021-05-26T16:41:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd914700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b8095fa0 con 0x7f04b8099eb0 2021-05-26T16:41:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f04a00024e0 con 0x7f04b8099eb0 2021-05-26T16:41:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f04a0002990 con 0x7f04b8099eb0 2021-05-26T16:41:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04aeffd700 4 set_mon_vals no callback set 2021-05-26T16:41:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.950+0000 7f04acff9700 10 monclient: dump: 2021-05-26T16:41:49.000 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.000 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.000 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.000 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.000 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.003 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.951+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f04a0002b70 con 0x7f04b8099eb0 2021-05-26T16:41:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.951+0000 7f04bd914700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.951+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f04900065a0 con 0x7f0490002840 2021-05-26T16:41:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.951+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 3941+0+0 (unknown 2454852892 0 0) 0x7f04a003dab0 con 0x7f04b8099eb0 2021-05-26T16:41:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.951+0000 7f04bd113700 10 monclient: get_auth_request con 0x7f0498032be0 auth_method 0 2021-05-26T16:41:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.953+0000 7f04bc912700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6792/0 conn(0x7f0490002840 legacy=0x7f0490004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112873037 0 0) 0x7f04900065a0 con 0x7f0490002840 2021-05-26T16:41:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient(hunting): my global_id is 4488 2021-05-26T16:41:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b8116ba0 con 0x7f0490002840 2021-05-26T16:41:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2377807980 0 0) 0x7f04b8116ba0 con 0x7f0490002840 2021-05-26T16:41:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f04900065a0 con 0x7f0490002840 2021-05-26T16:41:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f04a8004180 con 0x7f0490002840 2021-05-26T16:41:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient: dump: 2021-05-26T16:41:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.010 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2156714924 0 0) 0x7f04900065a0 con 0x7f0490002840 2021-05-26T16:41:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0490009e40 con 0x7f0490002840 2021-05-26T16:41:49.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f04a8006490 con 0x7f0490002840 2021-05-26T16:41:49.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:49.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6792/0 conn(0x7f0490002840 legacy=0x7f0490004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.954+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6792/0 conn(0x7f0490002840 legacy=0x7f0490004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.961+0000 7f04bd914700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:49.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.961+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f0490007510 con 0x7f04900068b0 2021-05-26T16:41:49.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.963+0000 7f04bc912700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6792/0 conn(0x7f04900068b0 legacy=0x7f0490006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509489978 0 0) 0x7f0490007510 con 0x7f04900068b0 2021-05-26T16:41:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient(hunting): my global_id is 4497 2021-05-26T16:41:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04900065a0 con 0x7f04900068b0 2021-05-26T16:41:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2058634273 0 0) 0x7f04900065a0 con 0x7f04900068b0 2021-05-26T16:41:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0490007510 con 0x7f04900068b0 2021-05-26T16:41:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f04a8004c70 con 0x7f04900068b0 2021-05-26T16:41:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:49.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient: dump: 2021-05-26T16:41:49.017 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.017 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.017 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.017 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.018 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.018 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.018 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.018 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.018 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.020 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.020 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.020 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.020 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3837820037 0 0) 0x7f0490007510 con 0x7f04900068b0 2021-05-26T16:41:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 --> v1:172.21.15.3:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0490008770 con 0x7f04900068b0 2021-05-26T16:41:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7289 (unknown 0 0 3296513899) 0x7f04a80062c0 con 0x7f04900068b0 2021-05-26T16:41:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6792/0 conn(0x7f04900068b0 legacy=0x7f0490006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.964+0000 7f04acff9700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6792/0 conn(0x7f04900068b0 legacy=0x7f0490006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.022 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 10, 2021-05-26T16:41:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: 6 2021-05-26T16:41:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:41:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.040 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.040 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.040 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.040 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.043 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.043 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.043 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.044 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.044 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.044 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.044 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.045 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:49.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:49.045 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.045 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.046 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.046 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.046 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:49.046 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.047 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.047 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.047 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.047 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.048 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.048 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.048 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.048 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:49.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:49.049 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.049 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.049 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.050 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.050 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:49.050 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.050 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.050 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.051 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.051 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.051 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.051 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.052 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.052 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:49.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:49.053 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.053 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.053 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.053 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.054 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:49.054 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.054 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.054 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.055 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.055 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.055 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.055 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.055 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.056 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:49.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:49.056 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.057 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.057 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.057 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.057 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:49.057 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.058 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.058 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.058 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.059 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.059 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.059 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.059 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.060 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:49.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:49.060 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.060 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.061 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.061 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.061 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:49.061 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.061 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.062 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.062 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.062 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.062 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.063 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.063 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.063 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:49.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:49.064 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.064 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.064 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.065 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.065 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:49.065 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.065 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.065 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.066 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.066 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.066 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.066 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.067 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.067 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.067 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:49.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:49.068 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.068 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.068 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.068 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.068 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:49.069 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.069 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.069 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.069 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.070 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.070 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.070 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.070 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.071 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.071 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.071 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:49.071 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:49.075 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:49.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.137:6812/30003 conn(0x7f0498032be0 legacy=0x7f04980350a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 10 monclient: shutdown 2021-05-26T16:41:49.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:49.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 >> v1:172.21.15.3:6791/0 conn(0x7f04b8099eb0 legacy=0x7f04b813c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd113700 1 -- 172.21.15.3:0/2050923397 reap_dead start 2021-05-26T16:41:49.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd113700 1 -- 172.21.15.3:0/2050923397 reap_dead start 2021-05-26T16:41:49.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 shutdown_connections 2021-05-26T16:41:49.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 >> 172.21.15.3:0/2050923397 conn(0x7f04b80a00c0 msgr2=0x7f04b812b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:49.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 shutdown_connections 2021-05-26T16:41:49.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:48.965+0000 7f04bd914700 1 -- 172.21.15.3:0/2050923397 wait complete. 2021-05-26T16:41:49.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2021-05-26T16:41:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.193+0000 7f2da85e8700 10 monclient: get_monmap_and_config 2021-05-26T16:41:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.193+0000 7f2da85e8700 10 monclient: build_initial_monmap 2021-05-26T16:41:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.193+0000 7f2da85e8700 10 monclient: monmap: 2021-05-26T16:41:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:49.193718+0000 2021-05-26T16:41:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:49.193718+0000 2021-05-26T16:41:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:49.200 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.193+0000 7f2da85e8700 1 Processor -- start 2021-05-26T16:41:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.193+0000 7f2da85e8700 1 -- start start 2021-05-26T16:41:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.193+0000 7f2da85e8700 10 monclient: init 2021-05-26T16:41:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 10 monclient: _add_conns ranks=[1,3,6,0,8,7,2,4,5] 2021-05-26T16:41:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 10 monclient(hunting): picked mon.noname-f con 0x7f2da0064a20 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 10 monclient(hunting): picked mon.noname-g con 0x7f2da0063e30 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 10 monclient(hunting): picked mon.noname-d con 0x7f2da00642e0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da0059750 con 0x7f2da0064a20 2021-05-26T16:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da0064e00 con 0x7f2da0063e30 2021-05-26T16:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da009c770 con 0x7f2da00642e0 2021-05-26T16:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da85e8700 10 monclient(hunting): authenticate will time out at 866.825358s 2021-05-26T16:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da6b85700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f2da00642e0 0x7f2da01357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57236/0 (socket says 172.21.15.3:57236) 2021-05-26T16:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.194+0000 7f2da6b85700 1 -- 172.21.15.3:0/31282396 learned_addr learned my addr 172.21.15.3:0/31282396 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.196+0000 7f2da6b85700 1 -- 172.21.15.3:0/31282396 >> v1:172.21.15.3:6792/0 conn(0x7f2da00642e0 legacy=0x7f2da01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.196+0000 7f2da6384700 1 -- 172.21.15.3:0/31282396 >> v1:172.21.15.137:6789/0 conn(0x7f2da0064a20 legacy=0x7f2da0099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5b83700 1 -- 172.21.15.3:0/31282396 >> v1:172.21.15.137:6790/0 conn(0x7f2da0063e30 legacy=0x7f2da0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167824671 0 0) 0x7f2da0059750 con 0x7f2da0064a20 2021-05-26T16:41:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient(hunting): my global_id is 4456 2021-05-26T16:41:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d88003270 con 0x7f2da0064a20 2021-05-26T16:41:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2079346723 0 0) 0x7f2d88003270 con 0x7f2da0064a20 2021-05-26T16:41:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 >> v1:172.21.15.3:6792/0 conn(0x7f2da00642e0 legacy=0x7f2da01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 >> v1:172.21.15.137:6790/0 conn(0x7f2da0063e30 legacy=0x7f2da0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: _finish_hunting 0 2021-05-26T16:41:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 monclient: found mon.noname-f 2021-05-26T16:41:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.137:6789/0 2021-05-26T16:41:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00977a0 con 0x7f2da0064a20 2021-05-26T16:41:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: _finish_auth 0 2021-05-26T16:41:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da85e8700 5 monclient: authenticate success, global_id 4456 2021-05-26T16:41:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2d94001b70 con 0x7f2da0064a20 2021-05-26T16:41:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2021-05-26T16:41:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: dump: 2021-05-26T16:41:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.225 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da85e8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 <== mon.1 v1:172.21.15.137:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2d94001f00 con 0x7f2da0064a20 2021-05-26T16:41:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 1 -- 172.21.15.3:0/31282396 <== mon.1 v1:172.21.15.137:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2d940023b0 con 0x7f2da0064a20 2021-05-26T16:41:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da85e8700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da85e8700 4 set_mon_vals no callback set 2021-05-26T16:41:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.197+0000 7f2da5382700 10 monclient: dump: 2021-05-26T16:41:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.230 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 10 monclient: shutdown 2021-05-26T16:41:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 1 -- 172.21.15.3:0/31282396 >> v1:172.21.15.137:6789/0 conn(0x7f2da0064a20 legacy=0x7f2da0099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 1 -- 172.21.15.3:0/31282396 shutdown_connections 2021-05-26T16:41:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 1 -- 172.21.15.3:0/31282396 >> 172.21.15.3:0/31282396 conn(0x7f2da00a0db0 msgr2=0x7f2da009cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 1 -- 172.21.15.3:0/31282396 shutdown_connections 2021-05-26T16:41:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 1 -- 172.21.15.3:0/31282396 wait complete. 2021-05-26T16:41:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 10 monclient: build_initial_monmap 2021-05-26T16:41:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.198+0000 7f2da85e8700 10 monclient: monmap: 2021-05-26T16:41:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:49.235 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:49.235 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.235 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:49.240 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.240 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 1 Processor -- start 2021-05-26T16:41:49.240 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 1 -- start start 2021-05-26T16:41:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient: init 2021-05-26T16:41:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient: _add_conns ranks=[3,6,4,2,0,8,1,7,5] 2021-05-26T16:41:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient(hunting): picked mon.noname-g con 0x7f2da0063e30 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient(hunting): picked mon.noname-d con 0x7f2da00642e0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient(hunting): picked mon.noname-c con 0x7f2da0064a20 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da009c180 con 0x7f2da0063e30 2021-05-26T16:41:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da013d120 con 0x7f2da0064a20 2021-05-26T16:41:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da00959e0 con 0x7f2da00642e0 2021-05-26T16:41:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da85e8700 10 monclient(hunting): authenticate will time out at 866.830531s 2021-05-26T16:41:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da5b83700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f2da00642e0 0x7f2da0141520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57238/0 (socket says 172.21.15.3:57238) 2021-05-26T16:41:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.199+0000 7f2da5b83700 1 -- 172.21.15.3:0/2427914973 learned_addr learned my addr 172.21.15.3:0/2427914973 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.201+0000 7f2da6b85700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.3:6791/0 conn(0x7f2da0064a20 legacy=0x7f2da0144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.201+0000 7f2da5b83700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.3:6792/0 conn(0x7f2da00642e0 legacy=0x7f2da0141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da6384700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6790/0 conn(0x7f2da0063e30 legacy=0x7f2da0129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476553021 0 0) 0x7f2da013d120 con 0x7f2da0064a20 2021-05-26T16:41:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient(hunting): my global_id is 4567 2021-05-26T16:41:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d80003270 con 0x7f2da0064a20 2021-05-26T16:41:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 490033279 0 0) 0x7f2d80003270 con 0x7f2da0064a20 2021-05-26T16:41:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2da013d120 con 0x7f2da0064a20 2021-05-26T16:41:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2d9c002050 con 0x7f2da0064a20 2021-05-26T16:41:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient(hunting): dump: 2021-05-26T16:41:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.251 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2674410268 0 0) 0x7f2da013d120 con 0x7f2da0064a20 2021-05-26T16:41:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.3:6792/0 conn(0x7f2da00642e0 legacy=0x7f2da0141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6790/0 conn(0x7f2da0063e30 legacy=0x7f2da0129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:41:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 monclient: found mon.c 2021-05-26T16:41:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0116eb0 con 0x7f2da0064a20 2021-05-26T16:41:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient: _finish_auth 0 2021-05-26T16:41:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da85e8700 5 monclient: authenticate success, global_id 4567 2021-05-26T16:41:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da85e8700 10 monclient: _renew_subs 2021-05-26T16:41:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da85e8700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da0117150 con 0x7f2da0064a20 2021-05-26T16:41:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da85e8700 10 monclient: _renew_subs 2021-05-26T16:41:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da85e8700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:41:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da0131700 con 0x7f2da0064a20 2021-05-26T16:41:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2d9c004ce0 con 0x7f2da0064a20 2021-05-26T16:41:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2d9c005190 con 0x7f2da0064a20 2021-05-26T16:41:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2da4b81700 4 set_mon_vals no callback set 2021-05-26T16:41:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.202+0000 7f2d8e7fc700 10 monclient: dump: 2021-05-26T16:41:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.261 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.203+0000 7f2da85e8700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.203+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f2d9c005370 con 0x7f2da0064a20 2021-05-26T16:41:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.203+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2d840065a0 con 0x7f2d84002840 2021-05-26T16:41:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.203+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 3941+0+0 (unknown 2454852892 0 0) 0x7f2d9c03dd40 con 0x7f2da0064a20 2021-05-26T16:41:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.203+0000 7f2da5b83700 10 monclient: get_auth_request con 0x7f2d800328a0 auth_method 0 2021-05-26T16:41:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.205+0000 7f2da6384700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6789/0 conn(0x7f2d84002840 legacy=0x7f2d84004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838539320 0 0) 0x7f2d840065a0 con 0x7f2d84002840 2021-05-26T16:41:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 10 monclient(hunting): my global_id is 4465 2021-05-26T16:41:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da013d120 con 0x7f2d84002840 2021-05-26T16:41:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 856193645 0 0) 0x7f2da013d120 con 0x7f2d84002840 2021-05-26T16:41:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2d840065a0 con 0x7f2d84002840 2021-05-26T16:41:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2d940023b0 con 0x7f2d84002840 2021-05-26T16:41:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 10 monclient: dump: 2021-05-26T16:41:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.268 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 29198685 0 0) 0x7f2d840065a0 con 0x7f2d84002840 2021-05-26T16:41:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d84009e40 con 0x7f2d84002840 2021-05-26T16:41:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.206+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f2d940019e0 con 0x7f2d84002840 2021-05-26T16:41:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.207+0000 7f2d8e7fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.207+0000 7f2d8e7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.207+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6789/0 conn(0x7f2d84002840 legacy=0x7f2d84004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.207+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6789/0 conn(0x7f2d84002840 legacy=0x7f2d84004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.213+0000 7f2da85e8700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.213+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2d84009ad0 con 0x7f2d84008d90 2021-05-26T16:41:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2da6384700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6789/0 conn(0x7f2d84008d90 legacy=0x7f2d84009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167150157 0 0) 0x7f2d84009ad0 con 0x7f2d84008d90 2021-05-26T16:41:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 10 monclient(hunting): my global_id is 4474 2021-05-26T16:41:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d840065a0 con 0x7f2d84008d90 2021-05-26T16:41:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3818046033 0 0) 0x7f2d840065a0 con 0x7f2d84008d90 2021-05-26T16:41:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2d84009ad0 con 0x7f2d84008d90 2021-05-26T16:41:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2d94002b30 con 0x7f2d84008d90 2021-05-26T16:41:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:41:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 10 monclient: dump: 2021-05-26T16:41:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.279 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2525620060 0 0) 0x7f2d84009ad0 con 0x7f2d84008d90 2021-05-26T16:41:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.216+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 --> v1:172.21.15.137:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2d84008740 con 0x7f2d84008d90 2021-05-26T16:41:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7291 (unknown 0 0 882823992) 0x7f2d94005510 con 0x7f2d84008d90 2021-05-26T16:41:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2d8e7fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2d8e7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6789/0 conn(0x7f2d84008d90 legacy=0x7f2d84009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2d8e7fc700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6789/0 conn(0x7f2d84008d90 legacy=0x7f2d84009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.282 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:49.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:49.282 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:49.283 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "leader", 2021-05-26T16:41:49.283 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 10, 2021-05-26T16:41:49.283 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: 6 2021-05-26T16:41:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:41:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.292 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.292 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:49.293 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:49.293 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:49.293 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:49.293 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:49.294 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:49.294 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.294 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.295 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:49.295 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:49.295 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:49.295 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:49.296 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:49.296 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.296 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:49.296 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.296 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.297 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.297 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.297 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.298 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.298 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.298 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.298 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.298 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.299 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:49.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.299 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:49.299 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.300 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:49.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:49.300 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.300 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.300 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.301 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.301 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:49.301 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.301 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.302 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.302 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.302 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.303 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.303 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.303 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.303 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.304 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:49.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:49.304 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.304 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.304 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.305 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.305 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:49.305 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.305 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.306 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.306 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.306 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.307 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.307 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.307 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.308 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.308 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:49.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:49.308 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.309 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.309 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.309 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.309 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:49.310 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.310 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.310 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.310 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.311 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.311 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.311 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.311 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.312 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.312 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:49.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:49.312 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.313 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.313 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.313 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.313 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:49.313 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.314 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.314 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.314 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.315 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.315 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.315 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.315 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.316 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.316 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:49.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:49.316 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.317 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.317 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.317 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.317 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:49.317 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.318 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.318 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.318 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.318 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.319 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.319 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.319 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.319 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.320 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:49.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:49.320 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.320 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.321 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.321 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.321 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:49.321 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.322 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.322 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.322 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.323 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.323 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.323 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.323 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.324 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.324 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:49.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:49.324 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.324 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.325 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.325 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.325 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:49.325 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.326 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.326 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.326 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.326 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.327 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.327 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.327 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.328 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.328 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:49.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:49.328 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.328 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.329 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.329 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.329 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:49.329 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.330 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.330 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.330 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.330 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.331 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.331 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.331 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.332 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.332 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:49.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:49.332 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.332 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.333 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.333 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.333 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:49.333 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.333 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.334 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.334 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.335 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.335 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.336 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.336 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.336 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.336 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.337 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:49.337 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:49.337 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.338 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.338 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.338 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:49.338 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.339 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.339 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:49.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.339 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.339 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.340 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:41:49.340 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.340 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.340 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:49.341 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.137:6812/30003 conn(0x7f2d800328a0 legacy=0x7f2d80034d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 10 monclient: shutdown 2021-05-26T16:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 >> v1:172.21.15.3:6791/0 conn(0x7f2da0064a20 legacy=0x7f2da0144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da6b85700 1 -- 172.21.15.3:0/2427914973 reap_dead start 2021-05-26T16:41:49.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da6b85700 1 -- 172.21.15.3:0/2427914973 reap_dead start 2021-05-26T16:41:49.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 shutdown_connections 2021-05-26T16:41:49.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 >> 172.21.15.3:0/2427914973 conn(0x7f2da00a0db0 msgr2=0x7f2da0099e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:49.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 shutdown_connections 2021-05-26T16:41:49.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.217+0000 7f2da85e8700 1 -- 172.21.15.3:0/2427914973 wait complete. 2021-05-26T16:41:49.345 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2021-05-26T16:41:49.349 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:49.349 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33087]: starting. 2021-05-26T16:41:49.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33087]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33052 2021-05-26T16:41:49.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33087]: created object 0... 2021-05-26T16:41:49.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33087]: created object 25... 2021-05-26T16:41:49.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33087]: created object 49... 2021-05-26T16:41:49.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33087]: finishing. 2021-05-26T16:41:49.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33087]: shutting down. 2021-05-26T16:41:49.389 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:49.389 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33089]: starting. 2021-05-26T16:41:49.390 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33089]: listing objects. 2021-05-26T16:41:49.390 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33089]: listed object 0... 2021-05-26T16:41:49.390 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33089]: listed object 25... 2021-05-26T16:41:49.390 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33089]: saw 50 objects 2021-05-26T16:41:49.391 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33089]: shutting down. 2021-05-26T16:41:49.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.460+0000 7f297d76b700 10 monclient: get_monmap_and_config 2021-05-26T16:41:49.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.460+0000 7f297d76b700 10 monclient: build_initial_monmap 2021-05-26T16:41:49.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.460+0000 7f297d76b700 10 monclient: monmap: 2021-05-26T16:41:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:49.460954+0000 2021-05-26T16:41:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:49.460954+0000 2021-05-26T16:41:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:49.467 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:49.467 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.460+0000 7f297d76b700 1 Processor -- start 2021-05-26T16:41:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.460+0000 7f297d76b700 1 -- start start 2021-05-26T16:41:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.460+0000 7f297d76b700 10 monclient: init 2021-05-26T16:41:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 10 monclient: _add_conns ranks=[4,6,1,0,8,7,3,2,5] 2021-05-26T16:41:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 10 monclient(hunting): picked mon.noname-c con 0x7f2978096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 10 monclient(hunting): picked mon.noname-d con 0x7f297812d460 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 10 monclient(hunting): picked mon.noname-f con 0x7f297812d910 addr v1:172.21.15.137:6789/0 2021-05-26T16:41:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2978059750 con 0x7f297812d910 2021-05-26T16:41:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297809c760 con 0x7f2978096ca0 2021-05-26T16:41:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297809ca00 con 0x7f297812d460 2021-05-26T16:41:49.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f297d76b700 10 monclient(hunting): authenticate will time out at 867.092560s 2021-05-26T16:41:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f29767fc700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f297812d460 0x7f29781320e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57250/0 (socket says 172.21.15.3:57250) 2021-05-26T16:41:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f2976ffd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f2978096ca0 0x7f297812cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37362/0 (socket says 172.21.15.3:37362) 2021-05-26T16:41:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.461+0000 7f29767fc700 1 -- 172.21.15.3:0/2174164824 learned_addr learned my addr 172.21.15.3:0/2174164824 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.463+0000 7f29767fc700 1 -- 172.21.15.3:0/2174164824 >> v1:172.21.15.3:6792/0 conn(0x7f297812d460 legacy=0x7f29781320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.463+0000 7f2976ffd700 1 -- 172.21.15.3:0/2174164824 >> v1:172.21.15.3:6791/0 conn(0x7f2978096ca0 legacy=0x7f297812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.463+0000 7f29777fe700 1 -- 172.21.15.3:0/2174164824 >> v1:172.21.15.137:6789/0 conn(0x7f297812d910 legacy=0x7f2978135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694071099 0 0) 0x7f297809c760 con 0x7f2978096ca0 2021-05-26T16:41:49.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): my global_id is 4576 2021-05-26T16:41:49.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2964003270 con 0x7f2978096ca0 2021-05-26T16:41:49.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943476298 0 0) 0x7f297809ca00 con 0x7f297812d460 2021-05-26T16:41:49.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): my global_id is 4506 2021-05-26T16:41:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297809c760 con 0x7f297812d460 2021-05-26T16:41:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564199929 0 0) 0x7f2978059750 con 0x7f297812d910 2021-05-26T16:41:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient(hunting): my global_id is 4483 2021-05-26T16:41:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297809ca00 con 0x7f297812d910 2021-05-26T16:41:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842322960 0 0) 0x7f297809c760 con 0x7f297812d460 2021-05-26T16:41:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 >> v1:172.21.15.3:6791/0 conn(0x7f2978096ca0 legacy=0x7f297812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 >> v1:172.21.15.137:6789/0 conn(0x7f297812d910 legacy=0x7f2978135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 monclient: found mon.noname-d 2021-05-26T16:41:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:41:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978097730 con 0x7f297812d460 2021-05-26T16:41:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f296c001a60 con 0x7f297812d460 2021-05-26T16:41:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: dump: 2021-05-26T16:41:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.494 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 5 monclient: authenticate success, global_id 4506 2021-05-26T16:41:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f296c001d70 con 0x7f297812d460 2021-05-26T16:41:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 1 -- 172.21.15.3:0/2174164824 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f296c004930 con 0x7f297812d460 2021-05-26T16:41:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 4 set_mon_vals no callback set 2021-05-26T16:41:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f2975ffb700 10 monclient: dump: 2021-05-26T16:41:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.499 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 10 monclient: shutdown 2021-05-26T16:41:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 1 -- 172.21.15.3:0/2174164824 >> v1:172.21.15.3:6792/0 conn(0x7f297812d460 legacy=0x7f29781320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.464+0000 7f297d76b700 1 -- 172.21.15.3:0/2174164824 shutdown_connections 2021-05-26T16:41:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.465+0000 7f297d76b700 1 -- 172.21.15.3:0/2174164824 >> 172.21.15.3:0/2174164824 conn(0x7f29780a00e0 msgr2=0x7f29780a04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.465+0000 7f297d76b700 1 -- 172.21.15.3:0/2174164824 shutdown_connections 2021-05-26T16:41:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.465+0000 7f297d76b700 1 -- 172.21.15.3:0/2174164824 wait complete. 2021-05-26T16:41:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.465+0000 7f297d76b700 10 monclient: build_initial_monmap 2021-05-26T16:41:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.465+0000 7f297d76b700 10 monclient: monmap: 2021-05-26T16:41:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:49.505 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 1 Processor -- start 2021-05-26T16:41:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 1 -- start start 2021-05-26T16:41:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient: init 2021-05-26T16:41:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient: _add_conns ranks=[6,7,3,5,0,8,2,4,1] 2021-05-26T16:41:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient(hunting): picked mon.noname-d con 0x7f2978096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:41:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient(hunting): picked mon.noname-i con 0x7f297812d460 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient(hunting): picked mon.noname-g con 0x7f297812d910 addr v1:172.21.15.137:6790/0 2021-05-26T16:41:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2978119ba0 con 0x7f297812d910 2021-05-26T16:41:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2978119e40 con 0x7f2978096ca0 2021-05-26T16:41:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297811a0e0 con 0x7f297812d460 2021-05-26T16:41:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f297d76b700 10 monclient(hunting): authenticate will time out at 867.097515s 2021-05-26T16:41:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f2976ffd700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f2978096ca0 0x7f297813c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57256/0 (socket says 172.21.15.3:57256) 2021-05-26T16:41:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f2976ffd700 1 -- 172.21.15.3:0/2216136911 learned_addr learned my addr 172.21.15.3:0/2216136911 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.466+0000 7f29767fc700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6792/0 conn(0x7f297812d460 legacy=0x7f2978141080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.468+0000 7f2976ffd700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.3:6792/0 conn(0x7f2978096ca0 legacy=0x7f297813c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.468+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339817035 0 0) 0x7f2978119e40 con 0x7f2978096ca0 2021-05-26T16:41:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.468+0000 7f295effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.468+0000 7f295effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.468+0000 7f295effd700 10 monclient(hunting): my global_id is 4515 2021-05-26T16:41:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.468+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2958003270 con 0x7f2978096ca0 2021-05-26T16:41:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.468+0000 7f29777fe700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f297812d910 legacy=0x7f29781447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3975325286 0 0) 0x7f2958003270 con 0x7f2978096ca0 2021-05-26T16:41:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2978119e40 con 0x7f2978096ca0 2021-05-26T16:41:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2960001930 con 0x7f2978096ca0 2021-05-26T16:41:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:41:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient(hunting): dump: 2021-05-26T16:41:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.514 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086754165 0 0) 0x7f2978119ba0 con 0x7f297812d910 2021-05-26T16:41:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient(hunting): my global_id is 4503 2021-05-26T16:41:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2958003270 con 0x7f297812d910 2021-05-26T16:41:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2879734522 0 0) 0x7f2978119e40 con 0x7f2978096ca0 2021-05-26T16:41:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6792/0 conn(0x7f297812d460 legacy=0x7f2978141080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-05-26T16:41:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f297812d910 legacy=0x7f29781447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient: _finish_hunting 0 2021-05-26T16:41:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 monclient: found mon.d 2021-05-26T16:41:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978117f70 con 0x7f2978096ca0 2021-05-26T16:41:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient: _finish_auth 0 2021-05-26T16:41:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f297d76b700 5 monclient: authenticate success, global_id 4515 2021-05-26T16:41:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f297d76b700 10 monclient: _renew_subs 2021-05-26T16:41:49.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f297d76b700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:49.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2978129c20 con 0x7f2978096ca0 2021-05-26T16:41:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f297d76b700 10 monclient: _renew_subs 2021-05-26T16:41:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f297d76b700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:41:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f297813ccc0 con 0x7f2978096ca0 2021-05-26T16:41:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2960004c90 con 0x7f2978096ca0 2021-05-26T16:41:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2960005140 con 0x7f2978096ca0 2021-05-26T16:41:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:41:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f29757fa700 4 set_mon_vals no callback set 2021-05-26T16:41:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 10 monclient: dump: 2021-05-26T16:41:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.529 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.469+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f2960005320 con 0x7f2978096ca0 2021-05-26T16:41:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.470+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(20..20 src has 1..20) v4 ==== 3941+0+0 (unknown 861422478 0 0) 0x7f296003db70 con 0x7f2978096ca0 2021-05-26T16:41:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.470+0000 7f297d76b700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.470+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f29500065a0 con 0x7f2950002840 2021-05-26T16:41:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.470+0000 7f29767fc700 10 monclient: get_auth_request con 0x7f29580326f0 auth_method 0 2021-05-26T16:41:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.472+0000 7f29777fe700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f2950002840 legacy=0x7f2950004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.472+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640857243 0 0) 0x7f29500065a0 con 0x7f2950002840 2021-05-26T16:41:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient(hunting): my global_id is 4512 2021-05-26T16:41:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2978119e40 con 0x7f2950002840 2021-05-26T16:41:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4277509857 0 0) 0x7f2978119e40 con 0x7f2950002840 2021-05-26T16:41:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29500065a0 con 0x7f2950002840 2021-05-26T16:41:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2968001bd0 con 0x7f2950002840 2021-05-26T16:41:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient: dump: 2021-05-26T16:41:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.536 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 573901786 0 0) 0x7f29500065a0 con 0x7f2950002840 2021-05-26T16:41:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2950009e40 con 0x7f2950002840 2021-05-26T16:41:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f29680068e0 con 0x7f2950002840 2021-05-26T16:41:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f2950002840 legacy=0x7f2950004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.473+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f2950002840 legacy=0x7f2950004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.480+0000 7f297d76b700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.480+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2950007510 con 0x7f29500068b0 2021-05-26T16:41:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f29777fe700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f29500068b0 legacy=0x7f2950006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921939839 0 0) 0x7f2950007510 con 0x7f29500068b0 2021-05-26T16:41:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient(hunting): my global_id is 4521 2021-05-26T16:41:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29500065a0 con 0x7f29500068b0 2021-05-26T16:41:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2909691054 0 0) 0x7f29500065a0 con 0x7f29500068b0 2021-05-26T16:41:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2950007510 con 0x7f29500068b0 2021-05-26T16:41:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2968002af0 con 0x7f29500068b0 2021-05-26T16:41:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:41:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient: dump: 2021-05-26T16:41:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.546 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.546 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.546 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.546 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.547 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.547 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.547 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.548 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 672953489 0 0) 0x7f2950007510 con 0x7f29500068b0 2021-05-26T16:41:49.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 --> v1:172.21.15.137:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2950008770 con 0x7f29500068b0 2021-05-26T16:41:49.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7629 (unknown 0 0 4294925194) 0x7f2968002f90 con 0x7f29500068b0 2021-05-26T16:41:49.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:49.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:49.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f29500068b0 legacy=0x7f2950006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.483+0000 7f295effd700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6790/0 conn(0x7f29500068b0 legacy=0x7f2950006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.550 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:49.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:49.550 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:49.550 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:49.551 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 10, 2021-05-26T16:41:49.551 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:49.551 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:49.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:49.552 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:49.552 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:49.552 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:49.552 INFO:teuthology.orchestra.run.smithi003.stdout: 6 2021-05-26T16:41:49.552 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.553 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:41:49.553 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.553 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:49.553 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:49.554 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.554 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.554 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.554 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.554 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.555 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.555 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.555 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.555 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.556 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.556 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:49.556 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:49.556 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.556 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.557 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.557 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.557 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.557 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.558 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.558 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.558 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.558 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.559 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:49.559 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:49.559 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:49.559 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:49.559 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:49.560 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:49.560 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.560 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.561 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:49.561 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:49.561 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:49.561 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:49.562 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:49.562 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.562 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:49.562 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.563 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.563 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.563 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.563 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.563 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.564 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.564 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.564 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.564 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.564 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:49.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.565 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:49.565 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.565 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:49.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:49.566 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.566 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.566 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.567 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.567 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:49.567 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.567 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.568 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.568 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.568 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.569 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.569 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.569 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.569 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.570 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:49.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:49.570 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.570 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.571 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.571 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.571 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:49.571 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.571 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.572 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.572 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.572 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.573 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.573 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.573 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.573 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.574 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:49.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:49.574 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.574 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.574 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.575 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.575 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:49.575 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.575 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.576 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.576 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.576 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.576 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.577 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.577 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.577 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.577 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:49.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:49.578 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.578 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.578 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.579 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.579 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:49.579 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.579 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.579 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.580 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.580 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.580 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.580 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.581 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.581 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.581 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:49.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:49.582 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.582 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.582 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.582 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.583 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:49.583 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.583 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.583 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.584 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.584 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.584 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.584 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.585 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.585 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.585 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:49.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:49.586 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.586 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.586 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.586 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.586 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:49.587 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.587 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.587 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.588 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.588 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.588 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.588 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.588 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.589 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.589 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:49.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:49.590 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.590 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.590 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.590 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.590 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:49.591 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.591 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.591 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.592 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.592 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.592 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.592 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.592 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.593 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.593 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:49.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:49.594 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.594 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.594 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.594 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.594 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:49.595 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.595 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.595 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.595 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.596 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.596 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.596 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.596 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.597 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.597 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:49.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:49.597 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.598 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.598 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.598 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.598 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:49.599 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.599 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.599 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.599 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.600 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.600 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.600 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.600 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.601 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.601 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.601 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:49.601 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:49.602 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.602 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.602 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.602 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:49.603 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.603 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.603 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:41:49.603 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.603 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.604 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.604 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:41:49.604 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.604 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.605 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:49.605 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.605 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.605 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.605 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:49.606 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.606 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.606 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": [ 2021-05-26T16:41:49.606 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.607 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.607 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.607 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:49.607 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.607 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.608 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:49.608 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:49.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.137:6812/30003 conn(0x7f29580326f0 legacy=0x7f2958034bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 10 monclient: shutdown 2021-05-26T16:41:49.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:49.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 >> v1:172.21.15.3:6792/0 conn(0x7f2978096ca0 legacy=0x7f297813c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f29777fe700 1 -- 172.21.15.3:0/2216136911 reap_dead start 2021-05-26T16:41:49.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f29777fe700 1 -- 172.21.15.3:0/2216136911 reap_dead start 2021-05-26T16:41:49.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 shutdown_connections 2021-05-26T16:41:49.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 >> 172.21.15.3:0/2216136911 conn(0x7f29780a00e0 msgr2=0x7f297809ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:49.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 shutdown_connections 2021-05-26T16:41:49.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.484+0000 7f297d76b700 1 -- 172.21.15.3:0/2216136911 wait complete. 2021-05-26T16:41:49.613 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2021-05-26T16:41:49.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.727+0000 7f108810b700 10 monclient: get_monmap_and_config 2021-05-26T16:41:49.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.727+0000 7f108810b700 10 monclient: build_initial_monmap 2021-05-26T16:41:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.727+0000 7f108810b700 10 monclient: monmap: 2021-05-26T16:41:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:41:49.727778+0000 2021-05-26T16:41:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:41:49.727778+0000 2021-05-26T16:41:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:49.733 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.727+0000 7f108810b700 1 Processor -- start 2021-05-26T16:41:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.727+0000 7f108810b700 1 -- start start 2021-05-26T16:41:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.727+0000 7f108810b700 10 monclient: init 2021-05-26T16:41:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 10 monclient: _add_conns ranks=[7,4,5,2,3,8,0,1,6] 2021-05-26T16:41:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 10 monclient(hunting): picked mon.noname-i con 0x7f1080064aa0 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 10 monclient(hunting): picked mon.noname-c con 0x7f1080099c40 addr v1:172.21.15.3:6791/0 2021-05-26T16:41:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 10 monclient(hunting): picked mon.noname-h con 0x7f108009a0c0 addr v1:172.21.15.137:6791/0 2021-05-26T16:41:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1080059750 con 0x7f1080099c40 2021-05-26T16:41:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108009a530 con 0x7f108009a0c0 2021-05-26T16:41:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108009c4e0 con 0x7f1080064aa0 2021-05-26T16:41:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f108810b700 10 monclient(hunting): authenticate will time out at 867.359424s 2021-05-26T16:41:49.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f10856a6700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f1080099c40 0x7f1080132070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37380/0 (socket says 172.21.15.3:37380) 2021-05-26T16:41:49.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f1085ea7700 1 -- >> v1:172.21.15.137:6792/0 conn(0x7f1080064aa0 legacy=0x7f1080063f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:49.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.728+0000 7f10856a6700 1 -- 172.21.15.3:0/3869541886 learned_addr learned my addr 172.21.15.3:0/3869541886 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:49.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.730+0000 7f10856a6700 1 -- 172.21.15.3:0/3869541886 >> v1:172.21.15.3:6791/0 conn(0x7f1080099c40 legacy=0x7f1080132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.730+0000 7f10866a8700 1 -- 172.21.15.3:0/3869541886 >> v1:172.21.15.137:6791/0 conn(0x7f108009a0c0 legacy=0x7f10801357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.730+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80411619 0 0) 0x7f1080059750 con 0x7f1080099c40 2021-05-26T16:41:49.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.730+0000 7f1084ea5700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.730+0000 7f1084ea5700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.730+0000 7f1084ea5700 10 monclient(hunting): my global_id is 4585 2021-05-26T16:41:49.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.730+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1068003270 con 0x7f1080099c40 2021-05-26T16:41:49.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717209085 0 0) 0x7f107c001820 con 0x7f108009a0c0 2021-05-26T16:41:49.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient(hunting): my global_id is 4595 2021-05-26T16:41:49.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1080059750 con 0x7f108009a0c0 2021-05-26T16:41:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230390952 0 0) 0x7f1068003270 con 0x7f1080099c40 2021-05-26T16:41:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 >> v1:172.21.15.137:6792/0 conn(0x7f1080064aa0 legacy=0x7f1080063f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:41:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 >> v1:172.21.15.137:6791/0 conn(0x7f108009a0c0 legacy=0x7f10801357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: _finish_hunting 0 2021-05-26T16:41:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 monclient: found mon.noname-c 2021-05-26T16:41:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:41:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108009c780 con 0x7f1080099c40 2021-05-26T16:41:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: _finish_auth 0 2021-05-26T16:41:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1070001a60 con 0x7f1080099c40 2021-05-26T16:41:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 5 monclient: authenticate success, global_id 4585 2021-05-26T16:41:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:41:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: dump: 2021-05-26T16:41:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.759 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:41:49.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1070001d70 con 0x7f1080099c40 2021-05-26T16:41:49.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:49.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 10 monclient: get_monmap_and_config success 2021-05-26T16:41:49.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 1 -- 172.21.15.3:0/3869541886 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1070004930 con 0x7f1080099c40 2021-05-26T16:41:49.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 4 set_mon_vals no callback set 2021-05-26T16:41:49.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:41:49.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f1084ea5700 10 monclient: dump: 2021-05-26T16:41:49.761 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.761 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.761 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.762 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.762 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.762 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.763 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.763 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.763 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.763 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.764 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.764 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.764 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.764 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.765 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.765 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 10 monclient: shutdown 2021-05-26T16:41:49.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:49.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 1 -- 172.21.15.3:0/3869541886 >> v1:172.21.15.3:6791/0 conn(0x7f1080099c40 legacy=0x7f1080132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 1 -- 172.21.15.3:0/3869541886 shutdown_connections 2021-05-26T16:41:49.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 1 -- 172.21.15.3:0/3869541886 >> 172.21.15.3:0/3869541886 conn(0x7f108005e1e0 msgr2=0x7f108009cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:49.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 1 -- 172.21.15.3:0/3869541886 shutdown_connections 2021-05-26T16:41:49.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.731+0000 7f108810b700 1 -- 172.21.15.3:0/3869541886 wait complete. 2021-05-26T16:41:49.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.732+0000 7f108810b700 10 monclient: build_initial_monmap 2021-05-26T16:41:49.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.732+0000 7f108810b700 10 monclient: monmap: 2021-05-26T16:41:49.768 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:41:49.768 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:41:49.769 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:41:49.769 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:41:49.769 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:41:49.769 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.770 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:41:49.770 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:41:49.770 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:41:49.770 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:41:49.771 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:41:49.771 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:41:49.771 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:41:49.771 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:41:49.771 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:41:49.772 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.732+0000 7f108810b700 1 Processor -- start 2021-05-26T16:41:49.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.732+0000 7f108810b700 1 -- start start 2021-05-26T16:41:49.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.732+0000 7f108810b700 10 monclient: init 2021-05-26T16:41:49.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 10 monclient: _reopen_session rank -1 2021-05-26T16:41:49.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 10 monclient: _add_conns ranks=[0,2,7,3,6,4,5,8,1] 2021-05-26T16:41:49.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 10 monclient(hunting): picked mon.noname-a con 0x7f1080099c40 addr v1:172.21.15.3:6789/0 2021-05-26T16:41:49.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 10 monclient(hunting): picked mon.noname-b con 0x7f108009a0c0 addr v1:172.21.15.3:6790/0 2021-05-26T16:41:49.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 10 monclient(hunting): picked mon.noname-i con 0x7f108011bd10 addr v1:172.21.15.137:6792/0 2021-05-26T16:41:49.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108011ce60 con 0x7f1080099c40 2021-05-26T16:41:49.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108011d100 con 0x7f108009a0c0 2021-05-26T16:41:49.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f1085ea7700 1 -- >> v1:172.21.15.3:6789/0 conn(0x7f1080099c40 legacy=0x7f108013c440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.3:6789/0 2021-05-26T16:41:49.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108011d3a0 con 0x7f108011bd10 2021-05-26T16:41:49.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 10 monclient(hunting): _renew_subs 2021-05-26T16:41:49.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f108810b700 10 monclient(hunting): authenticate will time out at 867.364238s 2021-05-26T16:41:49.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f10856a6700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f108009a0c0 0x7f10801410d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:53918/0 (socket says 172.21.15.3:53918) 2021-05-26T16:41:49.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f10856a6700 1 -- 172.21.15.3:0/2018059159 learned_addr learned my addr 172.21.15.3:0/2018059159 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:41:49.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.733+0000 7f10866a8700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6792/0 conn(0x7f108011bd10 legacy=0x7f1080144800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:41:49.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f10856a6700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.3:6790/0 conn(0x7f108009a0c0 legacy=0x7f10801410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340936825 0 0) 0x7f108011d100 con 0x7f108009a0c0 2021-05-26T16:41:49.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 10 monclient(hunting): my global_id is 4520 2021-05-26T16:41:49.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1060003270 con 0x7f108009a0c0 2021-05-26T16:41:49.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1721854523 0 0) 0x7f1060003270 con 0x7f108009a0c0 2021-05-26T16:41:49.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f108011d100 con 0x7f108009a0c0 2021-05-26T16:41:49.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1070004870 con 0x7f108009a0c0 2021-05-26T16:41:49.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:41:49.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 10 monclient(hunting): dump: 2021-05-26T16:41:49.779 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.780 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.780 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.780 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.780 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.781 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.781 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.781 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.781 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.782 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.782 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.782 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.782 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.783 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.783 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.783 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.735+0000 7f106dffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:41:49.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 772294253 0 0) 0x7f108011d100 con 0x7f108009a0c0 2021-05-26T16:41:49.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6792/0 conn(0x7f108011bd10 legacy=0x7f1080144800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-05-26T16:41:49.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.3:6789/0 conn(0x7f1080099c40 legacy=0x7f108013c440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-05-26T16:41:49.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:41:49.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 monclient: found mon.b 2021-05-26T16:41:49.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:41:49.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:49.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108011b230 con 0x7f108009a0c0 2021-05-26T16:41:49.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 10 monclient: _finish_auth 0 2021-05-26T16:41:49.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:41:49.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f108810b700 5 monclient: authenticate success, global_id 4520 2021-05-26T16:41:49.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f108810b700 10 monclient: _renew_subs 2021-05-26T16:41:49.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f108810b700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:49.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108012ff10 con 0x7f108009a0c0 2021-05-26T16:41:49.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1070004ee0 con 0x7f108009a0c0 2021-05-26T16:41:49.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:41:49.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f1070005390 con 0x7f108009a0c0 2021-05-26T16:41:49.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:41:49.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 10 monclient: dump: 2021-05-26T16:41:49.788 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.788 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.788 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.789 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.789 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.789 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.789 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.790 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.790 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.790 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.790 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.790 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.791 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.791 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.791 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.791 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106ffff700 4 set_mon_vals no callback set 2021-05-26T16:41:49.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f108810b700 10 monclient: _renew_subs 2021-05-26T16:41:49.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f108810b700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:41:49.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f108013cd10 con 0x7f108009a0c0 2021-05-26T16:41:49.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.736+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f107000e900 con 0x7f108009a0c0 2021-05-26T16:41:49.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.737+0000 7f108810b700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.737+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(20..20 src has 1..20) v4 ==== 3941+0+0 (unknown 861422478 0 0) 0x7f107003dcf0 con 0x7f108009a0c0 2021-05-26T16:41:49.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.737+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f108006c030 con 0x7f108005e1e0 2021-05-26T16:41:49.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.737+0000 7f1085ea7700 10 monclient: get_auth_request con 0x7f1060032760 auth_method 0 2021-05-26T16:41:49.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.739+0000 7f10866a8700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6791/0 conn(0x7f108005e1e0 legacy=0x7f1080058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.739+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656849753 0 0) 0x7f108006c030 con 0x7f108005e1e0 2021-05-26T16:41:49.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.739+0000 7f106dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.739+0000 7f106dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.739+0000 7f106dffb700 10 monclient(hunting): my global_id is 4604 2021-05-26T16:41:49.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.739+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f108011d100 con 0x7f108005e1e0 2021-05-26T16:41:49.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4130662958 0 0) 0x7f108011d100 con 0x7f108005e1e0 2021-05-26T16:41:49.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f108006c030 con 0x7f108005e1e0 2021-05-26T16:41:49.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f107c002050 con 0x7f108005e1e0 2021-05-26T16:41:49.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:49.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 10 monclient: dump: 2021-05-26T16:41:49.796 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.796 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.796 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.797 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.797 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.797 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.797 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.798 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.798 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.798 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.798 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.798 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.799 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.799 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.799 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.799 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3201055128 0 0) 0x7f108006c030 con 0x7f108005e1e0 2021-05-26T16:41:49.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10800008d0 con 0x7f108005e1e0 2021-05-26T16:41:49.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f107c006920 con 0x7f108005e1e0 2021-05-26T16:41:49.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:41:49.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:41:49.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6791/0 conn(0x7f108005e1e0 legacy=0x7f1080058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.740+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6791/0 conn(0x7f108005e1e0 legacy=0x7f1080058d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.747+0000 7f108810b700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:41:49.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.747+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f10801311c0 con 0x7f1080130de0 2021-05-26T16:41:49.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.749+0000 7f10866a8700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6791/0 conn(0x7f1080130de0 legacy=0x7f1080094ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:41:49.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.749+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250359583 0 0) 0x7f10801311c0 con 0x7f1080130de0 2021-05-26T16:41:49.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.749+0000 7f106dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:41:49.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.749+0000 7f106dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:41:49.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.749+0000 7f106dffb700 10 monclient(hunting): my global_id is 4613 2021-05-26T16:41:49.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.749+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f108006c030 con 0x7f1080130de0 2021-05-26T16:41:49.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3362328590 0 0) 0x7f108006c030 con 0x7f1080130de0 2021-05-26T16:41:49.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f10801311c0 con 0x7f1080130de0 2021-05-26T16:41:49.805 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f107c002af0 con 0x7f1080130de0 2021-05-26T16:41:49.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:41:49.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:41:49.806 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 10 monclient: dump: 2021-05-26T16:41:49.806 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:41:49.807 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:41:49.807 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.807 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:41:49.807 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:41:49.807 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:41:49.808 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:41:49.808 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:41:49.808 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:41:49.808 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:41:49.809 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:41:49.809 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:41:49.809 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:41:49.809 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:41:49.809 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:41:49.810 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:41:49.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2437435298 0 0) 0x7f10801311c0 con 0x7f1080130de0 2021-05-26T16:41:49.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 --> v1:172.21.15.137:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f10800951e0 con 0x7f1080130de0 2021-05-26T16:41:49.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7289 (unknown 0 0 2962326602) 0x7f107c002ee0 con 0x7f1080130de0 2021-05-26T16:41:49.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:41:49.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:41:49.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6791/0 conn(0x7f1080130de0 legacy=0x7f1080094ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f106dffb700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6791/0 conn(0x7f1080130de0 legacy=0x7f1080094ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:41:49.812 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:41:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:41:49.813 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 10, 2021-05-26T16:41:49.813 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:41:49.813 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:41:49.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:41:49.813 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:41:49.814 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:41:49.814 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:41:49.814 INFO:teuthology.orchestra.run.smithi003.stdout: 6 2021-05-26T16:41:49.814 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.815 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:41:49.815 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.815 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:41:49.815 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:41:49.815 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.816 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.816 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.816 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.816 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.817 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.817 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.817 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.817 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.817 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.818 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:41:49.818 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:41:49.818 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.818 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.818 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.819 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.819 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.819 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.819 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.820 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.820 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.820 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.820 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:41:49.821 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:41:49.821 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:41:49.821 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:41:49.821 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:41:49.821 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:41:49.822 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.822 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:41:49.822 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:41:49.822 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:41:49.823 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:41:49.823 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:41:49.823 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:41:49.823 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:41:49.823 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:41:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:41:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:41:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:41:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:41:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:41:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:41:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:41:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:41:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:41:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:41:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:41:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:41:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:41:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:41:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:41:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:41:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:41:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:41:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:41:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:41:49.835 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:41:49.835 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.835 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.835 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.835 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.836 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:41:49.836 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.836 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.836 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.836 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.837 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.837 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:41:49.837 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.837 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.838 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.838 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.838 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:41:49.838 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:41:49.839 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.839 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.839 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.839 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.840 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:41:49.840 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.840 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.840 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.840 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.841 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.841 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:41:49.841 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.841 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.841 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.842 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.842 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:41:49.842 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:41:49.843 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.843 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.843 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.843 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.843 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:41:49.844 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.844 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.844 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.844 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.845 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:41:49.845 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.845 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.845 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.846 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.846 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:41:49.846 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:41:49.846 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.847 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.847 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.847 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.847 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:41:49.847 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.848 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.848 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.848 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.848 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:41:49.849 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.849 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.849 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.850 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.850 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:41:49.850 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:41:49.850 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.850 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.851 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.851 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.851 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:41:49.851 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.851 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.852 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.852 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.852 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:41:49.853 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.853 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.853 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.853 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.854 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:41:49.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:41:49.854 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.854 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.854 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.855 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.855 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:41:49.855 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.855 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.856 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.856 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.856 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:41:49.856 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.857 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.857 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.857 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.857 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:41:49.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:41:49.858 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:41:49.858 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:41:49.858 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.859 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:41:49.859 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:41:49.859 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:41:49.859 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.859 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:41:49.862 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:41:49.862 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.862 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.862 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.862 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:41:49.863 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.863 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:41:49.863 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:41:49.863 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:41:49.864 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:41:49.864 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:41:49.864 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:41:49.864 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:41:49.864 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:41:49.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:41:49.865 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:41:49.865 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:41:49.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.137:6812/30003 conn(0x7f1060032760 legacy=0x7f1060034c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f108810b700 10 monclient: shutdown 2021-05-26T16:41:49.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f108810b700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:41:49.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 >> v1:172.21.15.3:6790/0 conn(0x7f108009a0c0 legacy=0x7f10801410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:41:49.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f10866a8700 1 -- 172.21.15.3:0/2018059159 reap_dead start 2021-05-26T16:41:49.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f10866a8700 1 -- 172.21.15.3:0/2018059159 reap_dead start 2021-05-26T16:41:49.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.750+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 shutdown_connections 2021-05-26T16:41:49.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.751+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 >> 172.21.15.3:0/2018059159 conn(0x7f1080064aa0 msgr2=0x7f108009ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:41:49.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.751+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 shutdown_connections 2021-05-26T16:41:49.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:41:49.751+0000 7f108810b700 1 -- 172.21.15.3:0/2018059159 wait complete. 2021-05-26T16:41:49.869 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-05-26T16:41:51.006 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:51.006 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33088]: starting. 2021-05-26T16:41:51.006 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33088]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33052 2021-05-26T16:41:51.006 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33088]: shutting down. 2021-05-26T16:41:51.007 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:51.007 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:51.007 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:41:51.009 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:41:53.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33169]: starting. 2021-05-26T16:41:53.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33169]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33168 2021-05-26T16:41:53.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33169]: created object 0... 2021-05-26T16:41:53.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33169]: created object 25... 2021-05-26T16:41:53.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33169]: created object 49... 2021-05-26T16:41:53.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33169]: finishing. 2021-05-26T16:41:53.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33169]: shutting down. 2021-05-26T16:41:54.246 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33170]: starting. 2021-05-26T16:41:54.247 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33170]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33168 2021-05-26T16:41:54.247 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33170]: shutting down. 2021-05-26T16:41:56.494 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:56.624 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33208]: starting. 2021-05-26T16:41:56.624 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33208]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33168 2021-05-26T16:41:56.624 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33208]: created object 0... 2021-05-26T16:41:56.625 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33208]: created object 25... 2021-05-26T16:41:56.625 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33208]: created object 49... 2021-05-26T16:41:56.625 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33208]: finishing. 2021-05-26T16:41:56.625 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33208]: shutting down. 2021-05-26T16:41:56.626 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:56.627 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33210]: starting. 2021-05-26T16:41:56.627 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33210]: listing objects. 2021-05-26T16:41:56.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33210]: listed object 0... 2021-05-26T16:41:56.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33210]: listed object 25... 2021-05-26T16:41:56.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33210]: saw 50 objects 2021-05-26T16:41:56.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33210]: shutting down. 2021-05-26T16:41:57.385 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:57.386 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33209]: starting. 2021-05-26T16:41:57.386 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33209]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33168 2021-05-26T16:41:57.386 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33209]: shutting down. 2021-05-26T16:41:57.387 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:57.387 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:41:57.387 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:41:57.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:41:59.538 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33280]: starting. 2021-05-26T16:41:59.538 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33280]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33279 2021-05-26T16:41:59.539 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33280]: created object 0... 2021-05-26T16:41:59.539 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33280]: created object 25... 2021-05-26T16:41:59.539 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33280]: created object 49... 2021-05-26T16:41:59.539 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33280]: finishing. 2021-05-26T16:41:59.540 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33280]: shutting down. 2021-05-26T16:42:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33281]: starting. 2021-05-26T16:42:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33281]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33279 2021-05-26T16:42:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33281]: shutting down. 2021-05-26T16:42:03.131 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:03.131 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33316]: starting. 2021-05-26T16:42:03.131 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33316]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33279 2021-05-26T16:42:03.132 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33316]: created object 0... 2021-05-26T16:42:03.132 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33316]: created object 25... 2021-05-26T16:42:03.132 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33316]: created object 49... 2021-05-26T16:42:03.132 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33316]: finishing. 2021-05-26T16:42:03.133 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33316]: shutting down. 2021-05-26T16:42:03.166 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:03.166 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33318]: starting. 2021-05-26T16:42:03.167 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33318]: listing objects. 2021-05-26T16:42:03.167 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33318]: listed object 0... 2021-05-26T16:42:03.167 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33318]: listed object 25... 2021-05-26T16:42:03.167 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33318]: saw 50 objects 2021-05-26T16:42:03.167 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33318]: shutting down. 2021-05-26T16:42:04.013 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:04.013 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33317]: starting. 2021-05-26T16:42:04.014 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33317]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33279 2021-05-26T16:42:04.014 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33317]: shutting down. 2021-05-26T16:42:04.014 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:04.015 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:04.015 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:04.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:06.157 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33386]: starting. 2021-05-26T16:42:06.160 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33386]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33385 2021-05-26T16:42:06.160 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33386]: created object 0... 2021-05-26T16:42:06.160 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33386]: created object 25... 2021-05-26T16:42:06.160 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33386]: created object 49... 2021-05-26T16:42:06.160 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33386]: finishing. 2021-05-26T16:42:06.161 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33386]: shutting down. 2021-05-26T16:42:07.130 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33387]: starting. 2021-05-26T16:42:07.130 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33387]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33385 2021-05-26T16:42:07.130 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33387]: shutting down. 2021-05-26T16:42:10.208 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:10.209 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33422]: starting. 2021-05-26T16:42:10.209 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33422]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33385 2021-05-26T16:42:10.209 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33422]: created object 0... 2021-05-26T16:42:10.209 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33422]: created object 25... 2021-05-26T16:42:10.210 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33422]: created object 49... 2021-05-26T16:42:10.210 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33422]: finishing. 2021-05-26T16:42:10.210 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33422]: shutting down. 2021-05-26T16:42:10.247 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:10.247 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33424]: starting. 2021-05-26T16:42:10.247 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33424]: listing objects. 2021-05-26T16:42:10.248 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33424]: listed object 0... 2021-05-26T16:42:10.248 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33424]: listed object 25... 2021-05-26T16:42:10.248 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33424]: saw 50 objects 2021-05-26T16:42:10.249 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33424]: shutting down. 2021-05-26T16:42:11.097 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:11.098 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33423]: starting. 2021-05-26T16:42:11.098 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33423]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33385 2021-05-26T16:42:11.099 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33423]: shutting down. 2021-05-26T16:42:11.101 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:11.101 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:11.102 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:11.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:13.312 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33492]: starting. 2021-05-26T16:42:13.312 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33492]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33491 2021-05-26T16:42:13.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33492]: created object 0... 2021-05-26T16:42:13.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33492]: created object 25... 2021-05-26T16:42:13.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33492]: created object 49... 2021-05-26T16:42:13.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33492]: finishing. 2021-05-26T16:42:13.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33492]: shutting down. 2021-05-26T16:42:14.194 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33493]: starting. 2021-05-26T16:42:14.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33493]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33491 2021-05-26T16:42:14.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33493]: shutting down. 2021-05-26T16:42:16.294 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:16.294 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33528]: starting. 2021-05-26T16:42:16.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33528]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33491 2021-05-26T16:42:16.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33528]: created object 0... 2021-05-26T16:42:16.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33528]: created object 25... 2021-05-26T16:42:16.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33528]: created object 49... 2021-05-26T16:42:16.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33528]: finishing. 2021-05-26T16:42:16.296 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33528]: shutting down. 2021-05-26T16:42:16.334 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:16.334 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33530]: starting. 2021-05-26T16:42:16.334 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33530]: listing objects. 2021-05-26T16:42:16.335 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33530]: listed object 0... 2021-05-26T16:42:16.336 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33530]: listed object 25... 2021-05-26T16:42:16.336 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33530]: saw 50 objects 2021-05-26T16:42:16.336 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33530]: shutting down. 2021-05-26T16:42:17.172 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:17.172 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33529]: starting. 2021-05-26T16:42:17.172 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33529]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33491 2021-05-26T16:42:17.173 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33529]: shutting down. 2021-05-26T16:42:17.173 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:17.173 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:17.173 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:17.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:19.294 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33598]: starting. 2021-05-26T16:42:19.294 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33598]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33597 2021-05-26T16:42:19.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33598]: created object 0... 2021-05-26T16:42:19.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33598]: created object 25... 2021-05-26T16:42:19.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33598]: created object 49... 2021-05-26T16:42:19.295 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33598]: finishing. 2021-05-26T16:42:19.296 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33598]: shutting down. 2021-05-26T16:42:20.188 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33599]: starting. 2021-05-26T16:42:20.188 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33599]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33597 2021-05-26T16:42:20.188 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33599]: shutting down. 2021-05-26T16:42:22.304 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:22.304 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33635]: starting. 2021-05-26T16:42:22.305 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33635]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33597 2021-05-26T16:42:22.305 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33635]: created object 0... 2021-05-26T16:42:22.305 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33635]: created object 25... 2021-05-26T16:42:22.305 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33635]: created object 49... 2021-05-26T16:42:22.306 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33635]: finishing. 2021-05-26T16:42:22.306 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33635]: shutting down. 2021-05-26T16:42:22.345 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:22.345 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33637]: starting. 2021-05-26T16:42:22.346 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33637]: listing objects. 2021-05-26T16:42:22.346 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33637]: listed object 0... 2021-05-26T16:42:22.346 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33637]: listed object 25... 2021-05-26T16:42:22.346 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33637]: saw 50 objects 2021-05-26T16:42:22.347 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33637]: shutting down. 2021-05-26T16:42:23.195 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:23.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33636]: starting. 2021-05-26T16:42:23.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33636]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33597 2021-05-26T16:42:23.196 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33636]: shutting down. 2021-05-26T16:42:23.196 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:23.197 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:23.197 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:23.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:25.329 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33705]: starting. 2021-05-26T16:42:25.330 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33705]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33704 2021-05-26T16:42:25.330 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33705]: created object 0... 2021-05-26T16:42:25.331 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33705]: created object 25... 2021-05-26T16:42:25.331 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33705]: created object 49... 2021-05-26T16:42:25.331 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33705]: finishing. 2021-05-26T16:42:25.332 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33705]: shutting down. 2021-05-26T16:42:26.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33706]: starting. 2021-05-26T16:42:26.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33706]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33704 2021-05-26T16:42:26.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33706]: shutting down. 2021-05-26T16:42:28.317 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:28.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33741]: starting. 2021-05-26T16:42:28.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33741]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33704 2021-05-26T16:42:28.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33741]: created object 0... 2021-05-26T16:42:28.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33741]: created object 25... 2021-05-26T16:42:28.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33741]: created object 49... 2021-05-26T16:42:28.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33741]: finishing. 2021-05-26T16:42:28.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33741]: shutting down. 2021-05-26T16:42:28.359 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:28.359 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33743]: starting. 2021-05-26T16:42:28.359 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33743]: listing objects. 2021-05-26T16:42:28.360 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33743]: listed object 0... 2021-05-26T16:42:28.360 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33743]: listed object 25... 2021-05-26T16:42:28.360 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33743]: saw 50 objects 2021-05-26T16:42:28.360 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33743]: shutting down. 2021-05-26T16:42:29.217 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:29.217 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33742]: starting. 2021-05-26T16:42:29.218 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33742]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33704 2021-05-26T16:42:29.218 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33742]: shutting down. 2021-05-26T16:42:29.219 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:29.219 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:29.219 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:29.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:31.308 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33811]: starting. 2021-05-26T16:42:31.308 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33811]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33810 2021-05-26T16:42:31.309 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33811]: created object 0... 2021-05-26T16:42:31.309 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33811]: created object 25... 2021-05-26T16:42:31.309 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33811]: created object 49... 2021-05-26T16:42:31.309 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33811]: finishing. 2021-05-26T16:42:31.309 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33811]: shutting down. 2021-05-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33812]: starting. 2021-05-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33812]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33810 2021-05-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33812]: shutting down. 2021-05-26T16:42:34.322 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:34.322 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33847]: starting. 2021-05-26T16:42:34.322 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33847]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33810 2021-05-26T16:42:34.323 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33847]: created object 0... 2021-05-26T16:42:34.323 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33847]: created object 25... 2021-05-26T16:42:34.323 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33847]: created object 49... 2021-05-26T16:42:34.323 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33847]: finishing. 2021-05-26T16:42:34.323 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33847]: shutting down. 2021-05-26T16:42:34.362 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:34.362 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33849]: starting. 2021-05-26T16:42:34.363 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33849]: listing objects. 2021-05-26T16:42:34.363 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33849]: listed object 0... 2021-05-26T16:42:34.363 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33849]: listed object 25... 2021-05-26T16:42:34.363 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33849]: saw 50 objects 2021-05-26T16:42:34.363 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33849]: shutting down. 2021-05-26T16:42:35.184 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:35.184 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33848]: starting. 2021-05-26T16:42:35.184 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33848]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33810 2021-05-26T16:42:35.184 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33848]: shutting down. 2021-05-26T16:42:35.185 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:35.185 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:35.185 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:35.187 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:37.323 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33917]: starting. 2021-05-26T16:42:37.324 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33917]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33916 2021-05-26T16:42:37.324 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33917]: created object 0... 2021-05-26T16:42:37.324 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33917]: created object 25... 2021-05-26T16:42:37.324 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33917]: created object 49... 2021-05-26T16:42:37.324 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33917]: finishing. 2021-05-26T16:42:37.325 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[33917]: shutting down. 2021-05-26T16:42:38.222 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33918]: starting. 2021-05-26T16:42:38.223 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33918]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33916 2021-05-26T16:42:38.223 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[33918]: shutting down. 2021-05-26T16:42:40.366 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:40.367 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33953]: starting. 2021-05-26T16:42:40.367 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33953]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-33916 2021-05-26T16:42:40.367 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33953]: created object 0... 2021-05-26T16:42:40.367 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33953]: created object 25... 2021-05-26T16:42:40.367 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33953]: created object 49... 2021-05-26T16:42:40.368 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33953]: finishing. 2021-05-26T16:42:40.368 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[33953]: shutting down. 2021-05-26T16:42:40.407 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:40.407 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33955]: starting. 2021-05-26T16:42:40.408 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33955]: listing objects. 2021-05-26T16:42:40.408 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33955]: listed object 0... 2021-05-26T16:42:40.408 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33955]: listed object 25... 2021-05-26T16:42:40.408 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33955]: saw 50 objects 2021-05-26T16:42:40.408 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[33955]: shutting down. 2021-05-26T16:42:41.176 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:41.177 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33954]: starting. 2021-05-26T16:42:41.177 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33954]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-33916 2021-05-26T16:42:41.177 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[33954]: shutting down. 2021-05-26T16:42:41.178 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:41.178 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:41.178 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:41.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:43.312 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34031]: starting. 2021-05-26T16:42:43.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34031]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34030 2021-05-26T16:42:43.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34031]: created object 0... 2021-05-26T16:42:43.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34031]: created object 25... 2021-05-26T16:42:43.313 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34031]: created object 49... 2021-05-26T16:42:43.314 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34031]: finishing. 2021-05-26T16:42:43.314 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34031]: shutting down. 2021-05-26T16:42:45.204 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34032]: starting. 2021-05-26T16:42:45.205 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34032]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34030 2021-05-26T16:42:45.205 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34032]: shutting down. 2021-05-26T16:42:47.332 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:47.332 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34067]: starting. 2021-05-26T16:42:47.332 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34067]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34030 2021-05-26T16:42:47.333 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34067]: created object 0... 2021-05-26T16:42:47.333 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34067]: created object 25... 2021-05-26T16:42:47.333 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34067]: created object 49... 2021-05-26T16:42:47.334 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34067]: finishing. 2021-05-26T16:42:47.334 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34067]: shutting down. 2021-05-26T16:42:47.372 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:47.372 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34069]: starting. 2021-05-26T16:42:47.372 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34069]: listing objects. 2021-05-26T16:42:47.373 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34069]: listed object 0... 2021-05-26T16:42:47.373 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34069]: listed object 25... 2021-05-26T16:42:47.373 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34069]: saw 50 objects 2021-05-26T16:42:47.373 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34069]: shutting down. 2021-05-26T16:42:48.224 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:48.225 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34068]: starting. 2021-05-26T16:42:48.225 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34068]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34030 2021-05-26T16:42:48.225 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34068]: shutting down. 2021-05-26T16:42:48.226 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:48.226 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:48.226 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:48.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:50.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34137]: starting. 2021-05-26T16:42:50.354 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34137]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34136 2021-05-26T16:42:50.354 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34137]: created object 0... 2021-05-26T16:42:50.354 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34137]: created object 25... 2021-05-26T16:42:50.355 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34137]: created object 49... 2021-05-26T16:42:50.355 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34137]: finishing. 2021-05-26T16:42:50.355 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34137]: shutting down. 2021-05-26T16:42:51.177 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34138]: starting. 2021-05-26T16:42:51.177 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34138]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34136 2021-05-26T16:42:51.177 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34138]: shutting down. 2021-05-26T16:42:53.320 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:53.320 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34173]: starting. 2021-05-26T16:42:53.320 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34173]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34136 2021-05-26T16:42:53.321 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34173]: created object 0... 2021-05-26T16:42:53.321 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34173]: created object 25... 2021-05-26T16:42:53.321 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34173]: created object 49... 2021-05-26T16:42:53.321 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34173]: finishing. 2021-05-26T16:42:53.322 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34173]: shutting down. 2021-05-26T16:42:53.363 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:53.364 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34175]: starting. 2021-05-26T16:42:53.364 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34175]: listing objects. 2021-05-26T16:42:53.364 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34175]: listed object 0... 2021-05-26T16:42:53.364 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34175]: listed object 25... 2021-05-26T16:42:53.364 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34175]: saw 50 objects 2021-05-26T16:42:53.365 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34175]: shutting down. 2021-05-26T16:42:54.213 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:54.214 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34174]: starting. 2021-05-26T16:42:54.214 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34174]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34136 2021-05-26T16:42:54.214 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34174]: shutting down. 2021-05-26T16:42:54.215 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:54.215 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:54.215 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:42:54.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:42:56.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34243]: starting. 2021-05-26T16:42:56.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34243]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34242 2021-05-26T16:42:56.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34243]: created object 0... 2021-05-26T16:42:56.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34243]: created object 25... 2021-05-26T16:42:56.354 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34243]: created object 49... 2021-05-26T16:42:56.354 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34243]: finishing. 2021-05-26T16:42:56.354 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34243]: shutting down. 2021-05-26T16:42:57.223 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34244]: starting. 2021-05-26T16:42:57.223 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34244]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34242 2021-05-26T16:42:57.224 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34244]: shutting down. 2021-05-26T16:42:59.433 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:59.434 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34279]: starting. 2021-05-26T16:42:59.434 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34279]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34242 2021-05-26T16:42:59.434 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34279]: created object 0... 2021-05-26T16:42:59.434 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34279]: created object 25... 2021-05-26T16:42:59.435 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34279]: created object 49... 2021-05-26T16:42:59.435 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34279]: finishing. 2021-05-26T16:42:59.435 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34279]: shutting down. 2021-05-26T16:42:59.705 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:42:59.706 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34281]: starting. 2021-05-26T16:42:59.706 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34281]: listing objects. 2021-05-26T16:42:59.706 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34281]: listed object 0... 2021-05-26T16:42:59.707 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34281]: listed object 25... 2021-05-26T16:42:59.707 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34281]: saw 50 objects 2021-05-26T16:42:59.707 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34281]: shutting down. 2021-05-26T16:43:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34280]: starting. 2021-05-26T16:43:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34280]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34242 2021-05-26T16:43:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34280]: shutting down. 2021-05-26T16:43:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:43:00.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:43:02.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34349]: starting. 2021-05-26T16:43:02.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34349]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34348 2021-05-26T16:43:02.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34349]: created object 0... 2021-05-26T16:43:02.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34349]: created object 25... 2021-05-26T16:43:02.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34349]: created object 49... 2021-05-26T16:43:02.319 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34349]: finishing. 2021-05-26T16:43:02.319 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34349]: shutting down. 2021-05-26T16:43:03.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34350]: starting. 2021-05-26T16:43:03.201 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34350]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34348 2021-05-26T16:43:03.201 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34350]: shutting down. 2021-05-26T16:43:05.332 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:05.333 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34385]: starting. 2021-05-26T16:43:05.333 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34385]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34348 2021-05-26T16:43:05.333 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34385]: created object 0... 2021-05-26T16:43:05.333 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34385]: created object 25... 2021-05-26T16:43:05.334 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34385]: created object 49... 2021-05-26T16:43:05.334 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34385]: finishing. 2021-05-26T16:43:05.334 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34385]: shutting down. 2021-05-26T16:43:05.373 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:05.373 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34387]: starting. 2021-05-26T16:43:05.373 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34387]: listing objects. 2021-05-26T16:43:05.373 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34387]: listed object 0... 2021-05-26T16:43:05.374 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34387]: listed object 25... 2021-05-26T16:43:05.374 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34387]: saw 50 objects 2021-05-26T16:43:05.374 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34387]: shutting down. 2021-05-26T16:43:06.221 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:06.221 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34386]: starting. 2021-05-26T16:43:06.221 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34386]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34348 2021-05-26T16:43:06.222 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34386]: shutting down. 2021-05-26T16:43:06.222 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:06.222 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:06.223 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:43:06.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:43:08.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34455]: starting. 2021-05-26T16:43:08.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34455]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34454 2021-05-26T16:43:08.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34455]: created object 0... 2021-05-26T16:43:08.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34455]: created object 25... 2021-05-26T16:43:08.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34455]: created object 49... 2021-05-26T16:43:08.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34455]: finishing. 2021-05-26T16:43:08.353 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34455]: shutting down. 2021-05-26T16:43:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34456]: starting. 2021-05-26T16:43:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34456]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34454 2021-05-26T16:43:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34456]: shutting down. 2021-05-26T16:43:11.290 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:11.291 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34491]: starting. 2021-05-26T16:43:11.291 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34491]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34454 2021-05-26T16:43:11.291 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34491]: created object 0... 2021-05-26T16:43:11.291 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34491]: created object 25... 2021-05-26T16:43:11.292 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34491]: created object 49... 2021-05-26T16:43:11.292 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34491]: finishing. 2021-05-26T16:43:11.292 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34491]: shutting down. 2021-05-26T16:43:11.330 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:11.331 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34493]: starting. 2021-05-26T16:43:11.331 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34493]: listing objects. 2021-05-26T16:43:11.331 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34493]: listed object 0... 2021-05-26T16:43:11.331 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34493]: listed object 25... 2021-05-26T16:43:11.332 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34493]: saw 50 objects 2021-05-26T16:43:11.332 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34493]: shutting down. 2021-05-26T16:43:12.190 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:12.191 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34492]: starting. 2021-05-26T16:43:12.191 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34492]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34454 2021-05-26T16:43:12.191 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34492]: shutting down. 2021-05-26T16:43:12.192 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:12.192 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:12.192 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:43:12.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:43:14.316 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34561]: starting. 2021-05-26T16:43:14.316 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34561]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34560 2021-05-26T16:43:14.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34561]: created object 0... 2021-05-26T16:43:14.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34561]: created object 25... 2021-05-26T16:43:14.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34561]: created object 49... 2021-05-26T16:43:14.317 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34561]: finishing. 2021-05-26T16:43:14.318 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34561]: shutting down. 2021-05-26T16:43:15.199 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34562]: starting. 2021-05-26T16:43:15.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34562]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34560 2021-05-26T16:43:15.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34562]: shutting down. 2021-05-26T16:43:17.351 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:17.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34597]: starting. 2021-05-26T16:43:17.351 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34597]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34560 2021-05-26T16:43:17.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34597]: created object 0... 2021-05-26T16:43:17.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34597]: created object 25... 2021-05-26T16:43:17.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34597]: created object 49... 2021-05-26T16:43:17.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34597]: finishing. 2021-05-26T16:43:17.352 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34597]: shutting down. 2021-05-26T16:43:17.392 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:17.392 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34599]: starting. 2021-05-26T16:43:17.392 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34599]: listing objects. 2021-05-26T16:43:17.393 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34599]: listed object 0... 2021-05-26T16:43:17.393 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34599]: listed object 25... 2021-05-26T16:43:17.393 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34599]: saw 50 objects 2021-05-26T16:43:17.393 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34599]: shutting down. 2021-05-26T16:43:18.235 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:18.236 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34598]: starting. 2021-05-26T16:43:18.236 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34598]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34560 2021-05-26T16:43:18.236 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34598]: shutting down. 2021-05-26T16:43:18.237 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:18.237 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:18.237 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:43:18.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:43:19.871 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2021-05-26T16:43:19.871 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2021-05-26T16:43:19.871 INFO:tasks.ceph.mon.i:Restarting daemon 2021-05-26T16:43:19.872 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2021-05-26T16:43:19.875 INFO:tasks.ceph.mon.i:Started 2021-05-26T16:43:19.875 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2021-05-26T16:43:19.876 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2021-05-26T16:43:19.876 INFO:tasks.ceph.mon.e:Restarting daemon 2021-05-26T16:43:19.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2021-05-26T16:43:19.880 INFO:tasks.ceph.mon.e:Started 2021-05-26T16:43:19.880 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2021-05-26T16:43:19.880 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2021-05-26T16:43:19.881 INFO:tasks.ceph.mon.a:Restarting daemon 2021-05-26T16:43:19.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-05-26T16:43:19.883 INFO:tasks.ceph.mon.a:Started 2021-05-26T16:43:19.883 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2021-05-26T16:43:19.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:43:20.010 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:20.010 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.011 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.011 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.011 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.012 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:20.012 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.012 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.013 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.013 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.013 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:20.013 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.014 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.014 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.014 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.015 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:43:20.015 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.015 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.015 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.016 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.016 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:20.016 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.017 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.017 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.017 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.017 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:20.018 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.018 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.018 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.018 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.020 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:20.020 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.020 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.020 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.021 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.021 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:20.021 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.021 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:20.022 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:20.022 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:20.022 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:20.022 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.023 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.023 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.023 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.023 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:20.024 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.024 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.024 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.024 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.025 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:20.025 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.025 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.025 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.025 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.026 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:43:20.026 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.027 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.027 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.027 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.027 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:43:20.027 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.028 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.028 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.028 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.029 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:20.029 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.029 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.030 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.030 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.030 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:20.030 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.031 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.031 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.031 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.025+0000 7fb888127700 10 monclient: get_monmap_and_config 2021-05-26T16:43:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.025+0000 7fb888127700 10 monclient: build_initial_monmap 2021-05-26T16:43:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.025+0000 7fb888127700 10 monclient: monmap: 2021-05-26T16:43:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:20.025880+0000 2021-05-26T16:43:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:20.025880+0000 2021-05-26T16:43:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:20.037 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.025+0000 7fb888127700 1 Processor -- start 2021-05-26T16:43:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 1 -- start start 2021-05-26T16:43:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient: init 2021-05-26T16:43:20.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:20.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient: _add_conns ranks=[2,4,1,3,7,8,5,0,6] 2021-05-26T16:43:20.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient(hunting): picked mon.noname-b con 0x7fb880064a20 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:20.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient(hunting): picked mon.noname-c con 0x7fb880063e30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:20.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient(hunting): picked mon.noname-f con 0x7fb8800642e0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:20.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb880059750 con 0x7fb8800642e0 2021-05-26T16:43:20.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb880064e00 con 0x7fb880064a20 2021-05-26T16:43:20.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88009c770 con 0x7fb880063e30 2021-05-26T16:43:20.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:20.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb888127700 10 monclient(hunting): authenticate will time out at 957.657603s 2021-05-26T16:43:20.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb885ec3700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fb880064a20 0x7fb880099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54202/0 (socket says 172.21.15.3:54202) 2021-05-26T16:43:20.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb885ec3700 1 -- 172.21.15.3:0/3746871478 learned_addr learned my addr 172.21.15.3:0/3746871478 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:20.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.026+0000 7fb8856c2700 1 --1- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6791/0 conn(0x7fb880063e30 0x7fb880132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37670/0 (socket says 172.21.15.3:37670) 2021-05-26T16:43:20.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.028+0000 7fb885ec3700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6790/0 conn(0x7fb880064a20 legacy=0x7fb880099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:20.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.028+0000 7fb8856c2700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6791/0 conn(0x7fb880063e30 legacy=0x7fb880132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:20.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:20.029+0000 7fb8866c4700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.137:6789/0 conn(0x7fb8800642e0 legacy=0x7fb8801357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:20.048 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:20.048 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.048 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.049 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.049 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.049 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:43:20.050 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.050 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.050 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.050 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:20.051 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:20.051 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:20.051 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:20.051 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:20.052 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 10 monclient(hunting): tick 2021-05-26T16:43:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 1 monclient(hunting): continuing hunt 2021-05-26T16:43:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:43:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6791/0 conn(0x7fb880063e30 legacy=0x7fb880132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6790/0 conn(0x7fb880064a20 legacy=0x7fb880099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.137:6789/0 conn(0x7fb8800642e0 legacy=0x7fb8801357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:23.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 10 monclient: _add_conns ranks=[8,5,0,6,7,3] 2021-05-26T16:43:23.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 10 monclient(hunting): picked mon.noname-e con 0x7fb860003680 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:23.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.026+0000 7fb86f7fe700 10 monclient(hunting): picked mon.noname-h con 0x7fb860007310 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:23.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.027+0000 7fb86f7fe700 10 monclient(hunting): picked mon.noname-a con 0x7fb86000b060 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:23.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.027+0000 7fb86f7fe700 1 -- 172.21.15.3:0/3746871478 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8800977a0 con 0x7fb86000b060 2021-05-26T16:43:23.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.027+0000 7fb86f7fe700 1 -- 172.21.15.3:0/3746871478 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86000fe70 con 0x7fb860007310 2021-05-26T16:43:23.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.027+0000 7fb86f7fe700 1 -- 172.21.15.3:0/3746871478 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8600110c0 con 0x7fb860003680 2021-05-26T16:43:23.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.027+0000 7fb86f7fe700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:23.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.029+0000 7fb8866c4700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6789/0 conn(0x7fb86000b060 legacy=0x7fb86000d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:23.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.029+0000 7fb885ec3700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6793/0 conn(0x7fb860003680 legacy=0x7fb860005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:23.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:23.029+0000 7fb8856c2700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.137:6791/0 conn(0x7fb860007310 legacy=0x7fb8600097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.012+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907105862 0 0) 0x7fb86000fe70 con 0x7fb860007310 2021-05-26T16:43:25.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.012+0000 7fb884ec1700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.012+0000 7fb884ec1700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.012+0000 7fb884ec1700 10 monclient(hunting): my global_id is 5027 2021-05-26T16:43:25.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.012+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb868003270 con 0x7fb860007310 2021-05-26T16:43:25.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.012+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2012663850 0 0) 0x7fb868003270 con 0x7fb860007310 2021-05-26T16:43:25.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.012+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6793/0 conn(0x7fb860003680 legacy=0x7fb860005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.3:6789/0 conn(0x7fb86000b060 legacy=0x7fb86000d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: _finish_hunting 0 2021-05-26T16:43:25.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 1 monclient: found mon.noname-h 2021-05-26T16:43:25.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:25.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.137:6791/0 2021-05-26T16:43:25.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb8866c4700 1 -- 172.21.15.3:0/3746871478 reap_dead start 2021-05-26T16:43:25.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600123d0 con 0x7fb860007310 2021-05-26T16:43:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: _finish_auth 0 2021-05-26T16:43:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb874001a60 con 0x7fb860007310 2021-05-26T16:43:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 5 monclient: authenticate success, global_id 5027 2021-05-26T16:43:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2021-05-26T16:43:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: dump: 2021-05-26T16:43:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.025 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.025 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.025 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.025 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.026 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.026 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.028 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 <== mon.5 v1:172.21.15.137:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb874001d70 con 0x7fb860007310 2021-05-26T16:43:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 1 -- 172.21.15.3:0/3746871478 <== mon.5 v1:172.21.15.137:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb874004870 con 0x7fb860007310 2021-05-26T16:43:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 4 set_mon_vals no callback set 2021-05-26T16:43:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb884ec1700 10 monclient: dump: 2021-05-26T16:43:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.033 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.033 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.033 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.033 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.034 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.034 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.034 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.035 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 10 monclient: shutdown 2021-05-26T16:43:25.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:25.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.013+0000 7fb888127700 1 -- 172.21.15.3:0/3746871478 >> v1:172.21.15.137:6791/0 conn(0x7fb860007310 legacy=0x7fb8600097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.014+0000 7fb888127700 1 -- 172.21.15.3:0/3746871478 shutdown_connections 2021-05-26T16:43:25.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.014+0000 7fb888127700 1 -- 172.21.15.3:0/3746871478 >> 172.21.15.3:0/3746871478 conn(0x7fb8800a0db0 msgr2=0x7fb88009cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:25.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.014+0000 7fb888127700 1 -- 172.21.15.3:0/3746871478 shutdown_connections 2021-05-26T16:43:25.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.014+0000 7fb888127700 1 -- 172.21.15.3:0/3746871478 wait complete. 2021-05-26T16:43:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.014+0000 7fb888127700 10 monclient: build_initial_monmap 2021-05-26T16:43:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.014+0000 7fb888127700 10 monclient: monmap: 2021-05-26T16:43:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:25.040 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 1 Processor -- start 2021-05-26T16:43:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 1 -- start start 2021-05-26T16:43:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient: init 2021-05-26T16:43:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient: _add_conns ranks=[4,0,7,5,2,6,8,1,3] 2021-05-26T16:43:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient(hunting): picked mon.noname-c con 0x7fb860007310 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient(hunting): picked mon.noname-a con 0x7fb88011bda0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient(hunting): picked mon.noname-i con 0x7fb880130ee0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb880131330 con 0x7fb88011bda0 2021-05-26T16:43:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88011cef0 con 0x7fb860007310 2021-05-26T16:43:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88011d190 con 0x7fb880130ee0 2021-05-26T16:43:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.015+0000 7fb888127700 10 monclient(hunting): authenticate will time out at 962.646939s 2021-05-26T16:43:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.016+0000 7fb885ec3700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fb860007310 0x7fb88013c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37696/0 (socket says 172.21.15.3:37696) 2021-05-26T16:43:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.016+0000 7fb885ec3700 1 -- 172.21.15.3:0/2819061435 learned_addr learned my addr 172.21.15.3:0/2819061435 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.018+0000 7fb885ec3700 1 -- 172.21.15.3:0/2819061435 >> v1:172.21.15.3:6791/0 conn(0x7fb860007310 legacy=0x7fb88013c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.018+0000 7fb8856c2700 1 -- 172.21.15.3:0/2819061435 >> v1:172.21.15.3:6789/0 conn(0x7fb88011bda0 legacy=0x7fb8801411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.018+0000 7fb8866c4700 1 -- 172.21.15.3:0/2819061435 >> v1:172.21.15.137:6792/0 conn(0x7fb880130ee0 legacy=0x7fb880144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535165492 0 0) 0x7fb88011cef0 con 0x7fb860007310 2021-05-26T16:43:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient(hunting): my global_id is 4963 2021-05-26T16:43:25.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8600115c0 con 0x7fb860007310 2021-05-26T16:43:25.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1719442552 0 0) 0x7fb8600115c0 con 0x7fb860007310 2021-05-26T16:43:25.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb88011cef0 con 0x7fb860007310 2021-05-26T16:43:25.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb870001bd0 con 0x7fb860007310 2021-05-26T16:43:25.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:43:25.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient(hunting): dump: 2021-05-26T16:43:25.051 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.051 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.052 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.052 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.052 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.052 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.052 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.053 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.053 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.053 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.053 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.054 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.054 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.054 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.054 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.054 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:25.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1357932117 0 0) 0x7fb88011cef0 con 0x7fb860007310 2021-05-26T16:43:25.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 >> v1:172.21.15.137:6792/0 conn(0x7fb880130ee0 legacy=0x7fb880144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 >> v1:172.21.15.3:6789/0 conn(0x7fb88011bda0 legacy=0x7fb8801411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:25.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 monclient: found mon.c 2021-05-26T16:43:25.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:25.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:25.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88011d430 con 0x7fb860007310 2021-05-26T16:43:25.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:25.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:25.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb888127700 5 monclient: authenticate success, global_id 4963 2021-05-26T16:43:25.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb888127700 10 monclient: _renew_subs 2021-05-26T16:43:25.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb888127700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:25.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88011b2c0 con 0x7fb860007310 2021-05-26T16:43:25.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb8700048a0 con 0x7fb860007310 2021-05-26T16:43:25.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:25.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb870004d50 con 0x7fb860007310 2021-05-26T16:43:25.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:25.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86dffb700 10 monclient: dump: 2021-05-26T16:43:25.059 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.059 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.060 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.060 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.060 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.060 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.060 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.061 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.061 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.061 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.061 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.061 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.062 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.062 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.062 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.062 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.026+0000 7fb888127700 10 monclient: _renew_subs 2021-05-26T16:43:25.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.025+0000 7fb86ffff700 4 set_mon_vals no callback set 2021-05-26T16:43:25.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.026+0000 7fb888127700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:25.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.026+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88012ffa0 con 0x7fb860007310 2021-05-26T16:43:25.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.026+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fb870004eb0 con 0x7fb860007310 2021-05-26T16:43:25.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.026+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(107..107 src has 1..107) v4 ==== 3941+0+0 (unknown 401767900 0 0) 0x7fb87003d900 con 0x7fb860007310 2021-05-26T16:43:25.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.027+0000 7fb8856c2700 10 monclient: get_auth_request con 0x7fb8600340b0 auth_method 0 2021-05-26T16:43:25.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.027+0000 7fb888127700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:25.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.027+0000 7fb888127700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:25.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.027+0000 7fb888127700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:25.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.027+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88006c030 con 0x7fb860007310 2021-05-26T16:43:25.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.032+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fb8700064f0 con 0x7fb860007310 2021-05-26T16:43:25.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.032+0000 7fb86dffb700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:25.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.032+0000 7fb86dffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:25.066 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:43:25.067 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.067 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.067 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.068 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.068 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:25.069 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.069 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.069 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.069 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.070 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:25.070 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.070 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.071 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.071 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.071 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:25.071 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.071 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.072 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.072 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.072 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:25.072 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.073 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.073 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.073 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.073 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:25.074 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.074 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.074 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.074 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.075 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:25.075 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.075 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.076 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.076 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.076 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:43:25.077 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.077 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.077 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.077 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.078 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:25.078 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.078 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.078 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.079 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.079 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:25.079 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.079 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.080 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.080 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.080 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:25.081 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.081 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.081 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.081 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.082 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:43:25.082 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.082 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.082 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.083 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.083 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:25.083 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.084 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.084 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.084 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.084 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:25.085 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.085 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.085 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.085 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.086 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:25.086 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.086 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.086 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.087 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.087 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:25.088 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.088 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.088 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.088 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.089 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:43:25.089 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.089 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.089 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.090 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.090 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:43:25.090 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.090 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.090 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.091 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.091 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:25.091 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.092 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.092 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.092 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.092 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:43:25.093 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.093 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.093 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.093 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.094 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:43:25.094 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.094 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.094 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.095 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.095 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:25.095 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.095 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.096 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.096 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.096 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:25.097 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.097 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.097 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.097 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.098 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:25.098 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.098 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:25.099 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:25.099 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:25.099 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:25.099 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.099 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.100 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.100 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.100 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:25.101 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.101 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.101 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.101 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.102 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:25.102 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:25.102 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:25.102 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:25.102 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:25.270 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34667]: starting. 2021-05-26T16:43:25.271 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34667]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34666 2021-05-26T16:43:25.271 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34667]: created object 0... 2021-05-26T16:43:25.271 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34667]: created object 25... 2021-05-26T16:43:25.271 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34667]: created object 49... 2021-05-26T16:43:25.271 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34667]: finishing. 2021-05-26T16:43:25.272 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34667]: shutting down. 2021-05-26T16:43:25.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.283+0000 7fb888127700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:43:25.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.283+0000 7fb888127700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:43:25.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.283+0000 7fb888127700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:25.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.283+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb880069b10 con 0x7fb860007310 2021-05-26T16:43:25.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.283+0000 7fb86dffb700 1 -- 172.21.15.3:0/2819061435 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2644 (unknown 254746657 0 3612601018) 0x7fb870012ff0 con 0x7fb860007310 2021-05-26T16:43:25.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.283+0000 7fb86dffb700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:43:25.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.283+0000 7fb86dffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:25.287 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":16,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:43:25.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 >> v1:172.21.15.137:6812/30003 conn(0x7fb8600340b0 legacy=0x7fb860036570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 10 monclient: shutdown 2021-05-26T16:43:25.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:25.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 >> v1:172.21.15.3:6791/0 conn(0x7fb860007310 legacy=0x7fb88013c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 shutdown_connections 2021-05-26T16:43:25.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 >> 172.21.15.3:0/2819061435 conn(0x7fb8800a0db0 msgr2=0x7fb880098580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:25.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 shutdown_connections 2021-05-26T16:43:25.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.285+0000 7fb888127700 1 -- 172.21.15.3:0/2819061435 wait complete. 2021-05-26T16:43:25.299 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2021-05-26T16:43:25.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-05-26T16:43:25.415 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.413+0000 7fe1b135e700 10 monclient: get_monmap_and_config 2021-05-26T16:43:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.413+0000 7fe1b135e700 10 monclient: build_initial_monmap 2021-05-26T16:43:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.413+0000 7fe1b135e700 10 monclient: monmap: 2021-05-26T16:43:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:25.413907+0000 2021-05-26T16:43:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:25.413907+0000 2021-05-26T16:43:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:25.420 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.413+0000 7fe1b135e700 1 Processor -- start 2021-05-26T16:43:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.413+0000 7fe1b135e700 1 -- start start 2021-05-26T16:43:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.413+0000 7fe1b135e700 10 monclient: init 2021-05-26T16:43:25.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:25.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 10 monclient: _add_conns ranks=[6,3,2,1,8,4,5,0,7] 2021-05-26T16:43:25.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 10 monclient(hunting): picked mon.noname-d con 0x7fe1ac0973f0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:25.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 10 monclient(hunting): picked mon.noname-g con 0x7fe1ac094c80 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:25.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 10 monclient(hunting): picked mon.noname-b con 0x7fe1ac097e90 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:25.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac059750 con 0x7fe1ac097e90 2021-05-26T16:43:25.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0996d0 con 0x7fe1ac094c80 2021-05-26T16:43:25.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac064870 con 0x7fe1ac0973f0 2021-05-26T16:43:25.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:25.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1b135e700 10 monclient(hunting): authenticate will time out at 963.045401s 2021-05-26T16:43:25.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1ab7fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fe1ac097e90 0x7fe1ac135b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54244/0 (socket says 172.21.15.3:54244) 2021-05-26T16:43:25.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.414+0000 7fe1ab7fe700 1 -- 172.21.15.3:0/3418749524 learned_addr learned my addr 172.21.15.3:0/3418749524 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:25.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1ab7fe700 1 -- 172.21.15.3:0/3418749524 >> v1:172.21.15.3:6790/0 conn(0x7fe1ac097e90 legacy=0x7fe1ac135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1aaffd700 1 -- 172.21.15.3:0/3418749524 >> v1:172.21.15.3:6792/0 conn(0x7fe1ac0973f0 legacy=0x7fe1ac0988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742121554 0 0) 0x7fe1ac064870 con 0x7fe1ac0973f0 2021-05-26T16:43:25.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 10 monclient(hunting): my global_id is 4866 2021-05-26T16:43:25.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe198003270 con 0x7fe1ac0973f0 2021-05-26T16:43:25.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705652483 0 0) 0x7fe1ac059750 con 0x7fe1ac097e90 2021-05-26T16:43:25.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 10 monclient(hunting): my global_id is 4907 2021-05-26T16:43:25.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac064870 con 0x7fe1ac097e90 2021-05-26T16:43:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.416+0000 7fe1aa7fc700 1 -- 172.21.15.3:0/3418749524 >> v1:172.21.15.137:6790/0 conn(0x7fe1ac094c80 legacy=0x7fe1ac098fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702511575 0 0) 0x7fe1ac0996d0 con 0x7fe1ac094c80 2021-05-26T16:43:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient(hunting): my global_id is 4908 2021-05-26T16:43:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac059750 con 0x7fe1ac094c80 2021-05-26T16:43:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2647455564 0 0) 0x7fe198003270 con 0x7fe1ac0973f0 2021-05-26T16:43:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 >> v1:172.21.15.137:6790/0 conn(0x7fe1ac094c80 legacy=0x7fe1ac098fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 >> v1:172.21.15.3:6790/0 conn(0x7fe1ac097e90 legacy=0x7fe1ac135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 monclient: found mon.noname-d 2021-05-26T16:43:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:43:25.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac064b10 con 0x7fe1ac0973f0 2021-05-26T16:43:25.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:25.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:25.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe194001ab0 con 0x7fe1ac0973f0 2021-05-26T16:43:25.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 5 monclient: authenticate success, global_id 4866 2021-05-26T16:43:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: dump: 2021-05-26T16:43:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.444 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.444 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.444 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.444 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.444 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.445 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.445 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:25.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe194001f00 con 0x7fe1ac0973f0 2021-05-26T16:43:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 1 -- 172.21.15.3:0/3418749524 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe1940023b0 con 0x7fe1ac0973f0 2021-05-26T16:43:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 4 set_mon_vals no callback set 2021-05-26T16:43:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1a9ffb700 10 monclient: dump: 2021-05-26T16:43:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.450 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 10 monclient: shutdown 2021-05-26T16:43:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 1 -- 172.21.15.3:0/3418749524 >> v1:172.21.15.3:6792/0 conn(0x7fe1ac0973f0 legacy=0x7fe1ac0988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 1 -- 172.21.15.3:0/3418749524 shutdown_connections 2021-05-26T16:43:25.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 1 -- 172.21.15.3:0/3418749524 >> 172.21.15.3:0/3418749524 conn(0x7fe1ac09a9b0 msgr2=0x7fe1ac09adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:25.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 1 -- 172.21.15.3:0/3418749524 shutdown_connections 2021-05-26T16:43:25.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.417+0000 7fe1b135e700 1 -- 172.21.15.3:0/3418749524 wait complete. 2021-05-26T16:43:25.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.418+0000 7fe1b135e700 10 monclient: build_initial_monmap 2021-05-26T16:43:25.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.418+0000 7fe1b135e700 10 monclient: monmap: 2021-05-26T16:43:25.453 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:25.453 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:25.453 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:25.453 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:25.454 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:25.454 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.454 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:25.454 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:25.454 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:25.455 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:25.455 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:25.455 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:25.455 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:25.456 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:25.456 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:25.456 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.418+0000 7fe1b135e700 1 Processor -- start 2021-05-26T16:43:25.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.418+0000 7fe1b135e700 1 -- start start 2021-05-26T16:43:25.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.418+0000 7fe1b135e700 10 monclient: init 2021-05-26T16:43:25.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:25.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 10 monclient: _add_conns ranks=[0,8,1,5,4,7,2,6,3] 2021-05-26T16:43:25.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 10 monclient(hunting): picked mon.noname-a con 0x7fe1ac0973f0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:25.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 10 monclient(hunting): picked mon.noname-e con 0x7fe1ac097e90 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:25.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 10 monclient(hunting): picked mon.noname-f con 0x7fe1ac13cc80 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:25.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac119aa0 con 0x7fe1ac0973f0 2021-05-26T16:43:25.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac119cd0 con 0x7fe1ac13cc80 2021-05-26T16:43:25.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac119f70 con 0x7fe1ac097e90 2021-05-26T16:43:25.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:25.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1b135e700 10 monclient(hunting): authenticate will time out at 963.050429s 2021-05-26T16:43:25.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1aaffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe1ac0973f0 0x7fe1ac13c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52204/0 (socket says 172.21.15.3:52204) 2021-05-26T16:43:25.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1aa7fc700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fe1ac097e90 0x7fe1ac1412a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53286/0 (socket says 172.21.15.3:53286) 2021-05-26T16:43:25.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.419+0000 7fe1aaffd700 1 -- 172.21.15.3:0/1066121108 learned_addr learned my addr 172.21.15.3:0/1066121108 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:25.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe1aa7fc700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6793/0 conn(0x7fe1ac097e90 legacy=0x7fe1ac1412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe1aaffd700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe1ac0973f0 legacy=0x7fe1ac13c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708496917 0 0) 0x7fe1ac119f70 con 0x7fe1ac097e90 2021-05-26T16:43:25.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 10 monclient(hunting): my global_id is 104111 2021-05-26T16:43:25.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c003270 con 0x7fe1ac097e90 2021-05-26T16:43:25.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274631006 0 0) 0x7fe1ac119aa0 con 0x7fe1ac0973f0 2021-05-26T16:43:25.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 10 monclient(hunting): my global_id is 104103 2021-05-26T16:43:25.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.421+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac119f70 con 0x7fe1ac0973f0 2021-05-26T16:43:25.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1ab7fe700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.137:6789/0 conn(0x7fe1ac13cc80 legacy=0x7fe1ac1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4192457052 0 0) 0x7fe18c003270 con 0x7fe1ac097e90 2021-05-26T16:43:25.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1ac119aa0 con 0x7fe1ac097e90 2021-05-26T16:43:25.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe1a0001c80 con 0x7fe1ac097e90 2021-05-26T16:43:25.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:25.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): dump: 2021-05-26T16:43:25.464 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.464 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.464 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.464 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.465 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.465 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.465 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.465 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.466 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.466 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.466 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.466 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.466 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.467 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.467 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.467 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:25.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243887281 0 0) 0x7fe1ac119cd0 con 0x7fe1ac13cc80 2021-05-26T16:43:25.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): my global_id is 4888 2021-05-26T16:43:25.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c003270 con 0x7fe1ac13cc80 2021-05-26T16:43:25.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3164952036 0 0) 0x7fe1ac119f70 con 0x7fe1ac0973f0 2021-05-26T16:43:25.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1ac119cd0 con 0x7fe1ac0973f0 2021-05-26T16:43:25.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe1940023b0 con 0x7fe1ac0973f0 2021-05-26T16:43:25.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:25.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient(hunting): dump: 2021-05-26T16:43:25.470 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.470 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.471 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.471 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.471 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.471 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.471 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.472 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.472 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.472 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.472 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.472 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.473 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.473 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.473 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.473 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2728251828 0 0) 0x7fe1ac119aa0 con 0x7fe1ac097e90 2021-05-26T16:43:25.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.137:6789/0 conn(0x7fe1ac13cc80 legacy=0x7fe1ac1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe1ac0973f0 legacy=0x7fe1ac13c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:25.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 monclient: found mon.e 2021-05-26T16:43:25.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:25.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:25.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac11a210 con 0x7fe1ac097e90 2021-05-26T16:43:25.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient: _finish_auth 0 2021-05-26T16:43:25.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:25.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1b135e700 5 monclient: authenticate success, global_id 104111 2021-05-26T16:43:25.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1b135e700 10 monclient: _renew_subs 2021-05-26T16:43:25.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1b135e700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:25.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac0943a0 con 0x7fe1ac097e90 2021-05-26T16:43:25.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1b135e700 10 monclient: _renew_subs 2021-05-26T16:43:25.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1b135e700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:25.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac130fb0 con 0x7fe1ac097e90 2021-05-26T16:43:25.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe1a0002350 con 0x7fe1ac097e90 2021-05-26T16:43:25.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:25.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe1a0002800 con 0x7fe1ac097e90 2021-05-26T16:43:25.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe1a97fa700 4 set_mon_vals no callback set 2021-05-26T16:43:25.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:25.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.422+0000 7fe192ffd700 10 monclient: dump: 2021-05-26T16:43:25.479 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.479 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.479 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.479 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.480 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.480 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.480 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.480 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.481 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.481 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.481 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.481 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.481 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.482 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.482 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.482 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.423+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fe1a0002960 con 0x7fe1ac097e90 2021-05-26T16:43:25.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.423+0000 7fe1b135e700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:25.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.423+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe1840065a0 con 0x7fe184002840 2021-05-26T16:43:25.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.423+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(108..108 src has 1..108) v4 ==== 3941+0+0 (unknown 3069717326 0 0) 0x7fe1a003d940 con 0x7fe1ac097e90 2021-05-26T16:43:25.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.423+0000 7fe1aaffd700 10 monclient: get_auth_request con 0x7fe18c033070 auth_method 0 2021-05-26T16:43:25.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.425+0000 7fe1ab7fe700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe184002840 legacy=0x7fe184004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.425+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638197261 0 0) 0x7fe1840065a0 con 0x7fe184002840 2021-05-26T16:43:25.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.425+0000 7fe192ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.425+0000 7fe192ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.425+0000 7fe192ffd700 10 monclient(hunting): my global_id is 104112 2021-05-26T16:43:25.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.425+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac119aa0 con 0x7fe184002840 2021-05-26T16:43:25.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.425+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1246712353 0 0) 0x7fe1ac119aa0 con 0x7fe184002840 2021-05-26T16:43:25.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1840065a0 con 0x7fe184002840 2021-05-26T16:43:25.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe19c002110 con 0x7fe184002840 2021-05-26T16:43:25.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:25.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 10 monclient: dump: 2021-05-26T16:43:25.486 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.486 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.486 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.487 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.487 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.487 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.487 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.487 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.488 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.488 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.488 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.488 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.489 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.489 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.489 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.489 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2412553748 0 0) 0x7fe1840065a0 con 0x7fe184002840 2021-05-26T16:43:25.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe184009e40 con 0x7fe184002840 2021-05-26T16:43:25.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe19c006910 con 0x7fe184002840 2021-05-26T16:43:25.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:25.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:25.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe184002840 legacy=0x7fe184004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.426+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe184002840 legacy=0x7fe184004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:25.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.433+0000 7fe1b135e700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:25.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.433+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe184009ad0 con 0x7fe184008d90 2021-05-26T16:43:25.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe1ab7fe700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe184008d90 legacy=0x7fe184009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142915579 0 0) 0x7fe184009ad0 con 0x7fe184008d90 2021-05-26T16:43:25.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 10 monclient(hunting): my global_id is 104121 2021-05-26T16:43:25.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1840065a0 con 0x7fe184008d90 2021-05-26T16:43:25.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1664633511 0 0) 0x7fe1840065a0 con 0x7fe184008d90 2021-05-26T16:43:25.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe184009ad0 con 0x7fe184008d90 2021-05-26T16:43:25.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe19c0050d0 con 0x7fe184008d90 2021-05-26T16:43:25.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:25.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.435+0000 7fe192ffd700 10 monclient: dump: 2021-05-26T16:43:25.497 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.497 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.497 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.497 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.497 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.498 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.498 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.498 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.498 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.498 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.499 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.499 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.499 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.499 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.500 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.500 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2043040828 0 0) 0x7fe184009ad0 con 0x7fe184008d90 2021-05-26T16:43:25.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 --> v1:172.21.15.3:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe184008740 con 0x7fe184008d90 2021-05-26T16:43:25.500 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7324 (unknown 0 0 824758864) 0x7fe19c006a80 con 0x7fe184008d90 2021-05-26T16:43:25.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe192ffd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:25.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe192ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:25.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe184008d90 legacy=0x7fe184009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe192ffd700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6789/0 conn(0x7fe184008d90 legacy=0x7fe184009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:25.502 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:25.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:25.502 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:25.502 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "leader", 2021-05-26T16:43:25.503 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:25.503 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:25.503 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:25.503 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:25.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:25.504 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:25.504 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:25.504 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:25.504 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:25.505 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:25.505 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:25.505 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.505 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 0, 2021-05-26T16:43:25.505 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:25.506 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:25.506 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:25.506 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:25.506 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:25.507 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:25.507 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:25.507 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:25.507 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:25.507 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:25.508 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:25.508 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:25.508 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.508 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:25.508 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:25.509 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:25.509 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:25.509 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:25.509 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:25.510 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:25.510 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:25.510 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:25.510 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:25.510 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:25.511 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.511 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:25.511 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:25.511 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:25.512 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:25.512 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:25.512 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:25.512 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:25.513 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:25.513 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:25.513 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:25.513 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:25.513 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:25.514 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:25.514 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:25.514 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:25.514 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:25.515 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:25.515 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:25.515 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:25.515 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:25.515 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:25.516 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:25.516 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:25.516 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:25.516 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.516 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:25.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.517 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:25.517 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.517 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:25.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:25.518 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.518 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.518 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.518 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.519 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:25.519 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.519 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.519 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.520 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:25.520 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:25.520 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.520 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.521 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.521 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.521 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:25.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:25.522 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.522 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.522 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.522 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.523 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:25.523 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.523 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.523 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.524 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:25.524 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:25.524 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.525 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.525 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.525 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.525 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:25.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:25.526 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.526 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.526 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.527 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.527 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:25.527 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.527 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.527 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.528 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:25.528 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:25.528 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.528 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.529 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.529 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.529 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:25.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:25.530 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.530 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.530 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.530 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.531 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:25.531 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.531 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.531 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.532 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:25.532 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:25.532 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.532 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.533 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.533 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.533 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:25.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:25.534 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.534 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.534 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.534 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.535 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:25.535 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.535 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.535 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.536 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:25.536 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:25.536 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.536 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.537 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.537 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.537 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:25.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:25.538 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.538 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.538 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.538 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.539 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:25.539 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.539 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.539 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.540 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:25.540 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:25.540 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.540 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.540 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.541 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.541 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:25.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:25.542 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.542 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.542 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.542 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.542 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:25.543 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.543 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.543 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.543 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:25.544 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:25.544 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.544 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.544 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.545 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.545 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:25.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:25.545 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.546 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.546 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.546 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.546 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:25.546 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.547 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.547 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.547 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:25.548 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:25.548 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.548 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.548 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.549 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.549 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:25.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:25.549 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.549 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.550 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.550 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.550 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:25.550 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.550 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.551 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.551 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:25.551 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:25.551 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.552 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.552 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.552 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.552 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.553 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:25.553 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:25.553 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.553 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:25.554 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:25.554 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:25.554 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.554 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.554 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:25.555 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.555 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:25.555 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:25.555 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:25.555 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.556 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.556 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:25.556 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:25.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.137:6812/30003 conn(0x7fe18c033070 legacy=0x7fe18c035530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 10 monclient: shutdown 2021-05-26T16:43:25.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:25.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 >> v1:172.21.15.3:6793/0 conn(0x7fe1ac097e90 legacy=0x7fe1ac1412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1ab7fe700 1 -- 172.21.15.3:0/1066121108 reap_dead start 2021-05-26T16:43:25.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1ab7fe700 1 -- 172.21.15.3:0/1066121108 reap_dead start 2021-05-26T16:43:25.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 shutdown_connections 2021-05-26T16:43:25.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 >> 172.21.15.3:0/1066121108 conn(0x7fe1ac09a9b0 msgr2=0x7fe1ac09cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:25.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 shutdown_connections 2021-05-26T16:43:25.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.436+0000 7fe1b135e700 1 -- 172.21.15.3:0/1066121108 wait complete. 2021-05-26T16:43:25.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-05-26T16:43:25.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.675+0000 7fd274248700 10 monclient: get_monmap_and_config 2021-05-26T16:43:25.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.675+0000 7fd274248700 10 monclient: build_initial_monmap 2021-05-26T16:43:25.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.675+0000 7fd274248700 10 monclient: monmap: 2021-05-26T16:43:25.678 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:25.678 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.678 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:25.675639+0000 2021-05-26T16:43:25.678 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:25.675639+0000 2021-05-26T16:43:25.679 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:25.679 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.679 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:25.679 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:25.679 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:25.680 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:25.680 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:25.680 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:25.680 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:25.680 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:25.681 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:25.681 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.675+0000 7fd274248700 1 Processor -- start 2021-05-26T16:43:25.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.675+0000 7fd274248700 1 -- start start 2021-05-26T16:43:25.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.675+0000 7fd274248700 10 monclient: init 2021-05-26T16:43:25.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:25.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 10 monclient: _add_conns ranks=[3,0,2,6,5,1,8,7,4] 2021-05-26T16:43:25.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 10 monclient(hunting): picked mon.noname-g con 0x7fd26c096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:25.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 10 monclient(hunting): picked mon.noname-a con 0x7fd26c099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:25.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 10 monclient(hunting): picked mon.noname-b con 0x7fd26c09a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:25.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c059750 con 0x7fd26c099db0 2021-05-26T16:43:25.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c064620 con 0x7fd26c09a260 2021-05-26T16:43:25.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c064e50 con 0x7fd26c096ca0 2021-05-26T16:43:25.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:25.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd274248700 10 monclient(hunting): authenticate will time out at 963.307357s 2021-05-26T16:43:25.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd2717e3700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd26c099db0 0x7fd26c132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52216/0 (socket says 172.21.15.3:52216) 2021-05-26T16:43:25.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd2717e3700 1 -- 172.21.15.3:0/3300862693 learned_addr learned my addr 172.21.15.3:0/3300862693 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:25.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.676+0000 7fd2727e5700 1 --1- 172.21.15.3:0/3300862693 >> v1:172.21.15.3:6790/0 conn(0x7fd26c09a260 0x7fd26c1357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54262/0 (socket says 172.21.15.3:54262) 2021-05-26T16:43:25.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.678+0000 7fd2717e3700 1 -- 172.21.15.3:0/3300862693 >> v1:172.21.15.3:6789/0 conn(0x7fd26c099db0 legacy=0x7fd26c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.678+0000 7fd2727e5700 1 -- 172.21.15.3:0/3300862693 >> v1:172.21.15.3:6790/0 conn(0x7fd26c09a260 legacy=0x7fd26c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.678+0000 7fd271fe4700 1 -- 172.21.15.3:0/3300862693 >> v1:172.21.15.137:6790/0 conn(0x7fd26c096ca0 legacy=0x7fd26c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768951707 0 0) 0x7fd26c064e50 con 0x7fd26c096ca0 2021-05-26T16:43:25.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): my global_id is 4917 2021-05-26T16:43:25.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd254003270 con 0x7fd26c096ca0 2021-05-26T16:43:25.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108315961 0 0) 0x7fd26c059750 con 0x7fd26c099db0 2021-05-26T16:43:25.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): my global_id is 104130 2021-05-26T16:43:25.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c064e50 con 0x7fd26c099db0 2021-05-26T16:43:25.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585515705 0 0) 0x7fd26c064620 con 0x7fd26c09a260 2021-05-26T16:43:25.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient(hunting): my global_id is 4916 2021-05-26T16:43:25.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c059750 con 0x7fd26c09a260 2021-05-26T16:43:25.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2149371273 0 0) 0x7fd254003270 con 0x7fd26c096ca0 2021-05-26T16:43:25.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 >> v1:172.21.15.3:6790/0 conn(0x7fd26c09a260 legacy=0x7fd26c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 >> v1:172.21.15.3:6789/0 conn(0x7fd26c099db0 legacy=0x7fd26c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: _finish_hunting 0 2021-05-26T16:43:25.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 monclient: found mon.noname-g 2021-05-26T16:43:25.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:25.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.137:6790/0 2021-05-26T16:43:25.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c09c390 con 0x7fd26c096ca0 2021-05-26T16:43:25.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: _finish_auth 0 2021-05-26T16:43:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd260001ab0 con 0x7fd26c096ca0 2021-05-26T16:43:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:43:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: dump: 2021-05-26T16:43:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.698 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.698 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.698 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.698 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.698 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.699 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.699 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.699 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.699 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.700 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd274248700 5 monclient: authenticate success, global_id 4917 2021-05-26T16:43:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd274248700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 <== mon.3 v1:172.21.15.137:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd260001f00 con 0x7fd26c096ca0 2021-05-26T16:43:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 1 -- 172.21.15.3:0/3300862693 <== mon.3 v1:172.21.15.137:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd2600023b0 con 0x7fd26c096ca0 2021-05-26T16:43:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd274248700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd274248700 4 set_mon_vals no callback set 2021-05-26T16:43:25.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:25.702 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.679+0000 7fd270fe2700 10 monclient: dump: 2021-05-26T16:43:25.702 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.704 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.704 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.704 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.704 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.704 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.705 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 10 monclient: shutdown 2021-05-26T16:43:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 1 -- 172.21.15.3:0/3300862693 >> v1:172.21.15.137:6790/0 conn(0x7fd26c096ca0 legacy=0x7fd26c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 1 -- 172.21.15.3:0/3300862693 shutdown_connections 2021-05-26T16:43:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 1 -- 172.21.15.3:0/3300862693 >> 172.21.15.3:0/3300862693 conn(0x7fd26c09cc00 msgr2=0x7fd26c09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 1 -- 172.21.15.3:0/3300862693 shutdown_connections 2021-05-26T16:43:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 1 -- 172.21.15.3:0/3300862693 wait complete. 2021-05-26T16:43:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 10 monclient: build_initial_monmap 2021-05-26T16:43:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 10 monclient: monmap: 2021-05-26T16:43:25.708 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:25.708 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:25.708 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:25.708 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:25.708 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:25.709 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.709 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:25.709 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:25.709 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:25.709 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:25.710 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:25.710 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:25.710 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:25.710 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:25.710 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:25.711 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 1 Processor -- start 2021-05-26T16:43:25.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 1 -- start start 2021-05-26T16:43:25.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.680+0000 7fd274248700 10 monclient: init 2021-05-26T16:43:25.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:25.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 10 monclient: _add_conns ranks=[6,8,1,5,0,3,2,4,7] 2021-05-26T16:43:25.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 10 monclient(hunting): picked mon.noname-d con 0x7fd26c096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:25.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 10 monclient(hunting): picked mon.noname-e con 0x7fd26c099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:25.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 10 monclient(hunting): picked mon.noname-f con 0x7fd26c09a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:25.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c11cca0 con 0x7fd26c09a260 2021-05-26T16:43:25.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c11cf40 con 0x7fd26c096ca0 2021-05-26T16:43:25.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c11d1e0 con 0x7fd26c099db0 2021-05-26T16:43:25.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:25.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd274248700 10 monclient(hunting): authenticate will time out at 963.312435s 2021-05-26T16:43:25.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd271fe4700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fd26c096ca0 0x7fd26c13bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57622/0 (socket says 172.21.15.3:57622) 2021-05-26T16:43:25.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.681+0000 7fd271fe4700 1 -- 172.21.15.3:0/2383227599 learned_addr learned my addr 172.21.15.3:0/2383227599 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:25.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.683+0000 7fd271fe4700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6792/0 conn(0x7fd26c096ca0 legacy=0x7fd26c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.683+0000 7fd2717e3700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6793/0 conn(0x7fd26c099db0 legacy=0x7fd26c13c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.683+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 DispatchQueue::entry inject delay of 0.002000 2021-05-26T16:43:25.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.683+0000 7fd2727e5700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.137:6789/0 conn(0x7fd26c09a260 legacy=0x7fd26c143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149711124 0 0) 0x7fd26c11cf40 con 0x7fd26c096ca0 2021-05-26T16:43:25.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): my global_id is 4875 2021-05-26T16:43:25.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd24c003270 con 0x7fd26c096ca0 2021-05-26T16:43:25.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745105982 0 0) 0x7fd26c11d1e0 con 0x7fd26c099db0 2021-05-26T16:43:25.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): my global_id is 104120 2021-05-26T16:43:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c11cf40 con 0x7fd26c099db0 2021-05-26T16:43:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118090659 0 0) 0x7fd26c11cca0 con 0x7fd26c09a260 2021-05-26T16:43:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 10 monclient(hunting): my global_id is 4897 2021-05-26T16:43:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.685+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c11d1e0 con 0x7fd26c09a260 2021-05-26T16:43:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1210151828 0 0) 0x7fd24c003270 con 0x7fd26c096ca0 2021-05-26T16:43:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd26c11cca0 con 0x7fd26c096ca0 2021-05-26T16:43:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd2600023b0 con 0x7fd26c096ca0 2021-05-26T16:43:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.729 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.729 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.729 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:25.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3436737968 0 0) 0x7fd26c11cf40 con 0x7fd26c099db0 2021-05-26T16:43:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd24c003270 con 0x7fd26c099db0 2021-05-26T16:43:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd25c001d80 con 0x7fd26c099db0 2021-05-26T16:43:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.734 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1969111224 0 0) 0x7fd26c11d1e0 con 0x7fd26c09a260 2021-05-26T16:43:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd26c11cf40 con 0x7fd26c09a260 2021-05-26T16:43:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd268001b80 con 0x7fd26c09a260 2021-05-26T16:43:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.737 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.737 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.737 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.737 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.739 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1465688580 0 0) 0x7fd26c11cca0 con 0x7fd26c096ca0 2021-05-26T16:43:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6793/0 conn(0x7fd26c099db0 legacy=0x7fd26c13c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.137:6789/0 conn(0x7fd26c09a260 legacy=0x7fd26c143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 monclient: found mon.d 2021-05-26T16:43:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c11b070 con 0x7fd26c096ca0 2021-05-26T16:43:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd274248700 5 monclient: authenticate success, global_id 4875 2021-05-26T16:43:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd274248700 10 monclient: _renew_subs 2021-05-26T16:43:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd274248700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c11db40 con 0x7fd26c096ca0 2021-05-26T16:43:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd260002960 con 0x7fd26c096ca0 2021-05-26T16:43:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd260001d80 con 0x7fd26c096ca0 2021-05-26T16:43:25.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:25.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd259ffb700 10 monclient: dump: 2021-05-26T16:43:25.743 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.746 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.746 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.746 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.746 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.747 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd274248700 10 monclient: _renew_subs 2021-05-26T16:43:25.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd25bfff700 4 set_mon_vals no callback set 2021-05-26T16:43:25.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd274248700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:25.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.686+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c11a4d0 con 0x7fd26c096ca0 2021-05-26T16:43:25.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.687+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fd26000e920 con 0x7fd26c096ca0 2021-05-26T16:43:25.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.687+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(108..108 src has 1..108) v4 ==== 3941+0+0 (unknown 3069717326 0 0) 0x7fd26003dcb0 con 0x7fd26c096ca0 2021-05-26T16:43:25.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.687+0000 7fd274248700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:25.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.687+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd26c06c030 con 0x7fd26c094a60 2021-05-26T16:43:25.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.687+0000 7fd2717e3700 10 monclient: get_auth_request con 0x7fd24c0335a0 auth_method 0 2021-05-26T16:43:25.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd2727e5700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6790/0 conn(0x7fd26c094a60 legacy=0x7fd26c094e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902556953 0 0) 0x7fd26c06c030 con 0x7fd26c094a60 2021-05-26T16:43:25.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 10 monclient(hunting): my global_id is 4925 2021-05-26T16:43:25.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c11cca0 con 0x7fd26c094a60 2021-05-26T16:43:25.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1527280618 0 0) 0x7fd26c11cca0 con 0x7fd26c094a60 2021-05-26T16:43:25.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd26c06c030 con 0x7fd26c094a60 2021-05-26T16:43:25.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd268004bf0 con 0x7fd26c094a60 2021-05-26T16:43:25.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:25.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.689+0000 7fd259ffb700 10 monclient: dump: 2021-05-26T16:43:25.751 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.754 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.754 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.754 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.754 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.754 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.690+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3991266267 0 0) 0x7fd26c06c030 con 0x7fd26c094a60 2021-05-26T16:43:25.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.690+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd26c11a780 con 0x7fd26c094a60 2021-05-26T16:43:25.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.690+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fd268005160 con 0x7fd26c094a60 2021-05-26T16:43:25.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.690+0000 7fd259ffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:25.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.690+0000 7fd259ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:25.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.690+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6790/0 conn(0x7fd26c094a60 legacy=0x7fd26c094e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.690+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6790/0 conn(0x7fd26c094a60 legacy=0x7fd26c094e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:25.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.696+0000 7fd274248700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:25.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.696+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd26c069b10 con 0x7fd26c027d00 2021-05-26T16:43:25.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd2727e5700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6790/0 conn(0x7fd26c027d00 legacy=0x7fd26c149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106566851 0 0) 0x7fd26c069b10 con 0x7fd26c027d00 2021-05-26T16:43:25.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 10 monclient(hunting): my global_id is 4934 2021-05-26T16:43:25.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c06c030 con 0x7fd26c027d00 2021-05-26T16:43:25.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2650508876 0 0) 0x7fd26c06c030 con 0x7fd26c027d00 2021-05-26T16:43:25.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd26c069b10 con 0x7fd26c027d00 2021-05-26T16:43:25.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd268005a40 con 0x7fd26c027d00 2021-05-26T16:43:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 10 monclient: dump: 2021-05-26T16:43:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.762 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.762 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.762 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.762 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.763 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1960306799 0 0) 0x7fd26c069b10 con 0x7fd26c027d00 2021-05-26T16:43:25.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.699+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 --> v1:172.21.15.3:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd26c095550 con 0x7fd26c027d00 2021-05-26T16:43:25.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 4059768437) 0x7fd268005eb0 con 0x7fd26c027d00 2021-05-26T16:43:25.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd259ffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd259ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6790/0 conn(0x7fd26c027d00 legacy=0x7fd26c149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd259ffb700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6790/0 conn(0x7fd26c027d00 legacy=0x7fd26c149690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:25.765 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:25.765 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:25.765 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:25.765 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:25.766 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:25.766 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:25.766 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:25.766 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:25.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:25.767 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:25.767 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:25.767 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:25.767 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:25.768 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:25.768 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:25.768 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.768 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 0, 2021-05-26T16:43:25.768 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:25.769 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:25.769 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:25.769 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:25.769 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:25.769 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:25.770 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:25.770 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:25.770 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:25.770 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:25.771 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:25.771 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:25.771 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.771 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:25.771 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:25.772 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:25.772 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:25.772 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:25.772 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:25.773 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:25.773 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:25.773 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:25.773 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:25.773 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:25.774 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.774 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:25.774 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:25.775 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:25.775 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:25.775 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:25.775 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:25.775 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:25.776 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:25.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:25.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:25.776 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:25.777 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:25.777 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:25.777 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:25.777 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:25.777 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:25.778 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:25.778 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:25.778 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:25.778 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:25.778 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:25.779 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:25.779 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:25.779 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:25.779 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.780 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:25.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.780 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:25.780 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.780 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:25.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:25.781 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.781 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.781 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.781 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.782 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:25.782 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.782 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.782 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.783 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:25.783 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:25.783 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.783 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.784 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.784 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.784 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:25.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:25.785 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.785 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.785 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.785 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.785 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:25.786 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.786 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.786 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.787 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:25.787 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:25.787 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.787 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.787 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.788 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.788 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:25.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:25.788 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.789 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.789 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.789 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.789 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:25.790 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.790 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.790 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.790 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:25.791 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:25.791 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.791 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.791 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.792 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.792 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:25.792 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:25.792 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.793 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.793 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.793 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.793 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:25.793 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.794 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.794 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.794 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:25.794 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:25.795 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.795 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.795 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.796 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.796 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:25.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:25.796 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.796 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.797 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.797 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.797 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:25.797 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.797 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.798 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.798 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.798 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:25.798 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:25.799 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.799 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.799 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.799 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.800 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:25.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:25.800 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.800 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.800 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.801 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.801 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:25.801 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.801 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.802 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.802 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:25.802 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:25.802 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.803 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.803 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.803 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.803 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:25.804 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:25.804 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.804 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.804 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.805 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.805 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:25.805 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.805 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.805 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.806 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:25.806 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:25.806 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.806 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.807 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.807 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.807 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:25.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:25.808 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.808 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.808 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.808 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.809 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:25.809 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.809 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.809 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.810 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:25.810 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:25.810 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.810 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.811 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.811 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.811 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:25.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:25.812 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:25.812 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:25.812 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.812 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:25.812 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:25.813 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:25.813 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.813 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.813 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:25.814 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:25.814 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:25.814 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:25.814 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:25.815 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.815 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.815 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:25.815 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:25.816 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.816 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:25.816 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:25.816 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:25.816 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.817 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:25.817 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:25.817 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:25.817 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:25.817 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:25.818 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:25.818 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:25.818 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:25.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:25.819 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:25.819 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:25.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.137:6812/30003 conn(0x7fd24c0335a0 legacy=0x7fd24c035a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 10 monclient: shutdown 2021-05-26T16:43:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 >> v1:172.21.15.3:6792/0 conn(0x7fd26c096ca0 legacy=0x7fd26c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd2727e5700 1 -- 172.21.15.3:0/2383227599 reap_dead start 2021-05-26T16:43:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 shutdown_connections 2021-05-26T16:43:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 >> 172.21.15.3:0/2383227599 conn(0x7fd26c09cc00 msgr2=0x7fd26c097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 shutdown_connections 2021-05-26T16:43:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.700+0000 7fd274248700 1 -- 172.21.15.3:0/2383227599 wait complete. 2021-05-26T16:43:25.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-05-26T16:43:25.939 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.936+0000 7fa38f3c0700 10 monclient: get_monmap_and_config 2021-05-26T16:43:25.939 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.936+0000 7fa38f3c0700 10 monclient: build_initial_monmap 2021-05-26T16:43:25.939 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.936+0000 7fa38f3c0700 10 monclient: monmap: 2021-05-26T16:43:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:25.937549+0000 2021-05-26T16:43:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:25.937549+0000 2021-05-26T16:43:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:25.941 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.941 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:25.941 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:25.941 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:25.942 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:25.942 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:25.942 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:25.942 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:25.942 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:25.943 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:25.943 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.937+0000 7fa38f3c0700 1 Processor -- start 2021-05-26T16:43:25.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.937+0000 7fa38f3c0700 1 -- start start 2021-05-26T16:43:25.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.937+0000 7fa38f3c0700 10 monclient: init 2021-05-26T16:43:25.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:25.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 10 monclient: _add_conns ranks=[2,8,5,0,3,1,7,6,4] 2021-05-26T16:43:25.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 10 monclient(hunting): picked mon.noname-b con 0x7fa388096ca0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:25.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 10 monclient(hunting): picked mon.noname-e con 0x7fa388099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:25.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 10 monclient(hunting): picked mon.noname-h con 0x7fa38809a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:25.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa388059750 con 0x7fa388096ca0 2021-05-26T16:43:25.956 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa388064620 con 0x7fa38809a260 2021-05-26T16:43:25.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa388064e50 con 0x7fa388099db0 2021-05-26T16:43:25.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:25.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38f3c0700 10 monclient(hunting): authenticate will time out at 963.569158s 2021-05-26T16:43:25.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38c95b700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fa388099db0 0x7fa388132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53314/0 (socket says 172.21.15.3:53314) 2021-05-26T16:43:25.957 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38d15c700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fa388096ca0 0x7fa388063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54276/0 (socket says 172.21.15.3:54276) 2021-05-26T16:43:25.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.938+0000 7fa38c95b700 1 -- 172.21.15.3:0/1743932602 learned_addr learned my addr 172.21.15.3:0/1743932602 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:25.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa38d15c700 1 -- 172.21.15.3:0/1743932602 >> v1:172.21.15.3:6790/0 conn(0x7fa388096ca0 legacy=0x7fa388063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa38c95b700 1 -- 172.21.15.3:0/1743932602 >> v1:172.21.15.3:6793/0 conn(0x7fa388099db0 legacy=0x7fa388132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711401743 0 0) 0x7fa388059750 con 0x7fa388096ca0 2021-05-26T16:43:25.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): my global_id is 4943 2021-05-26T16:43:25.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa38d95d700 1 -- 172.21.15.3:0/1743932602 >> v1:172.21.15.137:6791/0 conn(0x7fa38809a260 legacy=0x7fa3881357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa370003270 con 0x7fa388096ca0 2021-05-26T16:43:25.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237897740 0 0) 0x7fa388064e50 con 0x7fa388099db0 2021-05-26T16:43:25.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): my global_id is 104129 2021-05-26T16:43:25.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa388059750 con 0x7fa388099db0 2021-05-26T16:43:25.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577643901 0 0) 0x7fa388064620 con 0x7fa38809a260 2021-05-26T16:43:25.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient(hunting): my global_id is 5036 2021-05-26T16:43:25.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa388064e50 con 0x7fa38809a260 2021-05-26T16:43:25.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2872816473 0 0) 0x7fa370003270 con 0x7fa388096ca0 2021-05-26T16:43:25.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 >> v1:172.21.15.3:6793/0 conn(0x7fa388099db0 legacy=0x7fa388132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 >> v1:172.21.15.137:6791/0 conn(0x7fa38809a260 legacy=0x7fa3881357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:25.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 monclient: found mon.noname-b 2021-05-26T16:43:25.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:25.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:25.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38809c390 con 0x7fa388096ca0 2021-05-26T16:43:25.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient: _finish_auth 0 2021-05-26T16:43:25.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:25.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa37c001a50 con 0x7fa388096ca0 2021-05-26T16:43:25.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa38f3c0700 5 monclient: authenticate success, global_id 4943 2021-05-26T16:43:25.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa38f3c0700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:25.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.940+0000 7fa377fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:25.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 10 monclient: dump: 2021-05-26T16:43:25.966 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.966 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.966 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.966 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.966 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.967 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.967 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.967 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.967 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.968 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.968 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.968 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.968 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.968 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.969 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.969 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:25.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa37c001d60 con 0x7fa388096ca0 2021-05-26T16:43:25.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:25.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 1 -- 172.21.15.3:0/1743932602 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa37c004870 con 0x7fa388096ca0 2021-05-26T16:43:25.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:25.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 4 set_mon_vals no callback set 2021-05-26T16:43:25.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:25.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa377fff700 10 monclient: dump: 2021-05-26T16:43:25.971 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.971 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.972 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.972 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.972 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.972 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.972 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.973 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.973 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.973 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.973 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.973 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.974 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.974 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.974 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.974 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 10 monclient: shutdown 2021-05-26T16:43:25.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:25.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1743932602 >> v1:172.21.15.3:6790/0 conn(0x7fa388096ca0 legacy=0x7fa388063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:25.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1743932602 shutdown_connections 2021-05-26T16:43:25.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1743932602 >> 172.21.15.3:0/1743932602 conn(0x7fa38809cc00 msgr2=0x7fa38809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:25.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1743932602 shutdown_connections 2021-05-26T16:43:25.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.941+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1743932602 wait complete. 2021-05-26T16:43:25.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.942+0000 7fa38f3c0700 10 monclient: build_initial_monmap 2021-05-26T16:43:25.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.942+0000 7fa38f3c0700 10 monclient: monmap: 2021-05-26T16:43:25.977 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:25.977 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:25.977 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:25.977 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:25.977 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:25.978 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.978 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:25.978 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:25.978 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:25.979 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:25.979 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:25.979 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:25.979 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:25.979 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:25.980 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:25.980 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.942+0000 7fa38f3c0700 1 Processor -- start 2021-05-26T16:43:25.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.942+0000 7fa38f3c0700 1 -- start start 2021-05-26T16:43:25.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.942+0000 7fa38f3c0700 10 monclient: init 2021-05-26T16:43:25.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:25.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 10 monclient: _add_conns ranks=[8,6,1,4,5,2,3,7,0] 2021-05-26T16:43:25.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 10 monclient(hunting): picked mon.noname-e con 0x7fa388096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:25.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 10 monclient(hunting): picked mon.noname-d con 0x7fa388099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:25.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 10 monclient(hunting): picked mon.noname-f con 0x7fa38809a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:25.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3881168c0 con 0x7fa38809a260 2021-05-26T16:43:25.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa388116b60 con 0x7fa388099db0 2021-05-26T16:43:25.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa388116e00 con 0x7fa388096ca0 2021-05-26T16:43:25.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:25.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38f3c0700 10 monclient(hunting): authenticate will time out at 963.574209s 2021-05-26T16:43:25.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38d15c700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fa388096ca0 0x7fa38812d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53320/0 (socket says 172.21.15.3:53320) 2021-05-26T16:43:25.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.943+0000 7fa38d15c700 1 -- 172.21.15.3:0/1761333340 learned_addr learned my addr 172.21.15.3:0/1761333340 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:25.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa38c95b700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6792/0 conn(0x7fa388099db0 legacy=0x7fa38812dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa38d15c700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6793/0 conn(0x7fa388096ca0 legacy=0x7fa38812d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261009615 0 0) 0x7fa388116e00 con 0x7fa388096ca0 2021-05-26T16:43:25.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): my global_id is 104138 2021-05-26T16:43:25.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa368003270 con 0x7fa388096ca0 2021-05-26T16:43:25.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa38d95d700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.137:6789/0 conn(0x7fa38809a260 legacy=0x7fa388143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:25.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259094650 0 0) 0x7fa388116b60 con 0x7fa388099db0 2021-05-26T16:43:25.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): my global_id is 4884 2021-05-26T16:43:25.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa388116e00 con 0x7fa388099db0 2021-05-26T16:43:25.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047279606 0 0) 0x7fa3881168c0 con 0x7fa38809a260 2021-05-26T16:43:25.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:25.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:25.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): my global_id is 4906 2021-05-26T16:43:25.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa388116b60 con 0x7fa38809a260 2021-05-26T16:43:25.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 528526916 0 0) 0x7fa388116e00 con 0x7fa388099db0 2021-05-26T16:43:25.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa3881168c0 con 0x7fa388099db0 2021-05-26T16:43:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa378001d90 con 0x7fa388099db0 2021-05-26T16:43:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): dump: 2021-05-26T16:43:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.992 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:25.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3206364382 0 0) 0x7fa368003270 con 0x7fa388096ca0 2021-05-26T16:43:25.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa388116e00 con 0x7fa388096ca0 2021-05-26T16:43:25.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa37c004870 con 0x7fa388096ca0 2021-05-26T16:43:25.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.945+0000 7fa3757fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:25.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient(hunting): dump: 2021-05-26T16:43:25.993 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.994 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.994 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.994 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.994 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.995 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.995 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:25.995 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:25.995 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:25.995 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:25.996 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:25.996 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:25.996 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:25.996 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:25.996 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:25.997 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:25.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4141570294 0 0) 0x7fa388116b60 con 0x7fa38809a260 2021-05-26T16:43:25.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa368003270 con 0x7fa38809a260 2021-05-26T16:43:25.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa384002040 con 0x7fa38809a260 2021-05-26T16:43:25.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:25.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:25.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient(hunting): dump: 2021-05-26T16:43:25.998 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:25.998 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:25.999 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.999 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:25.999 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:25.999 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:25.999 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.000 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.000 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.000 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.000 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.000 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.001 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.001 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.001 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.001 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 159120010 0 0) 0x7fa3881168c0 con 0x7fa388099db0 2021-05-26T16:43:26.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6793/0 conn(0x7fa388096ca0 legacy=0x7fa38812d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.137:6789/0 conn(0x7fa38809a260 legacy=0x7fa388143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient: _finish_hunting 0 2021-05-26T16:43:26.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 monclient: found mon.d 2021-05-26T16:43:26.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:26.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:26.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38812f190 con 0x7fa388099db0 2021-05-26T16:43:26.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient: _finish_auth 0 2021-05-26T16:43:26.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:26.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa38f3c0700 5 monclient: authenticate success, global_id 4884 2021-05-26T16:43:26.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa38f3c0700 10 monclient: _renew_subs 2021-05-26T16:43:26.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa38f3c0700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:26.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38812fe60 con 0x7fa388099db0 2021-05-26T16:43:26.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa38f3c0700 10 monclient: _renew_subs 2021-05-26T16:43:26.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa38f3c0700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:26.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa388117380 con 0x7fa388099db0 2021-05-26T16:43:26.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa378004b20 con 0x7fa388099db0 2021-05-26T16:43:26.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:26.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa378004fd0 con 0x7fa388099db0 2021-05-26T16:43:26.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3777fe700 4 set_mon_vals no callback set 2021-05-26T16:43:26.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:26.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 10 monclient: dump: 2021-05-26T16:43:26.007 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.007 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.007 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.007 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.008 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.008 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.008 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.008 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.008 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.009 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.009 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.009 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.009 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.010 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.010 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.010 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.946+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fa37800e540 con 0x7fa388099db0 2021-05-26T16:43:26.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.947+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(108..108 src has 1..108) v4 ==== 3941+0+0 (unknown 3069717326 0 0) 0x7fa37803db20 con 0x7fa388099db0 2021-05-26T16:43:26.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.947+0000 7fa38f3c0700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.947+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa3600065a0 con 0x7fa360002840 2021-05-26T16:43:26.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.947+0000 7fa38d15c700 10 monclient: get_auth_request con 0x7fa3680334e0 auth_method 0 2021-05-26T16:43:26.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa38d95d700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6791/0 conn(0x7fa360002840 legacy=0x7fa360004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375534843 0 0) 0x7fa3600065a0 con 0x7fa360002840 2021-05-26T16:43:26.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 10 monclient(hunting): my global_id is 4972 2021-05-26T16:43:26.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3881168c0 con 0x7fa360002840 2021-05-26T16:43:26.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1596892017 0 0) 0x7fa3881168c0 con 0x7fa360002840 2021-05-26T16:43:26.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa3600065a0 con 0x7fa360002840 2021-05-26T16:43:26.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa384005dc0 con 0x7fa360002840 2021-05-26T16:43:26.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:26.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.949+0000 7fa3757fa700 10 monclient: dump: 2021-05-26T16:43:26.014 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.014 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.014 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.014 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.015 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.015 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.015 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.015 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.016 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.016 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.016 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.016 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.016 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.017 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.017 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.017 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.950+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1633423766 0 0) 0x7fa3600065a0 con 0x7fa360002840 2021-05-26T16:43:26.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.950+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa360009e40 con 0x7fa360002840 2021-05-26T16:43:26.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.950+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fa384002500 con 0x7fa360002840 2021-05-26T16:43:26.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.950+0000 7fa3757fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.950+0000 7fa3757fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:26.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.950+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6791/0 conn(0x7fa360002840 legacy=0x7fa360004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.950+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6791/0 conn(0x7fa360002840 legacy=0x7fa360004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.957+0000 7fa38f3c0700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:26.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.957+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa360009ad0 con 0x7fa360008d90 2021-05-26T16:43:26.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa38d95d700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6791/0 conn(0x7fa360008d90 legacy=0x7fa360009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859102927 0 0) 0x7fa360009ad0 con 0x7fa360008d90 2021-05-26T16:43:26.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 10 monclient(hunting): my global_id is 4981 2021-05-26T16:43:26.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3600065a0 con 0x7fa360008d90 2021-05-26T16:43:26.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2166210743 0 0) 0x7fa3600065a0 con 0x7fa360008d90 2021-05-26T16:43:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa360009ad0 con 0x7fa360008d90 2021-05-26T16:43:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa384002ce0 con 0x7fa360008d90 2021-05-26T16:43:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 10 monclient: dump: 2021-05-26T16:43:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.027 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 303107612 0 0) 0x7fa360009ad0 con 0x7fa360008d90 2021-05-26T16:43:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.959+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 --> v1:172.21.15.3:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa360008740 con 0x7fa360008d90 2021-05-26T16:43:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 2411748763) 0x7fa384008da0 con 0x7fa360008d90 2021-05-26T16:43:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa3757fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa3757fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6791/0 conn(0x7fa360008d90 legacy=0x7fa360009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa3757fa700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6791/0 conn(0x7fa360008d90 legacy=0x7fa360009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.029 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 0, 2021-05-26T16:43:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:26.085 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:26.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.137:6812/30003 conn(0x7fa3680334e0 legacy=0x7fa3680359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 10 monclient: shutdown 2021-05-26T16:43:26.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:26.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 >> v1:172.21.15.3:6792/0 conn(0x7fa388099db0 legacy=0x7fa38812dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38d95d700 1 -- 172.21.15.3:0/1761333340 reap_dead start 2021-05-26T16:43:26.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38d95d700 1 -- 172.21.15.3:0/1761333340 reap_dead start 2021-05-26T16:43:26.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 shutdown_connections 2021-05-26T16:43:26.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 >> 172.21.15.3:0/1761333340 conn(0x7fa38809cc00 msgr2=0x7fa38809f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:26.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 shutdown_connections 2021-05-26T16:43:26.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:25.960+0000 7fa38f3c0700 1 -- 172.21.15.3:0/1761333340 wait complete. 2021-05-26T16:43:26.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2021-05-26T16:43:26.151 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34668]: starting. 2021-05-26T16:43:26.151 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34668]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34666 2021-05-26T16:43:26.152 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34668]: shutting down. 2021-05-26T16:43:26.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.212+0000 7f5fabe43700 10 monclient: get_monmap_and_config 2021-05-26T16:43:26.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.212+0000 7f5fabe43700 10 monclient: build_initial_monmap 2021-05-26T16:43:26.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.212+0000 7f5fabe43700 10 monclient: monmap: 2021-05-26T16:43:26.215 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:26.215 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.216 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:26.213095+0000 2021-05-26T16:43:26.216 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:26.213095+0000 2021-05-26T16:43:26.216 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:26.216 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.216 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:26.217 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:26.217 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:26.217 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:26.217 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:26.218 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:26.218 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:26.218 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:26.218 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:26.218 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 1 Processor -- start 2021-05-26T16:43:26.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 1 -- start start 2021-05-26T16:43:26.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient: init 2021-05-26T16:43:26.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:26.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient: _add_conns ranks=[0,2,5,4,3,1,6,8,7] 2021-05-26T16:43:26.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient(hunting): picked mon.noname-a con 0x7f5fa4096ca0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:26.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient(hunting): picked mon.noname-b con 0x7f5fa4099db0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:26.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient(hunting): picked mon.noname-h con 0x7f5fa409a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:26.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa4059750 con 0x7f5fa4096ca0 2021-05-26T16:43:26.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa4064620 con 0x7f5fa4099db0 2021-05-26T16:43:26.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa4064e50 con 0x7f5fa409a260 2021-05-26T16:43:26.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:26.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fabe43700 10 monclient(hunting): authenticate will time out at 963.844719s 2021-05-26T16:43:26.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fa9bdf700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5fa4096ca0 0x7f5fa4063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52254/0 (socket says 172.21.15.3:52254) 2021-05-26T16:43:26.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fa93de700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f5fa4099db0 0x7f5fa4132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54298/0 (socket says 172.21.15.3:54298) 2021-05-26T16:43:26.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.213+0000 7f5fa9bdf700 1 -- 172.21.15.3:0/3228467431 learned_addr learned my addr 172.21.15.3:0/3228467431 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:26.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa9bdf700 1 -- 172.21.15.3:0/3228467431 >> v1:172.21.15.3:6789/0 conn(0x7f5fa4096ca0 legacy=0x7f5fa4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa93de700 1 -- 172.21.15.3:0/3228467431 >> v1:172.21.15.3:6790/0 conn(0x7f5fa4099db0 legacy=0x7f5fa4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331269936 0 0) 0x7f5fa4059750 con 0x7f5fa4096ca0 2021-05-26T16:43:26.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient(hunting): my global_id is 104148 2021-05-26T16:43:26.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f8c003270 con 0x7f5fa4096ca0 2021-05-26T16:43:26.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855313150 0 0) 0x7f5fa4064620 con 0x7f5fa4099db0 2021-05-26T16:43:26.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient(hunting): my global_id is 4961 2021-05-26T16:43:26.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa4059750 con 0x7f5fa4099db0 2021-05-26T16:43:26.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5faa3e0700 1 -- 172.21.15.3:0/3228467431 >> v1:172.21.15.137:6791/0 conn(0x7f5fa409a260 legacy=0x7f5fa41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1775177930 0 0) 0x7f5fa4059750 con 0x7f5fa4099db0 2021-05-26T16:43:26.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 >> v1:172.21.15.137:6791/0 conn(0x7f5fa409a260 legacy=0x7f5fa41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 >> v1:172.21.15.3:6789/0 conn(0x7f5fa4096ca0 legacy=0x7f5fa4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:26.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 monclient: found mon.noname-b 2021-05-26T16:43:26.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:26.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:26.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa409c390 con 0x7f5fa4099db0 2021-05-26T16:43:26.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: _finish_auth 0 2021-05-26T16:43:26.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:26.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fabe43700 5 monclient: authenticate success, global_id 4961 2021-05-26T16:43:26.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5f94001a60 con 0x7f5fa4099db0 2021-05-26T16:43:26.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:26.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: dump: 2021-05-26T16:43:26.238 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.238 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.239 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.239 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.239 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.239 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.239 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.240 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.240 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.240 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.240 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.241 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.241 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.241 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.241 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.241 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fabe43700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:26.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5f94001d70 con 0x7f5fa4099db0 2021-05-26T16:43:26.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:26.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 1 -- 172.21.15.3:0/3228467431 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5f94004870 con 0x7f5fa4099db0 2021-05-26T16:43:26.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:26.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fa8bdd700 10 monclient: dump: 2021-05-26T16:43:26.243 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.243 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.244 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.244 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.244 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.244 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.244 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.245 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.245 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.245 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.245 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.245 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.246 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.246 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.246 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.246 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fabe43700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:26.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.216+0000 7f5fabe43700 4 set_mon_vals no callback set 2021-05-26T16:43:26.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 10 monclient: shutdown 2021-05-26T16:43:26.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:26.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 1 -- 172.21.15.3:0/3228467431 >> v1:172.21.15.3:6790/0 conn(0x7f5fa4099db0 legacy=0x7f5fa4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 1 -- 172.21.15.3:0/3228467431 shutdown_connections 2021-05-26T16:43:26.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 1 -- 172.21.15.3:0/3228467431 >> 172.21.15.3:0/3228467431 conn(0x7f5fa409cc00 msgr2=0x7f5fa409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:26.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 1 -- 172.21.15.3:0/3228467431 shutdown_connections 2021-05-26T16:43:26.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 1 -- 172.21.15.3:0/3228467431 wait complete. 2021-05-26T16:43:26.249 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 10 monclient: build_initial_monmap 2021-05-26T16:43:26.249 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.217+0000 7f5fabe43700 10 monclient: monmap: 2021-05-26T16:43:26.249 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:26.249 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:26.249 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:26.250 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:26.250 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:26.250 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.250 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:26.251 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:26.251 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:26.251 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:26.251 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:26.251 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:26.252 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:26.252 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:26.252 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:26.252 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 1 Processor -- start 2021-05-26T16:43:26.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 1 -- start start 2021-05-26T16:43:26.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient: init 2021-05-26T16:43:26.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:26.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient: _add_conns ranks=[5,6,4,1,7,0,3,2,8] 2021-05-26T16:43:26.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient(hunting): picked mon.noname-h con 0x7f5fa4096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:26.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient(hunting): picked mon.noname-d con 0x7f5fa4099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:26.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient(hunting): picked mon.noname-c con 0x7f5fa409a260 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:26.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa411cae0 con 0x7f5fa409a260 2021-05-26T16:43:26.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa411cd80 con 0x7f5fa4096ca0 2021-05-26T16:43:26.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa411d020 con 0x7f5fa4099db0 2021-05-26T16:43:26.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:26.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5fabe43700 10 monclient(hunting): authenticate will time out at 963.849674s 2021-05-26T16:43:26.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5faa3e0700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f5fa409a260 0x7f5fa4144810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37776/0 (socket says 172.21.15.3:37776) 2021-05-26T16:43:26.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.218+0000 7f5faa3e0700 1 -- 172.21.15.3:0/134961555 learned_addr learned my addr 172.21.15.3:0/134961555 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:26.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.220+0000 7f5fa93de700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa4099db0 legacy=0x7f5fa41410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.220+0000 7f5faa3e0700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6791/0 conn(0x7f5fa409a260 legacy=0x7f5fa4144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918684932 0 0) 0x7f5fa411d020 con 0x7f5fa4099db0 2021-05-26T16:43:26.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): my global_id is 4893 2021-05-26T16:43:26.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f84003270 con 0x7f5fa4099db0 2021-05-26T16:43:26.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628656769 0 0) 0x7f5fa411cae0 con 0x7f5fa409a260 2021-05-26T16:43:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): my global_id is 5017 2021-05-26T16:43:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa411d020 con 0x7f5fa409a260 2021-05-26T16:43:26.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fa9bdf700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.137:6791/0 conn(0x7f5fa4096ca0 legacy=0x7f5fa413c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256358021 0 0) 0x7f5fa411cd80 con 0x7f5fa4096ca0 2021-05-26T16:43:26.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): my global_id is 5063 2021-05-26T16:43:26.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa411cae0 con 0x7f5fa4096ca0 2021-05-26T16:43:26.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3863414318 0 0) 0x7f5f84003270 con 0x7f5fa4099db0 2021-05-26T16:43:26.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5fa411cd80 con 0x7f5fa4099db0 2021-05-26T16:43:26.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5f94001a20 con 0x7f5fa4099db0 2021-05-26T16:43:26.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:26.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:26.261 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.262 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.262 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.262 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.262 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.262 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.263 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.263 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.263 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.263 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.264 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.264 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.264 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.264 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.264 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.265 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:26.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2424075639 0 0) 0x7f5fa411d020 con 0x7f5fa409a260 2021-05-26T16:43:26.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5f84003270 con 0x7f5fa409a260 2021-05-26T16:43:26.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5fa0002020 con 0x7f5fa409a260 2021-05-26T16:43:26.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:26.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:26.266 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.267 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.267 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.267 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.267 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.267 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.268 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.268 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.268 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.268 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.269 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.269 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.269 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.269 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.269 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.270 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3666243565 0 0) 0x7f5fa411cd80 con 0x7f5fa4099db0 2021-05-26T16:43:26.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.137:6791/0 conn(0x7f5fa4096ca0 legacy=0x7f5fa413c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6791/0 conn(0x7f5fa409a260 legacy=0x7f5fa4144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:26.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 monclient: found mon.d 2021-05-26T16:43:26.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:26.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:26.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa411b150 con 0x7f5fa4099db0 2021-05-26T16:43:26.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:26.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:26.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fabe43700 5 monclient: authenticate success, global_id 4893 2021-05-26T16:43:26.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fabe43700 10 monclient: _renew_subs 2021-05-26T16:43:26.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fabe43700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:26.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa411be50 con 0x7f5fa4099db0 2021-05-26T16:43:26.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5f94004e30 con 0x7f5fa4099db0 2021-05-26T16:43:26.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:26.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5f940052e0 con 0x7f5fa4099db0 2021-05-26T16:43:26.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:26.274 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f91ffb700 10 monclient: dump: 2021-05-26T16:43:26.274 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.274 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.275 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.275 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.275 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.275 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.275 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.276 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.276 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.276 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.276 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.277 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.277 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.277 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.277 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.277 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fabe43700 10 monclient: _renew_subs 2021-05-26T16:43:26.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5f93fff700 4 set_mon_vals no callback set 2021-05-26T16:43:26.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fabe43700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:26.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.221+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa413cc10 con 0x7f5fa4099db0 2021-05-26T16:43:26.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.222+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f5f9400e850 con 0x7f5fa4099db0 2021-05-26T16:43:26.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.222+0000 7f5fabe43700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.222+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(109..109 src has 1..109) v4 ==== 3549+0+0 (unknown 3170444478 0 0) 0x7f5f9403d980 con 0x7f5fa4099db0 2021-05-26T16:43:26.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.222+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5fa406c030 con 0x7f5fa4130df0 2021-05-26T16:43:26.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.223+0000 7f5fa9bdf700 10 monclient: get_auth_request con 0x7f5f84033130 auth_method 0 2021-05-26T16:43:26.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5faa3e0700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa4130df0 legacy=0x7f5fa4058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914663886 0 0) 0x7f5fa406c030 con 0x7f5fa4130df0 2021-05-26T16:43:26.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient(hunting): my global_id is 4902 2021-05-26T16:43:26.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa411cd80 con 0x7f5fa4130df0 2021-05-26T16:43:26.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 99942961 0 0) 0x7f5fa411cd80 con 0x7f5fa4130df0 2021-05-26T16:43:26.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5fa406c030 con 0x7f5fa4130df0 2021-05-26T16:43:26.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5fa00028d0 con 0x7f5fa4130df0 2021-05-26T16:43:26.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:26.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient: dump: 2021-05-26T16:43:26.282 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.282 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.283 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.283 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.283 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.283 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.283 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.284 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.284 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.284 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.284 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.284 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.285 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.285 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.285 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.285 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3696118310 0 0) 0x7f5fa406c030 con 0x7f5fa4130df0 2021-05-26T16:43:26.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fa40008d0 con 0x7f5fa4130df0 2021-05-26T16:43:26.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f5fa0002ca0 con 0x7f5fa4130df0 2021-05-26T16:43:26.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:26.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa4130df0 legacy=0x7f5fa4058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.225+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa4130df0 legacy=0x7f5fa4058d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.232+0000 7f5fabe43700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.232+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5fa412ff30 con 0x7f5fa412fb50 2021-05-26T16:43:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.234+0000 7f5faa3e0700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa412fb50 legacy=0x7f5fa4094c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279228156 0 0) 0x7f5fa412ff30 con 0x7f5fa412fb50 2021-05-26T16:43:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient(hunting): my global_id is 4911 2021-05-26T16:43:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa406c030 con 0x7f5fa412fb50 2021-05-26T16:43:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 653288374 0 0) 0x7f5fa406c030 con 0x7f5fa412fb50 2021-05-26T16:43:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5fa412ff30 con 0x7f5fa412fb50 2021-05-26T16:43:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5fa0005bd0 con 0x7f5fa412fb50 2021-05-26T16:43:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient: dump: 2021-05-26T16:43:26.296 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.296 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.296 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.296 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.296 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.297 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.297 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.297 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.297 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.297 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.298 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.298 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.298 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.298 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.298 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.299 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 248778733 0 0) 0x7f5fa412ff30 con 0x7f5fa412fb50 2021-05-26T16:43:26.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 --> v1:172.21.15.3:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5fa4095370 con 0x7f5fa412fb50 2021-05-26T16:43:26.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 2982837961) 0x7f5fa0006000 con 0x7f5fa412fb50 2021-05-26T16:43:26.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:26.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:26.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa412fb50 legacy=0x7f5fa4094c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.235+0000 7f5f91ffb700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa412fb50 legacy=0x7f5fa4094c60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.300 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:43:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:26.353 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:26.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.137:6812/30003 conn(0x7f5f84033130 legacy=0x7f5f840355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 10 monclient: shutdown 2021-05-26T16:43:26.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:26.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 >> v1:172.21.15.3:6792/0 conn(0x7f5fa4099db0 legacy=0x7f5fa41410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5faa3e0700 1 -- 172.21.15.3:0/134961555 reap_dead start 2021-05-26T16:43:26.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5faa3e0700 1 -- 172.21.15.3:0/134961555 reap_dead start 2021-05-26T16:43:26.356 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 shutdown_connections 2021-05-26T16:43:26.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 >> 172.21.15.3:0/134961555 conn(0x7f5fa409cc00 msgr2=0x7f5fa409ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:26.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 shutdown_connections 2021-05-26T16:43:26.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.236+0000 7f5fabe43700 1 -- 172.21.15.3:0/134961555 wait complete. 2021-05-26T16:43:26.358 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2021-05-26T16:43:26.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.471+0000 7fb82e134700 10 monclient: get_monmap_and_config 2021-05-26T16:43:26.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.471+0000 7fb82e134700 10 monclient: build_initial_monmap 2021-05-26T16:43:26.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.471+0000 7fb82e134700 10 monclient: monmap: 2021-05-26T16:43:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:26.472207+0000 2021-05-26T16:43:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:26.472207+0000 2021-05-26T16:43:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:26.478 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 1 Processor -- start 2021-05-26T16:43:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 1 -- start start 2021-05-26T16:43:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient: init 2021-05-26T16:43:26.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:26.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient: _add_conns ranks=[3,7,1,8,0,2,5,6,4] 2021-05-26T16:43:26.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient(hunting): picked mon.noname-g con 0x7fb82812cbd0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:26.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient(hunting): picked mon.noname-i con 0x7fb828099a30 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:26.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient(hunting): picked mon.noname-f con 0x7fb828099eb0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:26.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb828046600 con 0x7fb828099eb0 2021-05-26T16:43:26.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82809b5e0 con 0x7fb82812cbd0 2021-05-26T16:43:26.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82812d8f0 con 0x7fb828099a30 2021-05-26T16:43:26.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:26.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.472+0000 7fb82e134700 10 monclient(hunting): authenticate will time out at 964.103837s 2021-05-26T16:43:26.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.473+0000 7fb82c931700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7fb828099a30 0x7fb828131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.3:56410/0 (socket says 172.21.15.3:56410) 2021-05-26T16:43:26.490 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.473+0000 7fb82c931700 1 -- 172.21.15.3:0/2498470420 learned_addr learned my addr 172.21.15.3:0/2498470420 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:26.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb82c931700 1 -- 172.21.15.3:0/2498470420 >> v1:172.21.15.137:6792/0 conn(0x7fb828099a30 legacy=0x7fb828131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb82d933700 1 -- 172.21.15.3:0/2498470420 >> v1:172.21.15.137:6789/0 conn(0x7fb828099eb0 legacy=0x7fb828135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb82d132700 1 -- 172.21.15.3:0/2498470420 >> v1:172.21.15.137:6790/0 conn(0x7fb82812cbd0 legacy=0x7fb82812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544510409 0 0) 0x7fb82812d8f0 con 0x7fb828099a30 2021-05-26T16:43:26.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): my global_id is 104110 2021-05-26T16:43:26.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb810003270 con 0x7fb828099a30 2021-05-26T16:43:26.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512363147 0 0) 0x7fb828046600 con 0x7fb828099eb0 2021-05-26T16:43:26.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): my global_id is 4924 2021-05-26T16:43:26.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82812d8f0 con 0x7fb828099eb0 2021-05-26T16:43:26.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325190652 0 0) 0x7fb82809b5e0 con 0x7fb82812cbd0 2021-05-26T16:43:26.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 10 monclient(hunting): my global_id is 4944 2021-05-26T16:43:26.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.475+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828046600 con 0x7fb82812cbd0 2021-05-26T16:43:26.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 848998798 0 0) 0x7fb810003270 con 0x7fb828099a30 2021-05-26T16:43:26.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 >> v1:172.21.15.137:6790/0 conn(0x7fb82812cbd0 legacy=0x7fb82812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 >> v1:172.21.15.137:6789/0 conn(0x7fb828099eb0 legacy=0x7fb828135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:26.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 monclient: found mon.noname-i 2021-05-26T16:43:26.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:26.495 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.137:6792/0 2021-05-26T16:43:26.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 --> v1:172.21.15.137:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82809c2b0 con 0x7fb828099a30 2021-05-26T16:43:26.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: _finish_auth 0 2021-05-26T16:43:26.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:26.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 5 monclient: authenticate success, global_id 104110 2021-05-26T16:43:26.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb818001a50 con 0x7fb828099a30 2021-05-26T16:43:26.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:26.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2021-05-26T16:43:26.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: dump: 2021-05-26T16:43:26.498 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.498 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.498 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.498 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.499 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.499 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.499 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.499 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.499 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.500 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.500 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.500 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.500 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.501 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.501 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.501 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:26.501 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 <== mon.7 v1:172.21.15.137:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb818001d00 con 0x7fb828099a30 2021-05-26T16:43:26.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:26.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:26.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 4 set_mon_vals no callback set 2021-05-26T16:43:26.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 1 -- 172.21.15.3:0/2498470420 <== mon.7 v1:172.21.15.137:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb8180049b0 con 0x7fb828099a30 2021-05-26T16:43:26.502 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:26.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb817fff700 10 monclient: dump: 2021-05-26T16:43:26.503 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.503 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.504 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.504 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.504 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.504 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.504 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.505 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.505 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.505 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.505 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.505 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.506 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.506 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.506 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.506 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 10 monclient: shutdown 2021-05-26T16:43:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 1 -- 172.21.15.3:0/2498470420 >> v1:172.21.15.137:6792/0 conn(0x7fb828099a30 legacy=0x7fb828131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 1 -- 172.21.15.3:0/2498470420 shutdown_connections 2021-05-26T16:43:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 1 -- 172.21.15.3:0/2498470420 >> 172.21.15.3:0/2498470420 conn(0x7fb8280a00c0 msgr2=0x7fb8280a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 1 -- 172.21.15.3:0/2498470420 shutdown_connections 2021-05-26T16:43:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.476+0000 7fb82e134700 1 -- 172.21.15.3:0/2498470420 wait complete. 2021-05-26T16:43:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.477+0000 7fb82e134700 10 monclient: build_initial_monmap 2021-05-26T16:43:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.477+0000 7fb82e134700 10 monclient: monmap: 2021-05-26T16:43:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:26.511 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.477+0000 7fb82e134700 1 Processor -- start 2021-05-26T16:43:26.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.477+0000 7fb82e134700 1 -- start start 2021-05-26T16:43:26.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.477+0000 7fb82e134700 10 monclient: init 2021-05-26T16:43:26.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:26.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 10 monclient: _add_conns ranks=[0,8,7,3,4,5,6,1,2] 2021-05-26T16:43:26.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 10 monclient(hunting): picked mon.noname-a con 0x7fb828099a30 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:26.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 10 monclient(hunting): picked mon.noname-e con 0x7fb828099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:26.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 10 monclient(hunting): picked mon.noname-i con 0x7fb82812cbd0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:26.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82809b850 con 0x7fb828099a30 2021-05-26T16:43:26.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb828094580 con 0x7fb82812cbd0 2021-05-26T16:43:26.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb828116b00 con 0x7fb828099eb0 2021-05-26T16:43:26.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:26.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82e134700 10 monclient(hunting): authenticate will time out at 964.109284s 2021-05-26T16:43:26.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82d132700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb828099a30 0x7fb828093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52276/0 (socket says 172.21.15.3:52276) 2021-05-26T16:43:26.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.478+0000 7fb82d132700 1 -- 172.21.15.3:0/3503825995 learned_addr learned my addr 172.21.15.3:0/3503825995 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:26.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb82c931700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb828099eb0 legacy=0x7fb828093e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb82d132700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6789/0 conn(0x7fb828099a30 legacy=0x7fb828093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb82d933700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.137:6792/0 conn(0x7fb82812cbd0 legacy=0x7fb828144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225260419 0 0) 0x7fb828116b00 con 0x7fb828099eb0 2021-05-26T16:43:26.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): my global_id is 104165 2021-05-26T16:43:26.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb808003270 con 0x7fb828099eb0 2021-05-26T16:43:26.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126853802 0 0) 0x7fb82809b850 con 0x7fb828099a30 2021-05-26T16:43:26.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): my global_id is 104157 2021-05-26T16:43:26.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828116b00 con 0x7fb828099a30 2021-05-26T16:43:26.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272556485 0 0) 0x7fb828094580 con 0x7fb82812cbd0 2021-05-26T16:43:26.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 10 monclient(hunting): my global_id is 104119 2021-05-26T16:43:26.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.480+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82809b850 con 0x7fb82812cbd0 2021-05-26T16:43:26.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1470154448 0 0) 0x7fb828116b00 con 0x7fb828099a30 2021-05-26T16:43:26.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb828094580 con 0x7fb828099a30 2021-05-26T16:43:26.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1178666663 0 0) 0x7fb808003270 con 0x7fb828099eb0 2021-05-26T16:43:26.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb828116b00 con 0x7fb828099eb0 2021-05-26T16:43:26.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb81c001d40 con 0x7fb828099a30 2021-05-26T16:43:26.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:26.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient(hunting): dump: 2021-05-26T16:43:26.520 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.520 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.521 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.521 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.521 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.521 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.522 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.522 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.522 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.522 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.522 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.523 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.523 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.523 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.523 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.523 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:26.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb818004870 con 0x7fb828099eb0 2021-05-26T16:43:26.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:26.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient(hunting): dump: 2021-05-26T16:43:26.525 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.525 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.525 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.525 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.526 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.526 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.526 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.526 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.526 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.527 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.527 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.527 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.527 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.527 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.528 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.528 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2744690615 0 0) 0x7fb828094580 con 0x7fb828099a30 2021-05-26T16:43:26.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb828099eb0 legacy=0x7fb828093e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.137:6792/0 conn(0x7fb82812cbd0 legacy=0x7fb828144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient: _finish_hunting 0 2021-05-26T16:43:26.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 monclient: found mon.a 2021-05-26T16:43:26.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:26.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:26.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828116da0 con 0x7fb828099a30 2021-05-26T16:43:26.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient: _finish_auth 0 2021-05-26T16:43:26.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:26.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb82e134700 5 monclient: authenticate success, global_id 104157 2021-05-26T16:43:26.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb82e134700 10 monclient: _renew_subs 2021-05-26T16:43:26.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb82e134700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:26.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb828095290 con 0x7fb828099a30 2021-05-26T16:43:26.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb82e134700 10 monclient: _renew_subs 2021-05-26T16:43:26.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb82e134700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:26.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb828117160 con 0x7fb828099a30 2021-05-26T16:43:26.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb81c0023f0 con 0x7fb828099a30 2021-05-26T16:43:26.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:26.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb81c0028a0 con 0x7fb828099a30 2021-05-26T16:43:26.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:26.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8177fe700 4 set_mon_vals no callback set 2021-05-26T16:43:26.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.481+0000 7fb8157fa700 10 monclient: dump: 2021-05-26T16:43:26.533 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.534 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.534 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.534 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.534 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.535 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.535 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.535 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.535 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.535 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.536 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.536 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.536 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.536 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.536 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.537 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.482+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fb81c002ab0 con 0x7fb828099a30 2021-05-26T16:43:26.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.482+0000 7fb82e134700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.482+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb8000065a0 con 0x7fb800002840 2021-05-26T16:43:26.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.482+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(109..109 src has 1..109) v4 ==== 3549+0+0 (unknown 3170444478 0 0) 0x7fb81c03d800 con 0x7fb828099a30 2021-05-26T16:43:26.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.482+0000 7fb82c931700 10 monclient: get_auth_request con 0x7fb8080330b0 auth_method 0 2021-05-26T16:43:26.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb82d933700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb800002840 legacy=0x7fb800004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645188496 0 0) 0x7fb8000065a0 con 0x7fb800002840 2021-05-26T16:43:26.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 10 monclient(hunting): my global_id is 104174 2021-05-26T16:43:26.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828094580 con 0x7fb800002840 2021-05-26T16:43:26.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3056159565 0 0) 0x7fb828094580 con 0x7fb800002840 2021-05-26T16:43:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb8000065a0 con 0x7fb800002840 2021-05-26T16:43:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb824002010 con 0x7fb800002840 2021-05-26T16:43:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.484+0000 7fb8157fa700 10 monclient: dump: 2021-05-26T16:43:26.541 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.541 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.541 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.541 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.542 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.542 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.542 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.542 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.543 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.543 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.543 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.543 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.543 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.544 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.544 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.544 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.485+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 66998816 0 0) 0x7fb8000065a0 con 0x7fb800002840 2021-05-26T16:43:26.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.485+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb800009e40 con 0x7fb800002840 2021-05-26T16:43:26.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.485+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fb8240068c0 con 0x7fb800002840 2021-05-26T16:43:26.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.485+0000 7fb8157fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.485+0000 7fb8157fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:26.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.485+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb800002840 legacy=0x7fb800004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.485+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb800002840 legacy=0x7fb800004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.492+0000 7fb82e134700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:26.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.492+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb800009ad0 con 0x7fb800008d90 2021-05-26T16:43:26.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb82d933700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb800008d90 legacy=0x7fb800009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101654169 0 0) 0x7fb800009ad0 con 0x7fb800008d90 2021-05-26T16:43:26.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 10 monclient(hunting): my global_id is 104183 2021-05-26T16:43:26.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8000065a0 con 0x7fb800008d90 2021-05-26T16:43:26.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 47886624 0 0) 0x7fb8000065a0 con 0x7fb800008d90 2021-05-26T16:43:26.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb800009ad0 con 0x7fb800008d90 2021-05-26T16:43:26.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb824002a70 con 0x7fb800008d90 2021-05-26T16:43:26.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:26.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 10 monclient: dump: 2021-05-26T16:43:26.551 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.551 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.551 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.551 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.554 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.554 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.554 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2343118011 0 0) 0x7fb800009ad0 con 0x7fb800008d90 2021-05-26T16:43:26.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.494+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 --> v1:172.21.15.3:6793/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb800008740 con 0x7fb800008d90 2021-05-26T16:43:26.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 496325128) 0x7fb824002fc0 con 0x7fb800008d90 2021-05-26T16:43:26.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb8157fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:26.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb8157fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:26.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb800008d90 legacy=0x7fb800009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb8157fa700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6793/0 conn(0x7fb800008d90 legacy=0x7fb800009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.556 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:43:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:26.609 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:26.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.137:6812/30003 conn(0x7fb8080330b0 legacy=0x7fb808035570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 10 monclient: shutdown 2021-05-26T16:43:26.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:26.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 >> v1:172.21.15.3:6789/0 conn(0x7fb828099a30 legacy=0x7fb828093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82d933700 1 -- 172.21.15.3:0/3503825995 reap_dead start 2021-05-26T16:43:26.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 shutdown_connections 2021-05-26T16:43:26.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 >> 172.21.15.3:0/3503825995 conn(0x7fb8280a00c0 msgr2=0x7fb82812b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:26.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 shutdown_connections 2021-05-26T16:43:26.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.495+0000 7fb82e134700 1 -- 172.21.15.3:0/3503825995 wait complete. 2021-05-26T16:43:26.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2021-05-26T16:43:26.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.726+0000 7f886d48e700 10 monclient: get_monmap_and_config 2021-05-26T16:43:26.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.726+0000 7f886d48e700 10 monclient: build_initial_monmap 2021-05-26T16:43:26.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.726+0000 7f886d48e700 10 monclient: monmap: 2021-05-26T16:43:26.729 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:26.730 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.730 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:26.727293+0000 2021-05-26T16:43:26.730 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:26.727293+0000 2021-05-26T16:43:26.730 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:26.730 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.731 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:26.731 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:26.731 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:26.731 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:26.731 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:26.732 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:26.732 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:26.732 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:26.733 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:26.733 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 1 Processor -- start 2021-05-26T16:43:26.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 1 -- start start 2021-05-26T16:43:26.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient: init 2021-05-26T16:43:26.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient: _add_conns ranks=[4,6,2,7,8,5,0,1,3] 2021-05-26T16:43:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient(hunting): picked mon.noname-c con 0x7f886812cbd0 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient(hunting): picked mon.noname-d con 0x7f8868099a30 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient(hunting): picked mon.noname-b con 0x7f8868099eb0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868046600 con 0x7f8868099eb0 2021-05-26T16:43:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886809b5e0 con 0x7f886812cbd0 2021-05-26T16:43:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886812d8f0 con 0x7f8868099a30 2021-05-26T16:43:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.727+0000 7f886d48e700 10 monclient(hunting): authenticate will time out at 964.358940s 2021-05-26T16:43:26.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.728+0000 7f8867fff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f886812cbd0 0x7f886812d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37802/0 (socket says 172.21.15.3:37802) 2021-05-26T16:43:26.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.728+0000 7f88677fe700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f8868099a30 0x7f8868131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57688/0 (socket says 172.21.15.3:57688) 2021-05-26T16:43:26.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.728+0000 7f8867fff700 1 -- 172.21.15.3:0/846582610 learned_addr learned my addr 172.21.15.3:0/846582610 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:26.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.728+0000 7f886cc8d700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f8868099eb0 0x7f8868135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54334/0 (socket says 172.21.15.3:54334) 2021-05-26T16:43:26.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8867fff700 1 -- 172.21.15.3:0/846582610 >> v1:172.21.15.3:6791/0 conn(0x7f886812cbd0 legacy=0x7f886812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f886cc8d700 1 -- 172.21.15.3:0/846582610 >> v1:172.21.15.3:6790/0 conn(0x7f8868099eb0 legacy=0x7f8868135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f88677fe700 1 -- 172.21.15.3:0/846582610 >> v1:172.21.15.3:6792/0 conn(0x7f8868099a30 legacy=0x7f8868131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471097063 0 0) 0x7f886812d8f0 con 0x7f8868099a30 2021-05-26T16:43:26.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): my global_id is 4920 2021-05-26T16:43:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f884c003270 con 0x7f8868099a30 2021-05-26T16:43:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277699322 0 0) 0x7f8868046600 con 0x7f8868099eb0 2021-05-26T16:43:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): my global_id is 4970 2021-05-26T16:43:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f886812d8f0 con 0x7f8868099eb0 2021-05-26T16:43:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650388377 0 0) 0x7f886809b5e0 con 0x7f886812cbd0 2021-05-26T16:43:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient(hunting): my global_id is 5026 2021-05-26T16:43:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8868046600 con 0x7f886812cbd0 2021-05-26T16:43:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224644866 0 0) 0x7f8868046600 con 0x7f886812cbd0 2021-05-26T16:43:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 >> v1:172.21.15.3:6792/0 conn(0x7f8868099a30 legacy=0x7f8868131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 >> v1:172.21.15.3:6790/0 conn(0x7f8868099eb0 legacy=0x7f8868135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 monclient: found mon.noname-c 2021-05-26T16:43:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:43:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886809c2b0 con 0x7f886812cbd0 2021-05-26T16:43:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: _finish_auth 0 2021-05-26T16:43:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:26.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f886d48e700 5 monclient: authenticate success, global_id 5026 2021-05-26T16:43:26.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8858001a40 con 0x7f886812cbd0 2021-05-26T16:43:26.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:43:26.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: dump: 2021-05-26T16:43:26.756 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.756 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.756 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.756 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.758 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.758 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.758 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.758 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.758 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.759 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f886d48e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8858001cb0 con 0x7f886812cbd0 2021-05-26T16:43:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 1 -- 172.21.15.3:0/846582610 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8858004930 con 0x7f886812cbd0 2021-05-26T16:43:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f886d48e700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f886d48e700 4 set_mon_vals no callback set 2021-05-26T16:43:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:26.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.730+0000 7f8866ffd700 10 monclient: dump: 2021-05-26T16:43:26.761 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.761 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.763 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.763 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.763 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.763 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.763 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.764 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.764 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.764 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.764 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 10 monclient: shutdown 2021-05-26T16:43:26.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:26.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 1 -- 172.21.15.3:0/846582610 >> v1:172.21.15.3:6791/0 conn(0x7f886812cbd0 legacy=0x7f886812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 1 -- 172.21.15.3:0/846582610 shutdown_connections 2021-05-26T16:43:26.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 1 -- 172.21.15.3:0/846582610 >> 172.21.15.3:0/846582610 conn(0x7f88680a00c0 msgr2=0x7f88680a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:26.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 1 -- 172.21.15.3:0/846582610 shutdown_connections 2021-05-26T16:43:26.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 1 -- 172.21.15.3:0/846582610 wait complete. 2021-05-26T16:43:26.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 10 monclient: build_initial_monmap 2021-05-26T16:43:26.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.731+0000 7f886d48e700 10 monclient: monmap: 2021-05-26T16:43:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:26.767 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:26.768 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.768 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:26.768 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:26.768 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:26.768 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:26.769 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:26.769 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:26.769 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:26.769 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:26.770 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:26.770 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 1 Processor -- start 2021-05-26T16:43:26.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 1 -- start start 2021-05-26T16:43:26.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 10 monclient: init 2021-05-26T16:43:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 10 monclient: _add_conns ranks=[5,7,0,4,2,6,3,1,8] 2021-05-26T16:43:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 10 monclient(hunting): picked mon.noname-h con 0x7f8868099a30 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 10 monclient(hunting): picked mon.noname-i con 0x7f8868099eb0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 10 monclient(hunting): picked mon.noname-a con 0x7f886812cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.732+0000 7f886d48e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886809bd30 con 0x7f886812cbd0 2021-05-26T16:43:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.733+0000 7f886d48e700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868117580 con 0x7f8868099a30 2021-05-26T16:43:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.733+0000 7f886d48e700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868117820 con 0x7f8868099eb0 2021-05-26T16:43:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.733+0000 7f886d48e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.733+0000 7f886d48e700 10 monclient(hunting): authenticate will time out at 964.364042s 2021-05-26T16:43:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.733+0000 7f886cc8d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f886812cbd0 0x7f8868144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52298/0 (socket says 172.21.15.3:52298) 2021-05-26T16:43:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.733+0000 7f886cc8d700 1 -- 172.21.15.3:0/987160291 learned_addr learned my addr 172.21.15.3:0/987160291 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f886cc8d700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.3:6789/0 conn(0x7f886812cbd0 legacy=0x7f8868144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232454133 0 0) 0x7f886809bd30 con 0x7f886812cbd0 2021-05-26T16:43:26.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): my global_id is 104166 2021-05-26T16:43:26.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8848003270 con 0x7f886812cbd0 2021-05-26T16:43:26.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f88677fe700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6792/0 conn(0x7f8868099eb0 legacy=0x7f8868140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8867fff700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6791/0 conn(0x7f8868099a30 legacy=0x7f8868126db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1798755579 0 0) 0x7f8848003270 con 0x7f886812cbd0 2021-05-26T16:43:26.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f886809bd30 con 0x7f886812cbd0 2021-05-26T16:43:26.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f885c0020a0 con 0x7f886812cbd0 2021-05-26T16:43:26.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:26.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): dump: 2021-05-26T16:43:26.776 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.776 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.777 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.777 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.777 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.777 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.778 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.778 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.778 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.778 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.778 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.779 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.779 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.779 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.779 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.780 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:26.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910997011 0 0) 0x7f8868117820 con 0x7f8868099eb0 2021-05-26T16:43:26.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): my global_id is 104128 2021-05-26T16:43:26.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8848003270 con 0x7f8868099eb0 2021-05-26T16:43:26.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661926439 0 0) 0x7f8868117580 con 0x7f8868099a30 2021-05-26T16:43:26.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient(hunting): my global_id is 5072 2021-05-26T16:43:26.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8868117820 con 0x7f8868099a30 2021-05-26T16:43:26.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2193356421 0 0) 0x7f886809bd30 con 0x7f886812cbd0 2021-05-26T16:43:26.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6792/0 conn(0x7f8868099eb0 legacy=0x7f8868140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6791/0 conn(0x7f8868099a30 legacy=0x7f8868126db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:26.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 monclient: found mon.a 2021-05-26T16:43:26.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:26.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88681274c0 con 0x7f886812cbd0 2021-05-26T16:43:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 10 monclient: _finish_auth 0 2021-05-26T16:43:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f8853fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f886d48e700 5 monclient: authenticate success, global_id 104166 2021-05-26T16:43:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f886d48e700 10 monclient: _renew_subs 2021-05-26T16:43:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f886d48e700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.735+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8868095be0 con 0x7f886812cbd0 2021-05-26T16:43:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f886d48e700 10 monclient: _renew_subs 2021-05-26T16:43:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f886d48e700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f886813c300 con 0x7f886812cbd0 2021-05-26T16:43:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f885c004ea0 con 0x7f886812cbd0 2021-05-26T16:43:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f885c005350 con 0x7f886812cbd0 2021-05-26T16:43:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f88667fc700 4 set_mon_vals no callback set 2021-05-26T16:43:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 10 monclient: dump: 2021-05-26T16:43:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.790 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f885c00e8c0 con 0x7f886812cbd0 2021-05-26T16:43:26.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(109..109 src has 1..109) v4 ==== 3549+0+0 (unknown 3170444478 0 0) 0x7f885c03dc90 con 0x7f886812cbd0 2021-05-26T16:43:26.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f886d48e700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.736+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f88400065a0 con 0x7f8840002840 2021-05-26T16:43:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.737+0000 7f8867fff700 10 monclient: get_auth_request con 0x7f88480329c0 auth_method 0 2021-05-26T16:43:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.739+0000 7f88677fe700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6789/0 conn(0x7f8840002840 legacy=0x7f8840004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.739+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247256944 0 0) 0x7f88400065a0 con 0x7f8840002840 2021-05-26T16:43:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.739+0000 7f8853fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.739+0000 7f8853fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.739+0000 7f8853fff700 10 monclient(hunting): my global_id is 4933 2021-05-26T16:43:26.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.739+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f886809bd30 con 0x7f8840002840 2021-05-26T16:43:26.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3894456924 0 0) 0x7f886809bd30 con 0x7f8840002840 2021-05-26T16:43:26.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f88400065a0 con 0x7f8840002840 2021-05-26T16:43:26.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8854004530 con 0x7f8840002840 2021-05-26T16:43:26.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:26.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 10 monclient: dump: 2021-05-26T16:43:26.794 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.795 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.795 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.795 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.795 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.795 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.796 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.796 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.796 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.796 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.796 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.797 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.797 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.797 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.797 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.798 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2191485298 0 0) 0x7f88400065a0 con 0x7f8840002840 2021-05-26T16:43:26.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8840009e40 con 0x7f8840002840 2021-05-26T16:43:26.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f88540048d0 con 0x7f8840002840 2021-05-26T16:43:26.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:26.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:26.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6789/0 conn(0x7f8840002840 legacy=0x7f8840004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.740+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6789/0 conn(0x7f8840002840 legacy=0x7f8840004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.747+0000 7f886d48e700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:26.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.747+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8840007510 con 0x7f88400068b0 2021-05-26T16:43:26.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f88677fe700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6789/0 conn(0x7f88400068b0 legacy=0x7f8840006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:26.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512124560 0 0) 0x7f8840007510 con 0x7f88400068b0 2021-05-26T16:43:26.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:26.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:26.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 10 monclient(hunting): my global_id is 4942 2021-05-26T16:43:26.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88400065a0 con 0x7f88400068b0 2021-05-26T16:43:26.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3027640307 0 0) 0x7f88400065a0 con 0x7f88400068b0 2021-05-26T16:43:26.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8840007510 con 0x7f88400068b0 2021-05-26T16:43:26.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f88540050e0 con 0x7f88400068b0 2021-05-26T16:43:26.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:26.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:26.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 10 monclient: dump: 2021-05-26T16:43:26.804 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:26.805 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.805 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.805 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:26.805 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:26.808 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1617214241 0 0) 0x7f8840007510 con 0x7f88400068b0 2021-05-26T16:43:26.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.750+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 --> v1:172.21.15.137:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8840008770 con 0x7f88400068b0 2021-05-26T16:43:26.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 1681065147) 0x7f8854005580 con 0x7f88400068b0 2021-05-26T16:43:26.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f8853fff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:26.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f8853fff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:26.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6789/0 conn(0x7f88400068b0 legacy=0x7f8840006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f8853fff700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6789/0 conn(0x7f88400068b0 legacy=0x7f8840006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:26.810 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:26.810 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:26.810 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:26.810 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:26.811 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:26.811 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:26.811 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:26.811 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:26.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:26.812 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:26.812 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:26.812 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:26.812 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:26.813 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:26.813 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:26.813 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.813 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:43:26.814 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.814 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:26.814 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:26.814 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.815 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.815 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.815 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.815 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.815 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.816 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.816 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.816 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.816 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.816 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:26.817 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:26.817 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.817 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.817 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.818 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.818 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.818 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.818 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.818 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.819 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.819 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.819 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:26.819 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:26.820 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:26.820 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:26.820 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:26.820 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:26.821 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.821 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:26.821 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:26.821 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:26.821 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:26.822 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:26.822 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:26.822 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:26.822 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:26.823 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:26.823 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:26.823 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:26.823 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:26.823 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:26.824 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:26.824 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:26.824 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:26.824 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:26.825 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.826 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:26.826 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:26.826 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.826 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.827 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.827 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.827 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:26.827 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.827 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.828 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.828 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.828 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:26.829 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.829 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.829 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.829 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.830 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:26.830 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:26.830 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.830 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.830 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.831 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.831 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:26.831 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.831 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.832 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.832 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.832 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.832 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:26.832 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.833 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.833 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.833 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.833 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:26.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:26.834 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.834 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.834 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.835 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.835 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:26.835 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.835 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.835 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.836 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.836 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.836 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:26.836 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.837 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.837 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.837 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.837 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.837 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:26.838 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:26.838 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.838 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.838 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.839 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.839 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:26.839 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.839 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.840 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.840 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.840 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.840 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:26.841 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.841 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.841 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.841 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.841 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.842 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:26.842 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:26.842 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.842 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.843 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.843 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.843 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:26.843 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.843 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.844 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.844 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.844 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:26.844 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.845 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.845 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.845 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.846 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:26.846 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:26.846 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.846 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.846 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.847 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.847 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:26.847 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.847 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.848 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.848 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.848 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:26.848 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.849 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.849 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.849 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.849 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:26.850 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:26.850 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.850 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.850 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.851 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.851 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:26.851 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.851 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.852 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.852 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.852 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:26.852 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.853 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.853 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.853 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.853 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:26.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:26.854 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.854 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.854 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.855 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.855 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:26.855 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.855 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.855 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.856 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.856 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:26.856 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.857 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.857 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.857 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.857 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:26.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:26.858 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:26.858 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:26.858 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.858 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:26.859 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:26.859 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:26.859 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.859 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.860 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.860 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:26.860 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:26.860 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:26.861 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:26.861 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.861 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.861 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:26.862 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:26.862 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.862 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.862 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.862 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:26.863 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.863 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:26.863 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:26.863 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:26.864 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:26.864 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:26.864 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:26.864 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:26.864 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:26.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:26.865 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:26.865 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:26.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.137:6812/30003 conn(0x7f88480329c0 legacy=0x7f8848034e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 10 monclient: shutdown 2021-05-26T16:43:26.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:26.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 >> v1:172.21.15.3:6789/0 conn(0x7f886812cbd0 legacy=0x7f8868144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:26.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886cc8d700 1 -- 172.21.15.3:0/987160291 reap_dead start 2021-05-26T16:43:26.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886cc8d700 1 -- 172.21.15.3:0/987160291 reap_dead start 2021-05-26T16:43:26.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 shutdown_connections 2021-05-26T16:43:26.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 >> 172.21.15.3:0/987160291 conn(0x7f88680a00c0 msgr2=0x7f886812c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 shutdown_connections 2021-05-26T16:43:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.751+0000 7f886d48e700 1 -- 172.21.15.3:0/987160291 wait complete. 2021-05-26T16:43:26.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2021-05-26T16:43:26.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.984+0000 7fe30359e700 10 monclient: get_monmap_and_config 2021-05-26T16:43:26.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.984+0000 7fe30359e700 10 monclient: build_initial_monmap 2021-05-26T16:43:26.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.984+0000 7fe30359e700 10 monclient: monmap: 2021-05-26T16:43:26.987 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:26.988 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:26.988 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:26.984760+0000 2021-05-26T16:43:26.988 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:26.984760+0000 2021-05-26T16:43:26.988 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:26.988 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:26.989 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:26.989 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:26.989 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:26.989 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:26.989 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:26.990 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:26.990 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:26.990 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:26.990 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:26.991 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:26.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.984+0000 7fe30359e700 1 Processor -- start 2021-05-26T16:43:26.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.984+0000 7fe30359e700 1 -- start start 2021-05-26T16:43:26.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.984+0000 7fe30359e700 10 monclient: init 2021-05-26T16:43:27.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 10 monclient: _add_conns ranks=[6,5,3,8,4,2,1,7,0] 2021-05-26T16:43:27.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 10 monclient(hunting): picked mon.noname-d con 0x7fe30412cbd0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:27.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 10 monclient(hunting): picked mon.noname-h con 0x7fe304099a30 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:27.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 10 monclient(hunting): picked mon.noname-g con 0x7fe304099eb0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:27.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe304046600 con 0x7fe304099eb0 2021-05-26T16:43:27.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30409b5e0 con 0x7fe304099a30 2021-05-26T16:43:27.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30412d8f0 con 0x7fe30412cbd0 2021-05-26T16:43:27.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30359e700 10 monclient(hunting): authenticate will time out at 964.616477s 2021-05-26T16:43:27.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30259c700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fe30412cbd0 0x7fe30412d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57706/0 (socket says 172.21.15.3:57706) 2021-05-26T16:43:27.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.985+0000 7fe30259c700 1 -- 172.21.15.3:0/1981469175 learned_addr learned my addr 172.21.15.3:0/1981469175 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.987+0000 7fe30259c700 1 -- 172.21.15.3:0/1981469175 >> v1:172.21.15.3:6792/0 conn(0x7fe30412cbd0 legacy=0x7fe30412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe302d9d700 1 -- 172.21.15.3:0/1981469175 >> v1:172.21.15.137:6790/0 conn(0x7fe304099eb0 legacy=0x7fe304135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe301d9b700 1 -- 172.21.15.3:0/1981469175 >> v1:172.21.15.137:6791/0 conn(0x7fe304099a30 legacy=0x7fe304131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148917435 0 0) 0x7fe30412d8f0 con 0x7fe30412cbd0 2021-05-26T16:43:27.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): my global_id is 4929 2021-05-26T16:43:27.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e8003270 con 0x7fe30412cbd0 2021-05-26T16:43:27.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257019418 0 0) 0x7fe304046600 con 0x7fe304099eb0 2021-05-26T16:43:27.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): my global_id is 4953 2021-05-26T16:43:27.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30412d8f0 con 0x7fe304099eb0 2021-05-26T16:43:27.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974749398 0 0) 0x7fe30409b5e0 con 0x7fe304099a30 2021-05-26T16:43:27.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient(hunting): my global_id is 5081 2021-05-26T16:43:27.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe304046600 con 0x7fe304099a30 2021-05-26T16:43:27.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3290305666 0 0) 0x7fe2e8003270 con 0x7fe30412cbd0 2021-05-26T16:43:27.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 >> v1:172.21.15.137:6791/0 conn(0x7fe304099a30 legacy=0x7fe304131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 >> v1:172.21.15.137:6790/0 conn(0x7fe304099eb0 legacy=0x7fe304135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 monclient: found mon.noname-d 2021-05-26T16:43:27.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:43:27.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30409c2b0 con 0x7fe30412cbd0 2021-05-26T16:43:27.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 5 monclient: authenticate success, global_id 4929 2021-05-26T16:43:27.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2ec001a60 con 0x7fe30412cbd0 2021-05-26T16:43:27.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:27.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:27.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: dump: 2021-05-26T16:43:27.013 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.013 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.013 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.013 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.014 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.014 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.014 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.014 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.014 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.015 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.015 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.015 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.015 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.015 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.016 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.016 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:27.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe2ec001d70 con 0x7fe30412cbd0 2021-05-26T16:43:27.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 1 -- 172.21.15.3:0/1981469175 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2ec004930 con 0x7fe30412cbd0 2021-05-26T16:43:27.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:27.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 4 set_mon_vals no callback set 2021-05-26T16:43:27.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:27.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30159a700 10 monclient: dump: 2021-05-26T16:43:27.018 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.018 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.019 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.019 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.019 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.019 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.019 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.020 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.020 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.020 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.020 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.020 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.021 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.021 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.021 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.021 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 10 monclient: shutdown 2021-05-26T16:43:27.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:27.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 1 -- 172.21.15.3:0/1981469175 >> v1:172.21.15.3:6792/0 conn(0x7fe30412cbd0 legacy=0x7fe30412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.988+0000 7fe30359e700 1 -- 172.21.15.3:0/1981469175 shutdown_connections 2021-05-26T16:43:27.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 1 -- 172.21.15.3:0/1981469175 >> 172.21.15.3:0/1981469175 conn(0x7fe3040a00c0 msgr2=0x7fe3040a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:27.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 1 -- 172.21.15.3:0/1981469175 shutdown_connections 2021-05-26T16:43:27.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 1 -- 172.21.15.3:0/1981469175 wait complete. 2021-05-26T16:43:27.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 10 monclient: build_initial_monmap 2021-05-26T16:43:27.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 10 monclient: monmap: 2021-05-26T16:43:27.024 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:27.024 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:27.024 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:27.024 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:27.024 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:27.025 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.025 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:27.025 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:27.025 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:27.026 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:27.026 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:27.026 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:27.026 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:27.026 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:27.027 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:27.027 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 1 Processor -- start 2021-05-26T16:43:27.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 1 -- start start 2021-05-26T16:43:27.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.989+0000 7fe30359e700 10 monclient: init 2021-05-26T16:43:27.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 10 monclient: _add_conns ranks=[4,7,1,6,0,2,5,3,8] 2021-05-26T16:43:27.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 10 monclient(hunting): picked mon.noname-c con 0x7fe304099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:27.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 10 monclient(hunting): picked mon.noname-i con 0x7fe304099eb0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:27.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 10 monclient(hunting): picked mon.noname-f con 0x7fe30412cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:27.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe304094590 con 0x7fe30412cbd0 2021-05-26T16:43:27.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3041165c0 con 0x7fe304099a30 2021-05-26T16:43:27.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe304116860 con 0x7fe304099eb0 2021-05-26T16:43:27.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30359e700 10 monclient(hunting): authenticate will time out at 964.621329s 2021-05-26T16:43:27.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30259c700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fe304099a30 0x7fe304093770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37824/0 (socket says 172.21.15.3:37824) 2021-05-26T16:43:27.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.990+0000 7fe30259c700 1 -- 172.21.15.3:0/227986371 learned_addr learned my addr 172.21.15.3:0/227986371 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe30259c700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.3:6791/0 conn(0x7fe304099a30 legacy=0x7fe304093770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe301d9b700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6792/0 conn(0x7fe304099eb0 legacy=0x7fe304093e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe302d9d700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6789/0 conn(0x7fe30412cbd0 legacy=0x7fe304144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707690149 0 0) 0x7fe3041165c0 con 0x7fe304099a30 2021-05-26T16:43:27.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe2f27fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe2f27fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe2f27fc700 10 monclient(hunting): my global_id is 5035 2021-05-26T16:43:27.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.992+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e0003270 con 0x7fe304099a30 2021-05-26T16:43:27.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695630084 0 0) 0x7fe304116860 con 0x7fe304099eb0 2021-05-26T16:43:27.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): my global_id is 104137 2021-05-26T16:43:27.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3041165c0 con 0x7fe304099eb0 2021-05-26T16:43:27.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015421830 0 0) 0x7fe304094590 con 0x7fe30412cbd0 2021-05-26T16:43:27.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): my global_id is 4951 2021-05-26T16:43:27.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe304116860 con 0x7fe30412cbd0 2021-05-26T16:43:27.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3348561234 0 0) 0x7fe2e0003270 con 0x7fe304099a30 2021-05-26T16:43:27.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe304094590 con 0x7fe304099a30 2021-05-26T16:43:27.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2ec001a50 con 0x7fe304099a30 2021-05-26T16:43:27.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:43:27.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): dump: 2021-05-26T16:43:27.036 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.036 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.036 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.036 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.036 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.037 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.037 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.037 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.037 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.038 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.038 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.038 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.038 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.038 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.039 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.039 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:27.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2431981347 0 0) 0x7fe3041165c0 con 0x7fe304099eb0 2021-05-26T16:43:27.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2e0003270 con 0x7fe304099eb0 2021-05-26T16:43:27.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2f8001f00 con 0x7fe304099eb0 2021-05-26T16:43:27.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:27.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient(hunting): dump: 2021-05-26T16:43:27.041 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.041 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.041 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.041 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.041 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.042 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.042 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.042 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.042 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.043 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.043 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.043 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.043 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.043 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.044 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2748829186 0 0) 0x7fe304094590 con 0x7fe304099a30 2021-05-26T16:43:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6792/0 conn(0x7fe304099eb0 legacy=0x7fe304093e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6789/0 conn(0x7fe30412cbd0 legacy=0x7fe304144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 monclient: found mon.c 2021-05-26T16:43:27.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:27.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304116b00 con 0x7fe304099a30 2021-05-26T16:43:27.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2f4002100 con 0x7fe30412cbd0 2021-05-26T16:43:27.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:43:27.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe30359e700 5 monclient: authenticate success, global_id 5035 2021-05-26T16:43:27.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe30359e700 10 monclient: _renew_subs 2021-05-26T16:43:27.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe30359e700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:27.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe304129a20 con 0x7fe304099a30 2021-05-26T16:43:27.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe30359e700 10 monclient: _renew_subs 2021-05-26T16:43:27.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe30359e700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:27.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe304095fc0 con 0x7fe304099a30 2021-05-26T16:43:27.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe2ec004c20 con 0x7fe304099a30 2021-05-26T16:43:27.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2ec0050d0 con 0x7fe304099a30 2021-05-26T16:43:27.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe300d99700 4 set_mon_vals no callback set 2021-05-26T16:43:27.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:27.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.993+0000 7fe2f27fc700 10 monclient: dump: 2021-05-26T16:43:27.050 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.050 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.050 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.050 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.051 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.051 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.051 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.051 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.051 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.052 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.052 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.052 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.052 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.053 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.053 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.053 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.994+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fe2ec005230 con 0x7fe304099a30 2021-05-26T16:43:27.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.994+0000 7fe30359e700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.994+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe2e40065a0 con 0x7fe2e4002840 2021-05-26T16:43:27.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.994+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(109..109 src has 1..109) v4 ==== 3549+0+0 (unknown 3170444478 0 0) 0x7fe2ec03d9b0 con 0x7fe304099a30 2021-05-26T16:43:27.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.995+0000 7fe302d9d700 10 monclient: get_auth_request con 0x7fe2e0032f50 auth_method 0 2021-05-26T16:43:27.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe301d9b700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6790/0 conn(0x7fe2e4002840 legacy=0x7fe2e4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251134110 0 0) 0x7fe2e40065a0 con 0x7fe2e4002840 2021-05-26T16:43:27.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 10 monclient(hunting): my global_id is 4962 2021-05-26T16:43:27.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe304094590 con 0x7fe2e4002840 2021-05-26T16:43:27.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1431656706 0 0) 0x7fe304094590 con 0x7fe2e4002840 2021-05-26T16:43:27.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2e40065a0 con 0x7fe2e4002840 2021-05-26T16:43:27.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2f8002590 con 0x7fe2e4002840 2021-05-26T16:43:27.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:27.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 10 monclient: dump: 2021-05-26T16:43:27.057 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.057 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.057 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.057 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.058 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.058 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.058 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.058 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.059 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.059 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.059 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.059 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.059 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.060 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.060 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.060 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3767088098 0 0) 0x7fe2e40065a0 con 0x7fe2e4002840 2021-05-26T16:43:27.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.997+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2e4009e40 con 0x7fe2e4002840 2021-05-26T16:43:27.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.998+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe2f8002a30 con 0x7fe2e4002840 2021-05-26T16:43:27.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.998+0000 7fe2f27fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.998+0000 7fe2f27fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:27.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.998+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6790/0 conn(0x7fe2e4002840 legacy=0x7fe2e4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:26.998+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6790/0 conn(0x7fe2e4002840 legacy=0x7fe2e4004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:27.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.005+0000 7fe30359e700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:27.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.005+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe2e4009ad0 con 0x7fe2e4008d90 2021-05-26T16:43:27.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.007+0000 7fe301d9b700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6790/0 conn(0x7fe2e4008d90 legacy=0x7fe2e4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519553138 0 0) 0x7fe2e4009ad0 con 0x7fe2e4008d90 2021-05-26T16:43:27.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient(hunting): my global_id is 4971 2021-05-26T16:43:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e40065a0 con 0x7fe2e4008d90 2021-05-26T16:43:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2745574613 0 0) 0x7fe2e40065a0 con 0x7fe2e4008d90 2021-05-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2e4009ad0 con 0x7fe2e4008d90 2021-05-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe2f8005850 con 0x7fe2e4008d90 2021-05-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient: dump: 2021-05-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.069 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.069 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.069 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.069 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.070 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.070 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.070 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 654885356 0 0) 0x7fe2e4009ad0 con 0x7fe2e4008d90 2021-05-26T16:43:27.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 --> v1:172.21.15.137:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe2e4008740 con 0x7fe2e4008d90 2021-05-26T16:43:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7662 (unknown 0 0 2442608761) 0x7fe2f8005ce0 con 0x7fe2e4008d90 2021-05-26T16:43:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6790/0 conn(0x7fe2e4008d90 legacy=0x7fe2e4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.008+0000 7fe2f27fc700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6790/0 conn(0x7fe2e4008d90 legacy=0x7fe2e4009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:27.072 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:27.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:27.073 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:27.073 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:27.073 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:27.073 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:27.073 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:27.074 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:27.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:27.074 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:27.074 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:27.075 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:27.075 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:27.075 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:27.075 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:27.075 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.076 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:43:27.076 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:27.076 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:27.076 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:27.076 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.077 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.077 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.077 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.077 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.078 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.078 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.078 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.078 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.079 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.079 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:27.079 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:27.079 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.079 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.080 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.080 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.080 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.080 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.080 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.081 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.081 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.081 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.082 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:27.082 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:27.082 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:27.082 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:27.083 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:27.083 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:27.083 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:27.083 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:27.083 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:27.084 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:27.084 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:27.084 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:27.084 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:27.085 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:27.085 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:27.085 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.085 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.085 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.086 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.086 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.086 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.086 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.087 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.087 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.087 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.087 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:27.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.088 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:27.088 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.088 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:27.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:27.089 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.089 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.089 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.089 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.089 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:27.090 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.090 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.090 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.091 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:27.091 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:27.091 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.091 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.091 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.092 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:27.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:27.093 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.093 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.093 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.093 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:27.094 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.094 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.094 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.094 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:27.095 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:27.095 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.095 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.095 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.096 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.096 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:27.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:27.097 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.097 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.097 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:27.098 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.098 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.098 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.099 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:27.099 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:27.099 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.099 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.100 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.100 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.100 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:27.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:27.101 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.101 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.101 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.101 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:27.102 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.102 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.102 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.103 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:27.103 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:27.103 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.103 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.104 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.104 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:27.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:27.105 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.105 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.105 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.105 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:27.106 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.106 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.106 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.107 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:27.107 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:27.107 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.107 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.108 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.108 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.108 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:27.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:27.109 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.109 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.109 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.109 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.109 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:27.110 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.110 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.110 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.110 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:27.111 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:27.111 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.111 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.111 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:27.113 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.113 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.113 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.113 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.113 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:27.114 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.114 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.114 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.114 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:27.115 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:27.115 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.115 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.115 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.116 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.116 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:27.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:27.116 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.117 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.117 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.117 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.117 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:27.118 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.118 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.118 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.118 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:27.119 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:27.119 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.119 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.119 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.121 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.121 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.121 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.121 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:27.121 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.122 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.122 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.122 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:27.122 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:27.123 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.123 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.123 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.123 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.124 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.124 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:27.124 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:27.124 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.125 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.125 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.125 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:27.125 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.125 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.126 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:27.126 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.126 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.126 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.127 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4 2021-05-26T16:43:27.127 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.127 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.127 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:27.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.129 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": [ 2021-05-26T16:43:27.129 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.129 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.129 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.129 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:27.130 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.130 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.130 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:27.131 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:27.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.137:6812/30003 conn(0x7fe2e0032f50 legacy=0x7fe2e0035410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 10 monclient: shutdown 2021-05-26T16:43:27.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:27.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 >> v1:172.21.15.3:6791/0 conn(0x7fe304099a30 legacy=0x7fe304093770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe302d9d700 1 -- 172.21.15.3:0/227986371 reap_dead start 2021-05-26T16:43:27.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe302d9d700 1 -- 172.21.15.3:0/227986371 reap_dead start 2021-05-26T16:43:27.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 shutdown_connections 2021-05-26T16:43:27.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 >> 172.21.15.3:0/227986371 conn(0x7fe3040a00c0 msgr2=0x7fe30412b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:27.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 shutdown_connections 2021-05-26T16:43:27.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.009+0000 7fe30359e700 1 -- 172.21.15.3:0/227986371 wait complete. 2021-05-26T16:43:27.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2021-05-26T16:43:27.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.260+0000 7fb2e491e700 10 monclient: get_monmap_and_config 2021-05-26T16:43:27.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.260+0000 7fb2e491e700 10 monclient: build_initial_monmap 2021-05-26T16:43:27.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.260+0000 7fb2e491e700 10 monclient: monmap: 2021-05-26T16:43:27.263 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:27.261367+0000 2021-05-26T16:43:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:27.261367+0000 2021-05-26T16:43:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:27.267 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.261+0000 7fb2e491e700 1 Processor -- start 2021-05-26T16:43:27.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.261+0000 7fb2e491e700 1 -- start start 2021-05-26T16:43:27.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.261+0000 7fb2e491e700 10 monclient: init 2021-05-26T16:43:27.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.261+0000 7fb2e491e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.261+0000 7fb2e491e700 10 monclient: _add_conns ranks=[2,4,8,5,0,1,7,3,6] 2021-05-26T16:43:27.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 10 monclient(hunting): picked mon.noname-b con 0x7fb2e012cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:27.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 10 monclient(hunting): picked mon.noname-c con 0x7fb2e0099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:27.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 10 monclient(hunting): picked mon.noname-e con 0x7fb2e0099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:27.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e0046600 con 0x7fb2e012cbd0 2021-05-26T16:43:27.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e009b5e0 con 0x7fb2e0099a30 2021-05-26T16:43:27.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e012d8f0 con 0x7fb2e0099eb0 2021-05-26T16:43:27.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2e491e700 10 monclient(hunting): authenticate will time out at 964.893108s 2021-05-26T16:43:27.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2df7fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fb2e012cbd0 0x7fb2e012d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54366/0 (socket says 172.21.15.3:54366) 2021-05-26T16:43:27.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2deffd700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fb2e0099a30 0x7fb2e0131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37838/0 (socket says 172.21.15.3:37838) 2021-05-26T16:43:27.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.262+0000 7fb2df7fe700 1 -- 172.21.15.3:0/1593624117 learned_addr learned my addr 172.21.15.3:0/1593624117 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2dffff700 1 -- 172.21.15.3:0/1593624117 >> v1:172.21.15.3:6793/0 conn(0x7fb2e0099eb0 legacy=0x7fb2e0135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2deffd700 1 -- 172.21.15.3:0/1593624117 >> v1:172.21.15.3:6791/0 conn(0x7fb2e0099a30 legacy=0x7fb2e0131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2df7fe700 1 -- 172.21.15.3:0/1593624117 >> v1:172.21.15.3:6790/0 conn(0x7fb2e012cbd0 legacy=0x7fb2e012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226588404 0 0) 0x7fb2e0046600 con 0x7fb2e012cbd0 2021-05-26T16:43:27.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): my global_id is 4979 2021-05-26T16:43:27.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c4003270 con 0x7fb2e012cbd0 2021-05-26T16:43:27.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882230737 0 0) 0x7fb2e009b5e0 con 0x7fb2e0099a30 2021-05-26T16:43:27.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): my global_id is 5044 2021-05-26T16:43:27.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e0046600 con 0x7fb2e0099a30 2021-05-26T16:43:27.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973833508 0 0) 0x7fb2e012d8f0 con 0x7fb2e0099eb0 2021-05-26T16:43:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient(hunting): my global_id is 104192 2021-05-26T16:43:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e009b5e0 con 0x7fb2e0099eb0 2021-05-26T16:43:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794087746 0 0) 0x7fb2c4003270 con 0x7fb2e012cbd0 2021-05-26T16:43:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 >> v1:172.21.15.3:6793/0 conn(0x7fb2e0099eb0 legacy=0x7fb2e0135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 >> v1:172.21.15.3:6791/0 conn(0x7fb2e0099a30 legacy=0x7fb2e0131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 monclient: found mon.noname-b 2021-05-26T16:43:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e009c2b0 con 0x7fb2e012cbd0 2021-05-26T16:43:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2cc001a60 con 0x7fb2e012cbd0 2021-05-26T16:43:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2de7fc700 10 monclient: dump: 2021-05-26T16:43:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.290 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.290 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.290 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.290 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.291 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.291 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2e491e700 5 monclient: authenticate success, global_id 4979 2021-05-26T16:43:27.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.264+0000 7fb2e491e700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:27.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb2cc001d70 con 0x7fb2e012cbd0 2021-05-26T16:43:27.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2de7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:27.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2de7fc700 1 -- 172.21.15.3:0/1593624117 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2cc004930 con 0x7fb2e012cbd0 2021-05-26T16:43:27.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 4 set_mon_vals no callback set 2021-05-26T16:43:27.292 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2de7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2de7fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2de7fc700 10 monclient: dump: 2021-05-26T16:43:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.294 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.294 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.294 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.294 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.294 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.295 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.295 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.295 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.295 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.296 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.296 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.296 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.296 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.296 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 10 monclient: shutdown 2021-05-26T16:43:27.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:27.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 1 -- 172.21.15.3:0/1593624117 >> v1:172.21.15.3:6790/0 conn(0x7fb2e012cbd0 legacy=0x7fb2e012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 1 -- 172.21.15.3:0/1593624117 shutdown_connections 2021-05-26T16:43:27.297 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 1 -- 172.21.15.3:0/1593624117 >> 172.21.15.3:0/1593624117 conn(0x7fb2e00a00c0 msgr2=0x7fb2e00a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:27.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 1 -- 172.21.15.3:0/1593624117 shutdown_connections 2021-05-26T16:43:27.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 1 -- 172.21.15.3:0/1593624117 wait complete. 2021-05-26T16:43:27.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 10 monclient: build_initial_monmap 2021-05-26T16:43:27.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.265+0000 7fb2e491e700 10 monclient: monmap: 2021-05-26T16:43:27.299 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:27.299 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:27.299 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:27.299 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:27.299 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:27.300 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.300 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:27.300 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:27.300 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:27.300 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:27.301 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:27.301 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:27.301 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:27.301 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:27.302 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:27.302 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 1 Processor -- start 2021-05-26T16:43:27.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 1 -- start start 2021-05-26T16:43:27.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 10 monclient: init 2021-05-26T16:43:27.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 10 monclient: _add_conns ranks=[2,8,0,3,4,5,6,1,7] 2021-05-26T16:43:27.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 10 monclient(hunting): picked mon.noname-b con 0x7fb2e0099a30 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:27.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 10 monclient(hunting): picked mon.noname-e con 0x7fb2e0099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:27.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.266+0000 7fb2e491e700 10 monclient(hunting): picked mon.noname-a con 0x7fb2e012cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:27.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.267+0000 7fb2e491e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e0116c50 con 0x7fb2e012cbd0 2021-05-26T16:43:27.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.267+0000 7fb2e491e700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e0116ef0 con 0x7fb2e0099a30 2021-05-26T16:43:27.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.267+0000 7fb2e491e700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e0095480 con 0x7fb2e0099eb0 2021-05-26T16:43:27.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.267+0000 7fb2e491e700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.267+0000 7fb2e491e700 10 monclient(hunting): authenticate will time out at 964.898057s 2021-05-26T16:43:27.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.267+0000 7fb2df7fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fb2e0099a30 0x7fb2e013c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54370/0 (socket says 172.21.15.3:54370) 2021-05-26T16:43:27.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.267+0000 7fb2df7fe700 1 -- 172.21.15.3:0/4020840336 learned_addr learned my addr 172.21.15.3:0/4020840336 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2deffd700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.3:6793/0 conn(0x7fb2e0099eb0 legacy=0x7fb2e01410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2df7fe700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.3:6790/0 conn(0x7fb2e0099a30 legacy=0x7fb2e013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2dffff700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.3:6789/0 conn(0x7fb2e012cbd0 legacy=0x7fb2e01447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601969759 0 0) 0x7fb2e0095480 con 0x7fb2e0099eb0 2021-05-26T16:43:27.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): my global_id is 104201 2021-05-26T16:43:27.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c0003270 con 0x7fb2e0099eb0 2021-05-26T16:43:27.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207429773 0 0) 0x7fb2e0116ef0 con 0x7fb2e0099a30 2021-05-26T16:43:27.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): my global_id is 4988 2021-05-26T16:43:27.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e0095480 con 0x7fb2e0099a30 2021-05-26T16:43:27.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022421838 0 0) 0x7fb2e0116c50 con 0x7fb2e012cbd0 2021-05-26T16:43:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): my global_id is 104175 2021-05-26T16:43:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e0116ef0 con 0x7fb2e012cbd0 2021-05-26T16:43:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2460177064 0 0) 0x7fb2c0003270 con 0x7fb2e0099eb0 2021-05-26T16:43:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2e0116c50 con 0x7fb2e0099eb0 2021-05-26T16:43:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2d0001d30 con 0x7fb2e0099eb0 2021-05-26T16:43:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): dump: 2021-05-26T16:43:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.312 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.312 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.312 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.312 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.312 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.314 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3309556872 0 0) 0x7fb2e0095480 con 0x7fb2e0099a30 2021-05-26T16:43:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2c0003270 con 0x7fb2e0099a30 2021-05-26T16:43:27.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1183489611 0 0) 0x7fb2e0116ef0 con 0x7fb2e012cbd0 2021-05-26T16:43:27.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2e0095480 con 0x7fb2e012cbd0 2021-05-26T16:43:27.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2cc004870 con 0x7fb2e0099a30 2021-05-26T16:43:27.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:27.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): dump: 2021-05-26T16:43:27.316 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.316 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.316 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.317 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.317 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.317 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.317 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.317 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.317 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.318 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.318 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.318 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.318 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.319 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.319 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.319 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2d40020a0 con 0x7fb2e012cbd0 2021-05-26T16:43:27.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:27.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient(hunting): dump: 2021-05-26T16:43:27.320 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.320 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.320 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.321 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.321 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.321 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.321 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.321 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.323 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1628237659 0 0) 0x7fb2e0116c50 con 0x7fb2e0099eb0 2021-05-26T16:43:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.3:6790/0 conn(0x7fb2e0099a30 legacy=0x7fb2e013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.3:6789/0 conn(0x7fb2e012cbd0 legacy=0x7fb2e01447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 monclient: found mon.e 2021-05-26T16:43:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e013cb40 con 0x7fb2e0099eb0 2021-05-26T16:43:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2cb7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.269+0000 7fb2e491e700 5 monclient: authenticate success, global_id 104201 2021-05-26T16:43:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2e491e700 10 monclient: _renew_subs 2021-05-26T16:43:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2e491e700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e0096120 con 0x7fb2e0099eb0 2021-05-26T16:43:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2e491e700 10 monclient: _renew_subs 2021-05-26T16:43:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2e491e700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e01299d0 con 0x7fb2e0099eb0 2021-05-26T16:43:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb2d0004a80 con 0x7fb2e0099eb0 2021-05-26T16:43:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2d0004f30 con 0x7fb2e0099eb0 2021-05-26T16:43:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2ddffb700 4 set_mon_vals no callback set 2021-05-26T16:43:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 10 monclient: dump: 2021-05-26T16:43:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.331 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fb2d0005110 con 0x7fb2e0099eb0 2021-05-26T16:43:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(110..110 src has 1..110) v4 ==== 3941+0+0 (unknown 409044692 0 0) 0x7fb2d003da90 con 0x7fb2e0099eb0 2021-05-26T16:43:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.270+0000 7fb2e491e700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.271+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb2b80065a0 con 0x7fb2b8002840 2021-05-26T16:43:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.271+0000 7fb2df7fe700 10 monclient: get_auth_request con 0x7fb2c00333b0 auth_method 0 2021-05-26T16:43:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2dffff700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.137:6791/0 conn(0x7fb2b8002840 legacy=0x7fb2b8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117132427 0 0) 0x7fb2b80065a0 con 0x7fb2b8002840 2021-05-26T16:43:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 10 monclient(hunting): my global_id is 5090 2021-05-26T16:43:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e0116c50 con 0x7fb2b8002840 2021-05-26T16:43:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2672153972 0 0) 0x7fb2e0116c50 con 0x7fb2b8002840 2021-05-26T16:43:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2b80065a0 con 0x7fb2b8002840 2021-05-26T16:43:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2d40027f0 con 0x7fb2b8002840 2021-05-26T16:43:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.273+0000 7fb2cb7fe700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 10 monclient: dump: 2021-05-26T16:43:27.335 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.335 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.335 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.335 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.335 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.336 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.337 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.337 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.337 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.337 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.337 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.338 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2324650808 0 0) 0x7fb2b80065a0 con 0x7fb2b8002840 2021-05-26T16:43:27.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2b8009e40 con 0x7fb2b8002840 2021-05-26T16:43:27.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fb2d4002cd0 con 0x7fb2b8002840 2021-05-26T16:43:27.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:27.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.137:6791/0 conn(0x7fb2b8002840 legacy=0x7fb2b8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.274+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.137:6791/0 conn(0x7fb2b8002840 legacy=0x7fb2b8004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:27.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.281+0000 7fb2e491e700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:27.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.281+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb2b8007510 con 0x7fb2b80068b0 2021-05-26T16:43:27.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.283+0000 7fb2dffff700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.137:6791/0 conn(0x7fb2b80068b0 legacy=0x7fb2b8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.283+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416304436 0 0) 0x7fb2b8007510 con 0x7fb2b80068b0 2021-05-26T16:43:27.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.283+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.283+0000 7fb2cb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.283+0000 7fb2cb7fe700 10 monclient(hunting): my global_id is 5099 2021-05-26T16:43:27.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.283+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b80065a0 con 0x7fb2b80068b0 2021-05-26T16:43:27.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3703814609 0 0) 0x7fb2b80065a0 con 0x7fb2b80068b0 2021-05-26T16:43:27.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2b8007510 con 0x7fb2b80068b0 2021-05-26T16:43:27.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fb2d4005bd0 con 0x7fb2b80068b0 2021-05-26T16:43:27.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:27.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 10 monclient: dump: 2021-05-26T16:43:27.345 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.345 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.345 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.345 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.345 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.346 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.346 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.346 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.346 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.346 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.347 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.347 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.347 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.347 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.348 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.348 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3977738658 0 0) 0x7fb2b8007510 con 0x7fb2b80068b0 2021-05-26T16:43:27.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 --> v1:172.21.15.137:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb2b8008770 con 0x7fb2b80068b0 2021-05-26T16:43:27.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 3533094169) 0x7fb2d4005f30 con 0x7fb2b80068b0 2021-05-26T16:43:27.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:27.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:27.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.137:6791/0 conn(0x7fb2b80068b0 legacy=0x7fb2b8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.284+0000 7fb2cb7fe700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.137:6791/0 conn(0x7fb2b80068b0 legacy=0x7fb2b8006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:27.350 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:43:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:43:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:27.406 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.137:6812/30003 conn(0x7fb2c00333b0 legacy=0x7fb2c0035870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 10 monclient: shutdown 2021-05-26T16:43:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 >> v1:172.21.15.3:6793/0 conn(0x7fb2e0099eb0 legacy=0x7fb2e01410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2dffff700 1 -- 172.21.15.3:0/4020840336 reap_dead start 2021-05-26T16:43:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2dffff700 1 -- 172.21.15.3:0/4020840336 reap_dead start 2021-05-26T16:43:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 shutdown_connections 2021-05-26T16:43:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 >> 172.21.15.3:0/4020840336 conn(0x7fb2e00a00c0 msgr2=0x7fb2e012b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 shutdown_connections 2021-05-26T16:43:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.285+0000 7fb2e491e700 1 -- 172.21.15.3:0/4020840336 wait complete. 2021-05-26T16:43:27.410 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2021-05-26T16:43:27.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.525+0000 7fe9cdecc700 10 monclient: get_monmap_and_config 2021-05-26T16:43:27.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.525+0000 7fe9cdecc700 10 monclient: build_initial_monmap 2021-05-26T16:43:27.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.525+0000 7fe9cdecc700 10 monclient: monmap: 2021-05-26T16:43:27.528 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:27.528 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.529 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:27.526200+0000 2021-05-26T16:43:27.529 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:27.526200+0000 2021-05-26T16:43:27.529 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:27.529 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.530 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:27.530 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:27.530 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:27.530 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:27.531 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:27.531 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:27.531 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:27.531 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:27.531 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:27.532 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 1 Processor -- start 2021-05-26T16:43:27.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 1 -- start start 2021-05-26T16:43:27.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient: init 2021-05-26T16:43:27.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient: _add_conns ranks=[2,1,0,5,8,4,6,7,3] 2021-05-26T16:43:27.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient(hunting): picked mon.noname-b con 0x7fe9c812cd90 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:27.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient(hunting): picked mon.noname-f con 0x7fe9c8096d10 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient(hunting): picked mon.noname-a con 0x7fe9c812d760 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c8046600 con 0x7fe9c812d760 2021-05-26T16:43:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c8097820 con 0x7fe9c8096d10 2021-05-26T16:43:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c809a3f0 con 0x7fe9c812cd90 2021-05-26T16:43:27.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cdecc700 10 monclient(hunting): authenticate will time out at 965.157815s 2021-05-26T16:43:27.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cd6cb700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe9c812d760 0x7fe9c81357f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52344/0 (socket says 172.21.15.3:52344) 2021-05-26T16:43:27.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cd6cb700 1 -- 172.21.15.3:0/2591736372 learned_addr learned my addr 172.21.15.3:0/2591736372 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.526+0000 7fe9cceca700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fe9c812cd90 0x7fe9c8099ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54382/0 (socket says 172.21.15.3:54382) 2021-05-26T16:43:27.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9cd6cb700 1 -- 172.21.15.3:0/2591736372 >> v1:172.21.15.3:6789/0 conn(0x7fe9c812d760 legacy=0x7fe9c81357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9cceca700 1 -- 172.21.15.3:0/2591736372 >> v1:172.21.15.3:6790/0 conn(0x7fe9c812cd90 legacy=0x7fe9c8099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464634692 0 0) 0x7fe9c8046600 con 0x7fe9c812d760 2021-05-26T16:43:27.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient(hunting): my global_id is 104184 2021-05-26T16:43:27.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9b4003270 con 0x7fe9c812d760 2021-05-26T16:43:27.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803073153 0 0) 0x7fe9c809a3f0 con 0x7fe9c812cd90 2021-05-26T16:43:27.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient(hunting): my global_id is 4997 2021-05-26T16:43:27.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c8046600 con 0x7fe9c812cd90 2021-05-26T16:43:27.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bffff700 1 -- 172.21.15.3:0/2591736372 >> v1:172.21.15.137:6789/0 conn(0x7fe9c8096d10 legacy=0x7fe9c81320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 401692568 0 0) 0x7fe9c8046600 con 0x7fe9c812cd90 2021-05-26T16:43:27.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 >> v1:172.21.15.137:6789/0 conn(0x7fe9c8096d10 legacy=0x7fe9c81320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 >> v1:172.21.15.3:6789/0 conn(0x7fe9c812d760 legacy=0x7fe9c81357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 monclient: found mon.noname-b 2021-05-26T16:43:27.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:27.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c809c7c0 con 0x7fe9c812cd90 2021-05-26T16:43:27.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9cdecc700 5 monclient: authenticate success, global_id 4997 2021-05-26T16:43:27.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9cdecc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:27.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9b8001a60 con 0x7fe9c812cd90 2021-05-26T16:43:27.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:27.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: dump: 2021-05-26T16:43:27.554 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.554 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.554 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.554 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.555 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.555 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.555 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.555 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.556 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.556 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.556 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.556 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.556 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.557 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.557 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.557 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9cdecc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:27.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe9b8001d80 con 0x7fe9c812cd90 2021-05-26T16:43:27.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 1 -- 172.21.15.3:0/2591736372 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9b8004870 con 0x7fe9c812cd90 2021-05-26T16:43:27.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9cdecc700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:27.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9cdecc700 4 set_mon_vals no callback set 2021-05-26T16:43:27.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:27.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.529+0000 7fe9bf7fe700 10 monclient: dump: 2021-05-26T16:43:27.559 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.559 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.560 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.560 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.560 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.560 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.561 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.561 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.561 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.561 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.562 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.562 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.562 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.562 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.562 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.563 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 10 monclient: shutdown 2021-05-26T16:43:27.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:27.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 1 -- 172.21.15.3:0/2591736372 >> v1:172.21.15.3:6790/0 conn(0x7fe9c812cd90 legacy=0x7fe9c8099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 1 -- 172.21.15.3:0/2591736372 shutdown_connections 2021-05-26T16:43:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 1 -- 172.21.15.3:0/2591736372 >> 172.21.15.3:0/2591736372 conn(0x7fe9c809ffa0 msgr2=0x7fe9c80a0380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 1 -- 172.21.15.3:0/2591736372 shutdown_connections 2021-05-26T16:43:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 1 -- 172.21.15.3:0/2591736372 wait complete. 2021-05-26T16:43:27.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 10 monclient: build_initial_monmap 2021-05-26T16:43:27.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.530+0000 7fe9cdecc700 10 monclient: monmap: 2021-05-26T16:43:27.565 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:27.565 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:27.565 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:27.566 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:27.566 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:27.566 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.566 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:27.568 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:27.568 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:27.568 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:27.568 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 1 Processor -- start 2021-05-26T16:43:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 1 -- start start 2021-05-26T16:43:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient: init 2021-05-26T16:43:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient: _add_conns ranks=[6,1,8,3,7,2,0,4,5] 2021-05-26T16:43:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient(hunting): picked mon.noname-d con 0x7fe9c8096d10 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient(hunting): picked mon.noname-f con 0x7fe9c812cd90 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient(hunting): picked mon.noname-e con 0x7fe9c812d760 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c8119d90 con 0x7fe9c812cd90 2021-05-26T16:43:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c813cbc0 con 0x7fe9c8096d10 2021-05-26T16:43:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c811a000 con 0x7fe9c812d760 2021-05-26T16:43:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cdecc700 10 monclient(hunting): authenticate will time out at 965.162747s 2021-05-26T16:43:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cceca700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fe9c8096d10 0x7fe9c81297f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57746/0 (socket says 172.21.15.3:57746) 2021-05-26T16:43:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.531+0000 7fe9cceca700 1 -- 172.21.15.3:0/725273196 learned_addr learned my addr 172.21.15.3:0/725273196 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.533+0000 7fe9cceca700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.3:6792/0 conn(0x7fe9c8096d10 legacy=0x7fe9c81297f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.533+0000 7fe9cd6cb700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.3:6793/0 conn(0x7fe9c812d760 legacy=0x7fe9c8144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583056050 0 0) 0x7fe9c809c7c0 con 0x7fe9c8096d10 2021-05-26T16:43:27.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): my global_id is 4938 2021-05-26T16:43:27.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bffff700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6789/0 conn(0x7fe9c812cd90 legacy=0x7fe9c8141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9a8003270 con 0x7fe9c8096d10 2021-05-26T16:43:27.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506970031 0 0) 0x7fe9c811a000 con 0x7fe9c812d760 2021-05-26T16:43:27.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): my global_id is 104210 2021-05-26T16:43:27.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c809c7c0 con 0x7fe9c812d760 2021-05-26T16:43:27.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685994042 0 0) 0x7fe9c8119d90 con 0x7fe9c812cd90 2021-05-26T16:43:27.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): my global_id is 4969 2021-05-26T16:43:27.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c811a000 con 0x7fe9c812cd90 2021-05-26T16:43:27.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3764382299 0 0) 0x7fe9a8003270 con 0x7fe9c8096d10 2021-05-26T16:43:27.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9c8119d90 con 0x7fe9c8096d10 2021-05-26T16:43:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9b8004870 con 0x7fe9c8096d10 2021-05-26T16:43:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): dump: 2021-05-26T16:43:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.580 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.580 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.580 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.580 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.581 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2225344371 0 0) 0x7fe9c809c7c0 con 0x7fe9c812d760 2021-05-26T16:43:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9a8003270 con 0x7fe9c812d760 2021-05-26T16:43:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9c4001ff0 con 0x7fe9c812d760 2021-05-26T16:43:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): dump: 2021-05-26T16:43:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.585 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.585 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.585 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.585 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.585 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.586 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.586 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1429490471 0 0) 0x7fe9c811a000 con 0x7fe9c812cd90 2021-05-26T16:43:27.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9c809c7c0 con 0x7fe9c812cd90 2021-05-26T16:43:27.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9b0001ce0 con 0x7fe9c812cd90 2021-05-26T16:43:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient(hunting): dump: 2021-05-26T16:43:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.589 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.589 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.589 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.589 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.589 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.590 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.590 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.590 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.590 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.591 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.591 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 619991887 0 0) 0x7fe9c8119d90 con 0x7fe9c8096d10 2021-05-26T16:43:27.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.3:6793/0 conn(0x7fe9c812d760 legacy=0x7fe9c8144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6789/0 conn(0x7fe9c812cd90 legacy=0x7fe9c8141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 monclient: found mon.d 2021-05-26T16:43:27.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:27.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c811a2a0 con 0x7fe9c8096d10 2021-05-26T16:43:27.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9cdecc700 5 monclient: authenticate success, global_id 4938 2021-05-26T16:43:27.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9cdecc700 10 monclient: _renew_subs 2021-05-26T16:43:27.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9cdecc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:27.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c81180f0 con 0x7fe9c8096d10 2021-05-26T16:43:27.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9cdecc700 10 monclient: _renew_subs 2021-05-26T16:43:27.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9cdecc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:27.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c812a140 con 0x7fe9c8096d10 2021-05-26T16:43:27.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe9b8004ea0 con 0x7fe9c8096d10 2021-05-26T16:43:27.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9b8005350 con 0x7fe9c8096d10 2021-05-26T16:43:27.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9beffd700 4 set_mon_vals no callback set 2021-05-26T16:43:27.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:27.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.534+0000 7fe9bcff9700 10 monclient: dump: 2021-05-26T16:43:27.596 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.596 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.597 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.597 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.597 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.597 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.598 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.598 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.598 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.598 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.598 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.599 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.599 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.599 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.599 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.600 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.535+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fe9b8005530 con 0x7fe9c8096d10 2021-05-26T16:43:27.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.535+0000 7fe9cdecc700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.535+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe9a00065a0 con 0x7fe9a0002840 2021-05-26T16:43:27.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.535+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(110..110 src has 1..110) v4 ==== 3941+0+0 (unknown 409044692 0 0) 0x7fe9b803d9d0 con 0x7fe9c8096d10 2021-05-26T16:43:27.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.536+0000 7fe9cd6cb700 10 monclient: get_auth_request con 0x7fe9a80332d0 auth_method 0 2021-05-26T16:43:27.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bffff700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6792/0 conn(0x7fe9a0002840 legacy=0x7fe9a0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063110115 0 0) 0x7fe9a00065a0 con 0x7fe9a0002840 2021-05-26T16:43:27.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 10 monclient(hunting): my global_id is 104146 2021-05-26T16:43:27.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c8119d90 con 0x7fe9a0002840 2021-05-26T16:43:27.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2569877897 0 0) 0x7fe9c8119d90 con 0x7fe9a0002840 2021-05-26T16:43:27.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9a00065a0 con 0x7fe9a0002840 2021-05-26T16:43:27.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9b00024b0 con 0x7fe9a0002840 2021-05-26T16:43:27.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.538+0000 7fe9bcff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:27.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 10 monclient: dump: 2021-05-26T16:43:27.603 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.604 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.604 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.604 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.604 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.605 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.605 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.605 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.605 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.605 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.606 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.606 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.606 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.606 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.606 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.607 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 176554787 0 0) 0x7fe9a00065a0 con 0x7fe9a0002840 2021-05-26T16:43:27.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9a0009e40 con 0x7fe9a0002840 2021-05-26T16:43:27.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe9b00028d0 con 0x7fe9a0002840 2021-05-26T16:43:27.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:27.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6792/0 conn(0x7fe9a0002840 legacy=0x7fe9a0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.539+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6792/0 conn(0x7fe9a0002840 legacy=0x7fe9a0004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:27.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.546+0000 7fe9cdecc700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:27.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.546+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe9a0009ad0 con 0x7fe9a0008d90 2021-05-26T16:43:27.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bffff700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6792/0 conn(0x7fe9a0008d90 legacy=0x7fe9a0009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789676013 0 0) 0x7fe9a0009ad0 con 0x7fe9a0008d90 2021-05-26T16:43:27.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient(hunting): my global_id is 104155 2021-05-26T16:43:27.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9a00065a0 con 0x7fe9a0008d90 2021-05-26T16:43:27.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1896170676 0 0) 0x7fe9a00065a0 con 0x7fe9a0008d90 2021-05-26T16:43:27.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9a0009ad0 con 0x7fe9a0008d90 2021-05-26T16:43:27.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe9b0002dd0 con 0x7fe9a0008d90 2021-05-26T16:43:27.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:27.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient: dump: 2021-05-26T16:43:27.614 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.614 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.614 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.614 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.615 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.615 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.615 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.615 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.615 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.616 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.616 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.616 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.616 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.616 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.617 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.617 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 686591415 0 0) 0x7fe9a0009ad0 con 0x7fe9a0008d90 2021-05-26T16:43:27.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 --> v1:172.21.15.137:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe9a0008740 con 0x7fe9a0008d90 2021-05-26T16:43:27.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 2444986424) 0x7fe9b0007ae0 con 0x7fe9a0008d90 2021-05-26T16:43:27.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:27.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:27.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6792/0 conn(0x7fe9a0008d90 legacy=0x7fe9a0009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.549+0000 7fe9bcff9700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6792/0 conn(0x7fe9a0008d90 legacy=0x7fe9a0009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:27.619 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:27.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:27.619 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:27.620 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:27.620 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:27.620 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:27.620 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:27.621 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:27.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:27.621 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:27.621 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:27.621 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:27.622 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:27.622 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:27.622 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:27.622 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.623 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:43:27.623 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:27.623 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:27.623 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:27.623 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.624 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.624 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.624 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.624 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.624 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.625 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.625 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.625 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.625 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.626 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:27.626 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:27.626 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.626 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.626 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.627 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.627 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.627 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.627 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.628 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.628 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.628 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.628 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:27.629 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:27.629 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:27.629 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:27.629 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:27.630 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:27.630 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:27.630 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:27.630 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:27.630 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:27.631 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:27.631 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:27.631 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:27.631 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:27.632 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:27.632 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:27.632 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:27.632 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:27.632 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:27.633 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:27.633 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:27.633 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:27.633 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:27.634 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:27.634 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.634 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:27.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.634 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:27.635 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.635 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:27.635 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:27.635 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.636 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.636 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.636 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.636 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:27.636 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:27.638 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:27.638 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.638 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.638 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.639 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.639 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:27.639 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:27.639 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.640 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.640 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.640 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.640 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:27.641 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.641 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.641 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.641 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.641 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:27.642 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:27.642 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.642 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.642 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.642 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.643 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.643 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:27.643 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:27.643 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.644 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.644 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.644 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.644 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:27.644 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.645 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.645 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.645 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.645 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:27.646 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:27.646 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.646 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.646 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.646 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.647 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.647 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:27.647 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:27.647 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.648 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.648 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.648 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.648 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:27.649 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.649 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.649 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.649 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:27.650 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:27.650 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.650 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.650 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.651 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.651 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:27.651 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:27.651 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.652 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.652 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.652 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.652 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:27.652 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.653 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.653 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.653 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.653 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:27.653 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:27.654 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.654 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.654 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.654 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.655 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.655 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:27.655 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:27.655 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.655 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.656 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.656 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.656 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:27.656 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.656 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.658 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.658 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.658 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.658 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.659 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:27.659 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:27.659 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.659 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.659 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.660 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.660 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:27.660 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.660 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.660 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.661 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:27.661 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:27.661 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.662 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.662 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.662 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.662 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.662 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:27.663 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:27.663 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.663 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.663 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.663 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.664 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:27.664 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.664 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.664 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.664 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.665 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:27.665 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:27.665 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.665 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.665 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.666 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.666 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.666 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:27.666 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:27.667 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:27.667 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:27.667 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.667 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:27.668 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:27.668 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:27.668 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.668 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.668 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.669 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:27.669 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:27.669 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:27.669 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:27.669 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:27.670 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.670 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.670 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:27.670 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:27.671 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.671 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.671 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.671 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:27.671 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.672 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:27.672 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:27.672 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:27.672 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:27.672 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:27.673 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:27.673 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:27.673 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:27.673 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:27.673 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:27.674 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:27.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.137:6812/30003 conn(0x7fe9a80332d0 legacy=0x7fe9a8035790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 10 monclient: shutdown 2021-05-26T16:43:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 >> v1:172.21.15.3:6792/0 conn(0x7fe9c8096d10 legacy=0x7fe9c81297f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cd6cb700 1 -- 172.21.15.3:0/725273196 reap_dead start 2021-05-26T16:43:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cd6cb700 1 -- 172.21.15.3:0/725273196 reap_dead start 2021-05-26T16:43:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 shutdown_connections 2021-05-26T16:43:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 >> 172.21.15.3:0/725273196 conn(0x7fe9c809ffa0 msgr2=0x7fe9c812bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 shutdown_connections 2021-05-26T16:43:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.550+0000 7fe9cdecc700 1 -- 172.21.15.3:0/725273196 wait complete. 2021-05-26T16:43:27.678 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-05-26T16:43:27.678 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-05-26T16:43:27.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.792+0000 7f97d4992700 10 monclient: get_monmap_and_config 2021-05-26T16:43:27.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.792+0000 7f97d4992700 10 monclient: build_initial_monmap 2021-05-26T16:43:27.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.792+0000 7f97d4992700 10 monclient: monmap: 2021-05-26T16:43:27.796 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:27.796 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.796 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:27.793211+0000 2021-05-26T16:43:27.796 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:27.793211+0000 2021-05-26T16:43:27.797 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:27.797 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.797 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:27.797 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:27.798 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:27.798 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:27.798 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:27.799 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:27.799 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:27.799 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:27.800 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 1 Processor -- start 2021-05-26T16:43:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 1 -- start start 2021-05-26T16:43:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient: init 2021-05-26T16:43:27.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient: _add_conns ranks=[7,3,0,6,2,5,4,8,1] 2021-05-26T16:43:27.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient(hunting): picked mon.noname-i con 0x7f97d012cbd0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:27.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient(hunting): picked mon.noname-g con 0x7f97d0099a30 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:27.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient(hunting): picked mon.noname-a con 0x7f97d0099eb0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:27.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d0046600 con 0x7f97d0099eb0 2021-05-26T16:43:27.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d009b5e0 con 0x7f97d0099a30 2021-05-26T16:43:27.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d012d8f0 con 0x7f97d012cbd0 2021-05-26T16:43:27.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97d4992700 10 monclient(hunting): authenticate will time out at 965.424693s 2021-05-26T16:43:27.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97cf59e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f97d0099eb0 0x7f97d0135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52362/0 (socket says 172.21.15.3:52362) 2021-05-26T16:43:27.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.793+0000 7f97cf59e700 1 -- 172.21.15.3:0/388487854 learned_addr learned my addr 172.21.15.3:0/388487854 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.795+0000 7f97cf59e700 1 -- 172.21.15.3:0/388487854 >> v1:172.21.15.3:6789/0 conn(0x7f97d0099eb0 legacy=0x7f97d0135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97ce59c700 1 -- 172.21.15.3:0/388487854 >> v1:172.21.15.137:6790/0 conn(0x7f97d0099a30 legacy=0x7f97d0131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97ced9d700 1 -- 172.21.15.3:0/388487854 >> v1:172.21.15.137:6792/0 conn(0x7f97d012cbd0 legacy=0x7f97d012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753757133 0 0) 0x7f97d0046600 con 0x7f97d0099eb0 2021-05-26T16:43:27.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): my global_id is 104193 2021-05-26T16:43:27.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97bc003270 con 0x7f97d0099eb0 2021-05-26T16:43:27.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043626511 0 0) 0x7f97d009b5e0 con 0x7f97d0099a30 2021-05-26T16:43:27.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): my global_id is 4980 2021-05-26T16:43:27.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d0046600 con 0x7f97d0099a30 2021-05-26T16:43:27.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847730515 0 0) 0x7f97d012d8f0 con 0x7f97d012cbd0 2021-05-26T16:43:27.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient(hunting): my global_id is 104164 2021-05-26T16:43:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d009b5e0 con 0x7f97d012cbd0 2021-05-26T16:43:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236683045 0 0) 0x7f97bc003270 con 0x7f97d0099eb0 2021-05-26T16:43:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 >> v1:172.21.15.137:6792/0 conn(0x7f97d012cbd0 legacy=0x7f97d012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 >> v1:172.21.15.137:6790/0 conn(0x7f97d0099a30 legacy=0x7f97d0131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 monclient: found mon.noname-a 2021-05-26T16:43:27.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:43:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d009c2b0 con 0x7f97d0099eb0 2021-05-26T16:43:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f97c0001de0 con 0x7f97d0099eb0 2021-05-26T16:43:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 5 monclient: authenticate success, global_id 104193 2021-05-26T16:43:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: dump: 2021-05-26T16:43:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.826 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.826 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.826 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.826 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.826 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.827 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.827 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.827 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.827 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.828 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:27.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f97c00020f0 con 0x7f97d0099eb0 2021-05-26T16:43:27.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:27.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 1 -- 172.21.15.3:0/388487854 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f97c0004cb0 con 0x7f97d0099eb0 2021-05-26T16:43:27.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 4 set_mon_vals no callback set 2021-05-26T16:43:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97cdd9b700 10 monclient: dump: 2021-05-26T16:43:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.831 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.831 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.831 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.831 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.832 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.832 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.832 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.832 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.832 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.833 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.833 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.833 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.833 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 10 monclient: shutdown 2021-05-26T16:43:27.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:27.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 1 -- 172.21.15.3:0/388487854 >> v1:172.21.15.3:6789/0 conn(0x7f97d0099eb0 legacy=0x7f97d0135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.796+0000 7f97d4992700 1 -- 172.21.15.3:0/388487854 shutdown_connections 2021-05-26T16:43:27.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.797+0000 7f97d4992700 1 -- 172.21.15.3:0/388487854 >> 172.21.15.3:0/388487854 conn(0x7f97d00a00c0 msgr2=0x7f97d00a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:27.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.797+0000 7f97d4992700 1 -- 172.21.15.3:0/388487854 shutdown_connections 2021-05-26T16:43:27.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.797+0000 7f97d4992700 1 -- 172.21.15.3:0/388487854 wait complete. 2021-05-26T16:43:27.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.797+0000 7f97d4992700 10 monclient: build_initial_monmap 2021-05-26T16:43:27.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.797+0000 7f97d4992700 10 monclient: monmap: 2021-05-26T16:43:27.836 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:27.836 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:27.836 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:27.836 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:27.836 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:27.839 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 1 Processor -- start 2021-05-26T16:43:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 1 -- start start 2021-05-26T16:43:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient: init 2021-05-26T16:43:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient: _add_conns ranks=[2,8,1,4,6,5,0,7,3] 2021-05-26T16:43:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient(hunting): picked mon.noname-b con 0x7f97d0099a30 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:27.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient(hunting): picked mon.noname-e con 0x7f97d0099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:27.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient(hunting): picked mon.noname-f con 0x7f97d012cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:27.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d0094500 con 0x7f97d012cbd0 2021-05-26T16:43:27.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d0116a90 con 0x7f97d0099a30 2021-05-26T16:43:27.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d0116d30 con 0x7f97d0099eb0 2021-05-26T16:43:27.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:27.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97d4992700 10 monclient(hunting): authenticate will time out at 965.429596s 2021-05-26T16:43:27.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97ced9d700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f97d0099a30 0x7f97d00936e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54406/0 (socket says 172.21.15.3:54406) 2021-05-26T16:43:27.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.798+0000 7f97ced9d700 1 -- 172.21.15.3:0/1147773771 learned_addr learned my addr 172.21.15.3:0/1147773771 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.800+0000 7f97ced9d700 1 -- 172.21.15.3:0/1147773771 >> v1:172.21.15.3:6790/0 conn(0x7f97d0099a30 legacy=0x7f97d00936e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.800+0000 7f97ce59c700 1 -- 172.21.15.3:0/1147773771 >> v1:172.21.15.3:6793/0 conn(0x7f97d0099eb0 legacy=0x7f97d0093df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.800+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475039237 0 0) 0x7f97d0116a90 con 0x7f97d0099a30 2021-05-26T16:43:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): my global_id is 5006 2021-05-26T16:43:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b0003270 con 0x7f97d0099a30 2021-05-26T16:43:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039839099 0 0) 0x7f97d0116d30 con 0x7f97d0099eb0 2021-05-26T16:43:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): my global_id is 104219 2021-05-26T16:43:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d0116a90 con 0x7f97d0099eb0 2021-05-26T16:43:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97cf59e700 1 -- 172.21.15.3:0/1147773771 >> v1:172.21.15.137:6789/0 conn(0x7f97d012cbd0 legacy=0x7f97d01441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2065315862 0 0) 0x7f97b0003270 con 0x7f97d0099a30 2021-05-26T16:43:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f97d0116d30 con 0x7f97d0099a30 2021-05-26T16:43:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f97c4001d50 con 0x7f97d0099a30 2021-05-26T16:43:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): dump: 2021-05-26T16:43:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.850 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3067329621 0 0) 0x7f97d0116a90 con 0x7f97d0099eb0 2021-05-26T16:43:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f97b0003270 con 0x7f97d0099eb0 2021-05-26T16:43:27.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f97b8001d80 con 0x7f97d0099eb0 2021-05-26T16:43:27.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:27.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient(hunting): dump: 2021-05-26T16:43:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.853 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.853 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.853 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.853 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.853 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.854 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.854 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.854 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.854 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.855 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 676208740 0 0) 0x7f97d0116d30 con 0x7f97d0099a30 2021-05-26T16:43:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 >> v1:172.21.15.3:6793/0 conn(0x7f97d0099eb0 legacy=0x7f97d0093df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 >> v1:172.21.15.137:6789/0 conn(0x7f97d012cbd0 legacy=0x7f97d01441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:27.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:27.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 monclient: found mon.b 2021-05-26T16:43:27.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:27.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:27.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00968a0 con 0x7f97d0099a30 2021-05-26T16:43:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient: _finish_auth 0 2021-05-26T16:43:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97d4992700 5 monclient: authenticate success, global_id 5006 2021-05-26T16:43:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97d4992700 10 monclient: _renew_subs 2021-05-26T16:43:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97d4992700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d0095f10 con 0x7f97d0099a30 2021-05-26T16:43:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97d4992700 10 monclient: _renew_subs 2021-05-26T16:43:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97d4992700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d01172b0 con 0x7f97d0099a30 2021-05-26T16:43:27.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f97c4002430 con 0x7f97d0099a30 2021-05-26T16:43:27.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:27.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f97c40028e0 con 0x7f97d0099a30 2021-05-26T16:43:27.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:27.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97cd59a700 4 set_mon_vals no callback set 2021-05-26T16:43:27.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:27.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.801+0000 7f97b6ffd700 10 monclient: dump: 2021-05-26T16:43:27.860 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:27.860 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:27.861 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.861 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:27.861 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:27.861 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:27.861 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:27.862 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:27.862 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:27.862 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:27.862 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:27.863 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:27.863 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:27.863 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:27.863 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:27.863 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:27.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.802+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f97c4002b00 con 0x7f97d0099a30 2021-05-26T16:43:27.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.802+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(110..110 src has 1..110) v4 ==== 3941+0+0 (unknown 409044692 0 0) 0x7f97c403da60 con 0x7f97d0099a30 2021-05-26T16:43:27.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.802+0000 7f97d4992700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.802+0000 7f97d4992700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.802+0000 7f97d4992700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:27.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.802+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a8004db0 con 0x7f97d0099a30 2021-05-26T16:43:27.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.802+0000 7f97ce59c700 10 monclient: get_auth_request con 0x7f97b0032e50 auth_method 0 2021-05-26T16:43:27.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.807+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f97c4002d90 con 0x7f97d0099a30 2021-05-26T16:43:27.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.807+0000 7f97b6ffd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:27.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:27.807+0000 7f97b6ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:28.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.028+0000 7f97d4992700 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2021-05-26T16:43:28.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.028+0000 7f97d4992700 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2021-05-26T16:43:28.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.028+0000 7f97d4992700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:28.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.028+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f97a8005870 con 0x7f97d0099a30 2021-05-26T16:43:28.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f97b6ffd700 1 -- 172.21.15.3:0/1147773771 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7f97c40131a0 con 0x7f97d0099a30 2021-05-26T16:43:28.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f97b6ffd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2021-05-26T16:43:28.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f97b6ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:28.035 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.035 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.035 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=11,kv=5,logm=65} crc {auth=1979206816,config=3140514009,health=2725584139,kv=2528252110,logm=2645545006}) 2021-05-26T16:43:28.035 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.036 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.036 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=6,logm=63} crc {auth=2173252775,config=3140514009,health=1267016307,kv=2777291952,logm=2111657885}) 2021-05-26T16:43:28.036 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.036 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.037 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=2,health=12,kv=6,logm=64} crc {auth=4115788005,config=3140514009,health=1267016307,kv=2777291952,logm=3641130801}) 2021-05-26T16:43:28.037 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.037 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.037 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=17,config=2,health=11,kv=6,logm=64} crc {auth=1055585554,config=3140514009,health=1802613762,kv=2777291952,logm=1460494339}) 2021-05-26T16:43:28.037 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.038 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.038 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=10,kv=6,logm=64} crc {auth=1274124791,config=3140514009,health=222713608,kv=2777291952,logm=2627124632}) 2021-05-26T16:43:28.038 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.038 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.039 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=18,config=2,health=12,kv=6,logm=62} crc {auth=1274124791,config=3140514009,health=1322380842,kv=2777291952,logm=1871568284}) 2021-05-26T16:43:28.039 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.039 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.039 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=18,config=2,health=11,kv=6,logm=63} crc {auth=1274124791,config=3140514009,health=2725584139,kv=2777291952,logm=1290010565}) 2021-05-26T16:43:28.039 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.040 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=1,health=12,kv=4,logm=65} crc {auth=1274124791,config=1228700967,health=944019775,kv=789904155,logm=678913372}) 2021-05-26T16:43:28.040 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.030+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=18,config=2,health=10,kv=6,logm=64} crc {auth=1512187290,config=3140514009,health=2521029769,kv=2777291952,logm=2631946749}) 2021-05-26T16:43:28.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 >> v1:172.21.15.137:6812/30003 conn(0x7f97b0032e50 legacy=0x7f97b0035310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:28.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 10 monclient: shutdown 2021-05-26T16:43:28.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:28.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 >> v1:172.21.15.3:6790/0 conn(0x7f97d0099a30 legacy=0x7f97d00936e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:28.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 shutdown_connections 2021-05-26T16:43:28.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 >> 172.21.15.3:0/1147773771 conn(0x7f97d00a00c0 msgr2=0x7f97d012b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:28.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 shutdown_connections 2021-05-26T16:43:28.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:28.032+0000 7f97d4992700 1 -- 172.21.15.3:0/1147773771 wait complete. 2021-05-26T16:43:28.051 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.052 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.052 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2039570825}) 2021-05-26T16:43:28.052 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.052 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.053 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2658660770}) 2021-05-26T16:43:28.053 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.053 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.053 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1480971050}) 2021-05-26T16:43:28.053 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.054 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.054 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=246439384}) 2021-05-26T16:43:28.054 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.054 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.055 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3178214775}) 2021-05-26T16:43:28.055 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.055 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.055 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3374138531}) 2021-05-26T16:43:28.056 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.056 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.056 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1871249589}) 2021-05-26T16:43:28.056 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.056 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169254257}) 2021-05-26T16:43:28.057 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.033+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=627973523}) 2021-05-26T16:43:28.057 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.057 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.057 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=35,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=3807172305,mdsmap=1531151339,mgr=2928577311,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=4093668243,mon_config_key=2930251686,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=2081061156}) 2021-05-26T16:43:28.058 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.058 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.058 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=38,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=3,monmap=2,osd_metadata=5,osd_pg_creating=1,osdmap=28} crc {logm=2717610021,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=4093668243,mon_config_key=28388069,monmap=82091487,osd_metadata=1096450327,osd_pg_creating=1975979722,osdmap=2946960717}) 2021-05-26T16:43:28.058 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.058 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.059 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=36,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=9,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=31} crc {logm=2548988902,mdsmap=3140514009,mgr=2631599771,mgr_command_descs=2322758115,mgrstat=2221525103,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=3420596657}) 2021-05-26T16:43:28.059 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.059 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.059 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=40,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=23} crc {logm=1260033512,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=4093668243,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1528121313}) 2021-05-26T16:43:28.059 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=39,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=3,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=26} crc {logm=128227187,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=4093668243,mon_config_key=1776565380,monmap=3140514009,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=3338631081}) 2021-05-26T16:43:28.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.061 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=40,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=25} crc {logm=1260033512,mdsmap=3140514009,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2808553540,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=284237661}) 2021-05-26T16:43:28.061 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.061 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.061 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=39,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=11,mon_config_key=3,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=26} crc {logm=3713448027,mdsmap=1531151339,mgr=2631599771,mgr_metadata=3215074340,mgrstat=2620047629,mon_config_key=1776565380,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=64227527}) 2021-05-26T16:43:28.061 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.062 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=2351592126,mdsmap=1531151339,mgr=144465734,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2338225398,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=1975979722,osdmap=1402947996}) 2021-05-26T16:43:28.062 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.036+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=38,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=26} crc {logm=548513614,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=4093668243,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1096450327,osd_pg_creating=1975979722,osdmap=64227527}) 2021-05-26T16:43:28.062 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.062 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.062 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1594237249}) 2021-05-26T16:43:28.063 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.063 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.063 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3984057418}) 2021-05-26T16:43:28.063 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.063 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.064 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3682266759}) 2021-05-26T16:43:28.064 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.064 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.064 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2583649098}) 2021-05-26T16:43:28.065 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.065 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.065 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=825034429}) 2021-05-26T16:43:28.065 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.065 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.066 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3278864949}) 2021-05-26T16:43:28.066 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.066 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.066 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=781533225}) 2021-05-26T16:43:28.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2230123814}) 2021-05-26T16:43:28.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.038+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3794241537}) 2021-05-26T16:43:28.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.068 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=43} crc {osdmap=3634758601}) 2021-05-26T16:43:28.068 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.068 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.068 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=44} crc {osdmap=3944921981}) 2021-05-26T16:43:28.068 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.069 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.069 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=46} crc {osdmap=4033589577}) 2021-05-26T16:43:28.069 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.069 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.070 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=44} crc {osdmap=1411264232}) 2021-05-26T16:43:28.070 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.070 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.070 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=45} crc {osdmap=997789553}) 2021-05-26T16:43:28.071 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.071 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.071 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=46} crc {osdmap=3277814429}) 2021-05-26T16:43:28.071 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.071 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.072 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=45} crc {osdmap=3921717305}) 2021-05-26T16:43:28.072 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:43:28.072 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1124874261}) 2021-05-26T16:43:28.072 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:43:28.043+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=44} crc {osdmap=3706591228}) 2021-05-26T16:43:28.073 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-05-26T16:43:28.287 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:28.287 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34761]: starting. 2021-05-26T16:43:28.288 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34761]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34666 2021-05-26T16:43:28.288 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34761]: created object 0... 2021-05-26T16:43:28.288 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34761]: created object 25... 2021-05-26T16:43:28.288 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34761]: created object 49... 2021-05-26T16:43:28.289 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34761]: finishing. 2021-05-26T16:43:28.289 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34761]: shutting down. 2021-05-26T16:43:28.326 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:28.326 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34763]: starting. 2021-05-26T16:43:28.326 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34763]: listing objects. 2021-05-26T16:43:28.327 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34763]: listed object 0... 2021-05-26T16:43:28.327 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34763]: listed object 25... 2021-05-26T16:43:28.327 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34763]: saw 50 objects 2021-05-26T16:43:28.327 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34763]: shutting down. 2021-05-26T16:43:29.075 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2021-05-26T16:43:29.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:43:29.199 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:29.199 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34762]: starting. 2021-05-26T16:43:29.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34762]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34666 2021-05-26T16:43:29.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34762]: shutting down. 2021-05-26T16:43:29.200 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:29.201 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:29.201 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:43:29.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:43:29.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.210+0000 7f2c69ebc700 10 monclient: get_monmap_and_config 2021-05-26T16:43:29.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.210+0000 7f2c69ebc700 10 monclient: build_initial_monmap 2021-05-26T16:43:29.213 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.210+0000 7f2c69ebc700 10 monclient: monmap: 2021-05-26T16:43:29.213 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:29.213 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.214 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:29.211506+0000 2021-05-26T16:43:29.214 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:29.211506+0000 2021-05-26T16:43:29.214 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:29.214 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.215 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:29.215 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:29.215 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:29.215 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:29.216 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:29.216 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:29.216 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:29.216 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:29.216 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:29.217 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.211+0000 7f2c69ebc700 1 Processor -- start 2021-05-26T16:43:29.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.211+0000 7f2c69ebc700 1 -- start start 2021-05-26T16:43:29.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.211+0000 7f2c69ebc700 10 monclient: init 2021-05-26T16:43:29.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:29.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 10 monclient: _add_conns ranks=[8,0,5,6,1,3,4,7,2] 2021-05-26T16:43:29.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 10 monclient(hunting): picked mon.noname-e con 0x7f2c64096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:29.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 10 monclient(hunting): picked mon.noname-a con 0x7f2c64099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:29.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 10 monclient(hunting): picked mon.noname-h con 0x7f2c6409a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:29.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c64059750 con 0x7f2c64099db0 2021-05-26T16:43:29.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c64064620 con 0x7f2c6409a260 2021-05-26T16:43:29.229 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c64064e50 con 0x7f2c64096ca0 2021-05-26T16:43:29.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:29.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c69ebc700 10 monclient(hunting): authenticate will time out at 966.843295s 2021-05-26T16:43:29.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c62ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2c64099db0 0x7f2c64132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52374/0 (socket says 172.21.15.3:52374) 2021-05-26T16:43:29.230 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c637fe700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f2c64096ca0 0x7f2c64063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53454/0 (socket says 172.21.15.3:53454) 2021-05-26T16:43:29.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.212+0000 7f2c62ffd700 1 -- 172.21.15.3:0/3599793395 learned_addr learned my addr 172.21.15.3:0/3599793395 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:29.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c637fe700 1 -- 172.21.15.3:0/3599793395 >> v1:172.21.15.3:6793/0 conn(0x7f2c64096ca0 legacy=0x7f2c64063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c62ffd700 1 -- 172.21.15.3:0/3599793395 >> v1:172.21.15.3:6789/0 conn(0x7f2c64099db0 legacy=0x7f2c64132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c63fff700 1 -- 172.21.15.3:0/3599793395 >> v1:172.21.15.137:6791/0 conn(0x7f2c6409a260 legacy=0x7f2c641357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.231 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891293281 0 0) 0x7f2c64064e50 con 0x7f2c64096ca0 2021-05-26T16:43:29.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 10 monclient(hunting): my global_id is 104228 2021-05-26T16:43:29.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c50003270 con 0x7f2c64096ca0 2021-05-26T16:43:29.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206692538 0 0) 0x7f2c64059750 con 0x7f2c64099db0 2021-05-26T16:43:29.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 10 monclient(hunting): my global_id is 104202 2021-05-26T16:43:29.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c64064e50 con 0x7f2c64099db0 2021-05-26T16:43:29.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.214+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809242062 0 0) 0x7f2c64064620 con 0x7f2c6409a260 2021-05-26T16:43:29.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.234 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient(hunting): my global_id is 5108 2021-05-26T16:43:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c64059750 con 0x7f2c6409a260 2021-05-26T16:43:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1621327782 0 0) 0x7f2c64064e50 con 0x7f2c64099db0 2021-05-26T16:43:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 >> v1:172.21.15.3:6793/0 conn(0x7f2c64096ca0 legacy=0x7f2c64063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 >> v1:172.21.15.137:6791/0 conn(0x7f2c6409a260 legacy=0x7f2c641357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:29.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 monclient: found mon.noname-a 2021-05-26T16:43:29.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:29.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:43:29.236 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6409c390 con 0x7f2c64099db0 2021-05-26T16:43:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2c4c001a50 con 0x7f2c64099db0 2021-05-26T16:43:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 5 monclient: authenticate success, global_id 104202 2021-05-26T16:43:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:29.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:29.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: dump: 2021-05-26T16:43:29.238 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.239 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.239 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.239 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.239 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.239 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.240 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.240 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.240 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.240 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.240 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.241 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.241 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.241 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.241 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.242 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:29.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2c4c001d60 con 0x7f2c64099db0 2021-05-26T16:43:29.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:29.242 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:29.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 1 -- 172.21.15.3:0/3599793395 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2c4c004930 con 0x7f2c64099db0 2021-05-26T16:43:29.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 4 set_mon_vals no callback set 2021-05-26T16:43:29.243 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:29.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c627fc700 10 monclient: dump: 2021-05-26T16:43:29.244 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.244 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.244 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.244 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.245 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.245 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.245 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.245 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.247 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.247 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.247 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 10 monclient: shutdown 2021-05-26T16:43:29.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:29.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 1 -- 172.21.15.3:0/3599793395 >> v1:172.21.15.3:6789/0 conn(0x7f2c64099db0 legacy=0x7f2c64132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 1 -- 172.21.15.3:0/3599793395 shutdown_connections 2021-05-26T16:43:29.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 1 -- 172.21.15.3:0/3599793395 >> 172.21.15.3:0/3599793395 conn(0x7f2c6409cc00 msgr2=0x7f2c6409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:29.249 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 1 -- 172.21.15.3:0/3599793395 shutdown_connections 2021-05-26T16:43:29.249 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.215+0000 7f2c69ebc700 1 -- 172.21.15.3:0/3599793395 wait complete. 2021-05-26T16:43:29.249 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.216+0000 7f2c69ebc700 10 monclient: build_initial_monmap 2021-05-26T16:43:29.249 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.216+0000 7f2c69ebc700 10 monclient: monmap: 2021-05-26T16:43:29.250 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:29.250 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:29.250 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:29.250 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:29.250 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:29.251 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.251 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:29.251 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:29.251 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:29.251 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:29.252 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:29.252 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:29.252 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:29.252 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:29.253 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:29.253 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.216+0000 7f2c69ebc700 1 Processor -- start 2021-05-26T16:43:29.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.216+0000 7f2c69ebc700 1 -- start start 2021-05-26T16:43:29.253 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.216+0000 7f2c69ebc700 10 monclient: init 2021-05-26T16:43:29.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:29.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 10 monclient: _add_conns ranks=[4,6,2,8,5,0,1,7,3] 2021-05-26T16:43:29.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 10 monclient(hunting): picked mon.noname-c con 0x7f2c64096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:29.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 10 monclient(hunting): picked mon.noname-d con 0x7f2c64099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:29.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 10 monclient(hunting): picked mon.noname-b con 0x7f2c6409a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6411cc30 con 0x7f2c6409a260 2021-05-26T16:43:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6411ced0 con 0x7f2c64096ca0 2021-05-26T16:43:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6411d170 con 0x7f2c64099db0 2021-05-26T16:43:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c69ebc700 10 monclient(hunting): authenticate will time out at 966.848371s 2021-05-26T16:43:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c637fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f2c64096ca0 0x7f2c64119450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37892/0 (socket says 172.21.15.3:37892) 2021-05-26T16:43:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.217+0000 7f2c637fe700 1 -- 172.21.15.3:0/1091940230 learned_addr learned my addr 172.21.15.3:0/1091940230 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c62ffd700 1 -- 172.21.15.3:0/1091940230 >> v1:172.21.15.3:6792/0 conn(0x7f2c64099db0 legacy=0x7f2c64119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c637fe700 1 -- 172.21.15.3:0/1091940230 >> v1:172.21.15.3:6791/0 conn(0x7f2c64096ca0 legacy=0x7f2c64119450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c63fff700 1 -- 172.21.15.3:0/1091940230 >> v1:172.21.15.3:6790/0 conn(0x7f2c6409a260 legacy=0x7f2c64143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135000355 0 0) 0x7f2c6411d170 con 0x7f2c64099db0 2021-05-26T16:43:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): my global_id is 4947 2021-05-26T16:43:29.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c44003270 con 0x7f2c64099db0 2021-05-26T16:43:29.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413773924 0 0) 0x7f2c6411ced0 con 0x7f2c64096ca0 2021-05-26T16:43:29.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): my global_id is 5053 2021-05-26T16:43:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6411d170 con 0x7f2c64096ca0 2021-05-26T16:43:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387971858 0 0) 0x7f2c6411cc30 con 0x7f2c6409a260 2021-05-26T16:43:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 10 monclient(hunting): my global_id is 5015 2021-05-26T16:43:29.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.219+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6411ced0 con 0x7f2c6409a260 2021-05-26T16:43:29.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2917796636 0 0) 0x7f2c44003270 con 0x7f2c64099db0 2021-05-26T16:43:29.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c6411cc30 con 0x7f2c64099db0 2021-05-26T16:43:29.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 755313114 0 0) 0x7f2c6411d170 con 0x7f2c64096ca0 2021-05-26T16:43:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c44003270 con 0x7f2c64096ca0 2021-05-26T16:43:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2c58001d90 con 0x7f2c64096ca0 2021-05-26T16:43:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:43:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): dump: 2021-05-26T16:43:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.263 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.263 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.263 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.263 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.263 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.265 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2c4c004870 con 0x7f2c64099db0 2021-05-26T16:43:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): dump: 2021-05-26T16:43:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.267 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.267 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.267 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.267 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.267 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.268 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.268 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.268 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.268 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.268 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.269 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.269 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.269 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.269 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.269 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1125370444 0 0) 0x7f2c6411ced0 con 0x7f2c6409a260 2021-05-26T16:43:29.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c6411d170 con 0x7f2c6409a260 2021-05-26T16:43:29.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2c54002080 con 0x7f2c6409a260 2021-05-26T16:43:29.270 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:29.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient(hunting): dump: 2021-05-26T16:43:29.271 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.271 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.271 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.272 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.272 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.272 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.272 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.273 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.273 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.273 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.273 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.273 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.274 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.274 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.274 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.274 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1870981476 0 0) 0x7f2c6411cc30 con 0x7f2c64099db0 2021-05-26T16:43:29.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 >> v1:172.21.15.3:6791/0 conn(0x7f2c64096ca0 legacy=0x7f2c64119450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 >> v1:172.21.15.3:6790/0 conn(0x7f2c6409a260 legacy=0x7f2c64143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient: _finish_hunting 0 2021-05-26T16:43:29.275 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 monclient: found mon.d 2021-05-26T16:43:29.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:29.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:29.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6411b000 con 0x7f2c64099db0 2021-05-26T16:43:29.276 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient: _finish_auth 0 2021-05-26T16:43:29.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:29.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c69ebc700 5 monclient: authenticate success, global_id 4947 2021-05-26T16:43:29.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c69ebc700 10 monclient: _renew_subs 2021-05-26T16:43:29.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c69ebc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:29.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6411bca0 con 0x7f2c64099db0 2021-05-26T16:43:29.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c69ebc700 10 monclient: _renew_subs 2021-05-26T16:43:29.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c69ebc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:29.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6411d6f0 con 0x7f2c64099db0 2021-05-26T16:43:29.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2c4c001a40 con 0x7f2c64099db0 2021-05-26T16:43:29.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:29.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f2c4c0051e0 con 0x7f2c64099db0 2021-05-26T16:43:29.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c61ffb700 4 set_mon_vals no callback set 2021-05-26T16:43:29.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:29.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.220+0000 7f2c4b7fe700 10 monclient: dump: 2021-05-26T16:43:29.280 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.280 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.280 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.280 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.281 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.281 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.281 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.281 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.282 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.282 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.282 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.282 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.282 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.283 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.283 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.283 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.221+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f2c4c00e750 con 0x7f2c64099db0 2021-05-26T16:43:29.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.221+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(112..112 src has 1..112) v4 ==== 3549+0+0 (unknown 3556148005 0 0) 0x7f2c4c03d9b0 con 0x7f2c64099db0 2021-05-26T16:43:29.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.221+0000 7f2c69ebc700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:29.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.221+0000 7f2c69ebc700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:29.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.221+0000 7f2c69ebc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:29.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.221+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c004db0 con 0x7f2c64099db0 2021-05-26T16:43:29.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.221+0000 7f2c637fe700 10 monclient: get_auth_request con 0x7f2c440333d0 auth_method 0 2021-05-26T16:43:29.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.226+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f2c4c013750 con 0x7f2c64099db0 2021-05-26T16:43:29.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.226+0000 7f2c4b7fe700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:29.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.226+0000 7f2c4b7fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.445+0000 7f2c69ebc700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:43:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.445+0000 7f2c69ebc700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:43:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.445+0000 7f2c69ebc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.445+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2c3c0055e0 con 0x7f2c64099db0 2021-05-26T16:43:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.445+0000 7f2c4b7fe700 1 -- 172.21.15.3:0/1091940230 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2644 (unknown 254746657 0 722167129) 0x7f2c4c013340 con 0x7f2c64099db0 2021-05-26T16:43:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.445+0000 7f2c4b7fe700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:43:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.445+0000 7f2c4b7fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:29.449 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":16,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:43:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 >> v1:172.21.15.137:6812/30003 conn(0x7f2c440333d0 legacy=0x7f2c44035890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 10 monclient: shutdown 2021-05-26T16:43:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 >> v1:172.21.15.3:6792/0 conn(0x7f2c64099db0 legacy=0x7f2c64119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 shutdown_connections 2021-05-26T16:43:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 >> 172.21.15.3:0/1091940230 conn(0x7f2c6409cc00 msgr2=0x7f2c64097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 shutdown_connections 2021-05-26T16:43:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.447+0000 7f2c69ebc700 1 -- 172.21.15.3:0/1091940230 wait complete. 2021-05-26T16:43:29.461 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2021-05-26T16:43:29.461 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-05-26T16:43:29.461 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-05-26T16:43:29.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.574+0000 7f29bd311700 10 monclient: get_monmap_and_config 2021-05-26T16:43:29.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.574+0000 7f29bd311700 10 monclient: build_initial_monmap 2021-05-26T16:43:29.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.574+0000 7f29bd311700 10 monclient: monmap: 2021-05-26T16:43:29.578 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:29.578 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.578 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:29.575462+0000 2021-05-26T16:43:29.579 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:29.575462+0000 2021-05-26T16:43:29.579 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:29.579 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.579 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:29.579 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 1 Processor -- start 2021-05-26T16:43:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 1 -- start start 2021-05-26T16:43:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient: init 2021-05-26T16:43:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient: _add_conns ranks=[8,0,1,6,2,5,3,4,7] 2021-05-26T16:43:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient(hunting): picked mon.noname-e con 0x7f29b8096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient(hunting): picked mon.noname-a con 0x7f29b8099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient(hunting): picked mon.noname-f con 0x7f29b809a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b8059750 con 0x7f29b8099db0 2021-05-26T16:43:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b8064620 con 0x7f29b809a260 2021-05-26T16:43:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b8064e50 con 0x7f29b8096ca0 2021-05-26T16:43:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.575+0000 7f29bd311700 10 monclient(hunting): authenticate will time out at 967.206958s 2021-05-26T16:43:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.576+0000 7f29b6ffd700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f29b8096ca0 0x7f29b8063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53470/0 (socket says 172.21.15.3:53470) 2021-05-26T16:43:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.576+0000 7f29b6ffd700 1 -- 172.21.15.3:0/2795258632 learned_addr learned my addr 172.21.15.3:0/2795258632 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.576+0000 7f29b67fc700 1 --1- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29b8099db0 0x7f29b8132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52388/0 (socket says 172.21.15.3:52388) 2021-05-26T16:43:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b6ffd700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6793/0 conn(0x7f29b8096ca0 legacy=0x7f29b8063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b67fc700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29b8099db0 legacy=0x7f29b8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801451042 0 0) 0x7f29b8059750 con 0x7f29b8099db0 2021-05-26T16:43:29.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient(hunting): my global_id is 104220 2021-05-26T16:43:29.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a4003270 con 0x7f29b8099db0 2021-05-26T16:43:29.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681934781 0 0) 0x7f29b8064e50 con 0x7f29b8096ca0 2021-05-26T16:43:29.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:29.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient(hunting): my global_id is 104246 2021-05-26T16:43:29.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8059750 con 0x7f29b8096ca0 2021-05-26T16:43:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b77fe700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.137:6789/0 conn(0x7f29b809a260 legacy=0x7f29b81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537040282 0 0) 0x7f29a4003270 con 0x7f29b8099db0 2021-05-26T16:43:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6793/0 conn(0x7f29b8096ca0 legacy=0x7f29b8063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.137:6789/0 conn(0x7f29b809a260 legacy=0x7f29b81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 monclient: found mon.noname-a 2021-05-26T16:43:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:43:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b809c390 con 0x7f29b8099db0 2021-05-26T16:43:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29bd311700 5 monclient: authenticate success, global_id 104220 2021-05-26T16:43:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29ac001980 con 0x7f29b8099db0 2021-05-26T16:43:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: dump: 2021-05-26T16:43:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.600 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.600 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.600 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.600 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.600 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.601 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29bd311700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:29.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b67fc700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29b8099db0 legacy=0x7f29b8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2021-05-26T16:43:29.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b67fc700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29b8099db0 legacy=0x7f29b8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:43:29.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b67fc700 1 --1- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29b8099db0 0x7f29b8132080 :-1 s=OPENED pgs=156 cs=1 l=1).handle_message read tag failed 2021-05-26T16:43:29.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b67fc700 1 --1- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29b8099db0 0x7f29b8132080 :-1 s=OPENED pgs=156 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:43:29.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: ms_handle_reset current mon v1:172.21.15.3:6789/0 2021-05-26T16:43:29.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:29.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29b8099db0 legacy=0x7f29b8132080 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:29.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient: _add_conns ranks=[3,0,1,7,4,8,2,5,6] 2021-05-26T16:43:29.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.578+0000 7f29b5ffb700 10 monclient(hunting): picked mon.g con 0x7f29a40034b0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:29.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.579+0000 7f29b5ffb700 10 monclient(hunting): picked mon.a con 0x7f29a4003fa0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:29.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.579+0000 7f29b5ffb700 10 monclient(hunting): picked mon.f con 0x7f29b809a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:29.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.579+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f29a4003270 con 0x7f29a4003fa0 2021-05-26T16:43:29.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.579+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f29b8059750 con 0x7f29b809a260 2021-05-26T16:43:29.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.579+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f29b8064e50 con 0x7f29a40034b0 2021-05-26T16:43:29.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.579+0000 7f29b5ffb700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:29.605 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.579+0000 7f29b5ffb700 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.3:6789/0 2021-05-26T16:43:29.606 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b67fc700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29a4003fa0 legacy=0x7f29a400a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.606 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021846678 0 0) 0x7f29a4003270 con 0x7f29a4003fa0 2021-05-26T16:43:29.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:29.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient(hunting): _init_auth already have auth, reseting 2021-05-26T16:43:29.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.3:6789/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f29a400f790 con 0x7f29a4003fa0 2021-05-26T16:43:29.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b77fe700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.137:6789/0 conn(0x7f29b809a260 legacy=0x7f29a400de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b6ffd700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.137:6790/0 conn(0x7f29a40034b0 legacy=0x7f29a4003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:29.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b67fc700 1 --1- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29a4003fa0 0x7f29a400a760 :-1 s=OPENED pgs=157 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7f29a400f790 auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:43:29.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (unknown 3880367581 0 0) 0x7f29a400f790 con 0x7f29a4003fa0 2021-05-26T16:43:29.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.137:6790/0 conn(0x7f29a40034b0 legacy=0x7f29a4003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.137:6789/0 conn(0x7f29b809a260 legacy=0x7f29a400de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:29.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:29.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 monclient: found mon.a 2021-05-26T16:43:29.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:29.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:29.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=2+}) v3 -- 0x7f29a4012900 con 0x7f29a4003fa0 2021-05-26T16:43:29.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:29.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:29.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29ac004ab0 con 0x7f29a4003fa0 2021-05-26T16:43:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29b5ffb700 10 monclient: dump: 2021-05-26T16:43:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:29.615 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.615 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:29.615 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:29.615 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:29.615 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:29.616 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:29.616 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:29.616 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:29.616 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:29.617 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:29.581+0000 7f29bd311700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:30.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.409+0000 7f29b5ffb700 1 -- 172.21.15.3:0/2795258632 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f29ac004d10 con 0x7f29a4003fa0 2021-05-26T16:43:30.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.409+0000 7f29b5ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:30.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.409+0000 7f29bd311700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:30.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.409+0000 7f29bd311700 4 set_mon_vals no callback set 2021-05-26T16:43:30.415 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.410+0000 7f29bd311700 10 monclient: shutdown 2021-05-26T16:43:30.415 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.410+0000 7f29bd311700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:30.415 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.410+0000 7f29bd311700 1 -- 172.21.15.3:0/2795258632 >> v1:172.21.15.3:6789/0 conn(0x7f29a4003fa0 legacy=0x7f29a400a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.416 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.410+0000 7f29bd311700 1 -- 172.21.15.3:0/2795258632 shutdown_connections 2021-05-26T16:43:30.416 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.410+0000 7f29bd311700 1 -- 172.21.15.3:0/2795258632 >> 172.21.15.3:0/2795258632 conn(0x7f29b809cc00 msgr2=0x7f29b809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:30.416 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.410+0000 7f29bd311700 1 -- 172.21.15.3:0/2795258632 shutdown_connections 2021-05-26T16:43:30.416 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.410+0000 7f29bd311700 1 -- 172.21.15.3:0/2795258632 wait complete. 2021-05-26T16:43:30.417 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.411+0000 7f29bd311700 10 monclient: build_initial_monmap 2021-05-26T16:43:30.417 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.411+0000 7f29bd311700 10 monclient: monmap: 2021-05-26T16:43:30.417 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:30.417 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:30.417 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:30.418 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:30.418 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:30.418 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.418 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:30.420 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:30.420 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:30.420 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:30.420 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 1 Processor -- start 2021-05-26T16:43:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 1 -- start start 2021-05-26T16:43:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient: init 2021-05-26T16:43:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient: _add_conns ranks=[3,4,7,6,2,5,0,1,8] 2021-05-26T16:43:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient(hunting): picked mon.noname-g con 0x7f29a40034b0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient(hunting): picked mon.noname-c con 0x7f29a4003fa0 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient(hunting): picked mon.noname-i con 0x7f29b8096ca0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b809bfb0 con 0x7f29a40034b0 2021-05-26T16:43:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b8118780 con 0x7f29a4003fa0 2021-05-26T16:43:30.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b8118a20 con 0x7f29b8096ca0 2021-05-26T16:43:30.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:30.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.412+0000 7f29bd311700 10 monclient(hunting): authenticate will time out at 968.043933s 2021-05-26T16:43:30.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.413+0000 7f29b67fc700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f29a4003fa0 0x7f29b8138590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37914/0 (socket says 172.21.15.3:37914) 2021-05-26T16:43:30.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.413+0000 7f29b67fc700 1 -- 172.21.15.3:0/2493491929 learned_addr learned my addr 172.21.15.3:0/2493491929 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:30.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f29b67fc700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6791/0 conn(0x7f29a4003fa0 legacy=0x7f29b8138590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f29b6ffd700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.137:6790/0 conn(0x7f29a40034b0 legacy=0x7f29b8129fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156378972 0 0) 0x7f29b8118780 con 0x7f29a4003fa0 2021-05-26T16:43:30.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): my global_id is 5071 2021-05-26T16:43:30.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f29b77fe700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.137:6792/0 conn(0x7f29b8096ca0 legacy=0x7f29b8143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2998003270 con 0x7f29a4003fa0 2021-05-26T16:43:30.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374212756 0 0) 0x7f29b809bfb0 con 0x7f29a40034b0 2021-05-26T16:43:30.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): my global_id is 4998 2021-05-26T16:43:30.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8118780 con 0x7f29a40034b0 2021-05-26T16:43:30.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840401735 0 0) 0x7f29b8118a20 con 0x7f29b8096ca0 2021-05-26T16:43:30.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): my global_id is 104173 2021-05-26T16:43:30.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b809bfb0 con 0x7f29b8096ca0 2021-05-26T16:43:30.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 548457181 0 0) 0x7f2998003270 con 0x7f29a4003fa0 2021-05-26T16:43:30.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29b8118a20 con 0x7f29a4003fa0 2021-05-26T16:43:30.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29ac001780 con 0x7f29a4003fa0 2021-05-26T16:43:30.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:43:30.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): dump: 2021-05-26T16:43:30.435 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.435 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.436 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.436 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.436 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.436 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.437 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.437 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.437 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.437 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.437 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.438 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.438 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.438 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.438 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.438 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.415+0000 7f299effd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:30.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2868417514 0 0) 0x7f29b8118780 con 0x7f29a40034b0 2021-05-26T16:43:30.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2998003270 con 0x7f29a40034b0 2021-05-26T16:43:30.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3893325653 0 0) 0x7f29b809bfb0 con 0x7f29b8096ca0 2021-05-26T16:43:30.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29b8118780 con 0x7f29b8096ca0 2021-05-26T16:43:30.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29a0001d90 con 0x7f29a40034b0 2021-05-26T16:43:30.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:30.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient(hunting): dump: 2021-05-26T16:43:30.441 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.441 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.441 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.441 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.441 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.444 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4141279089 0 0) 0x7f29b8118a20 con 0x7f29a4003fa0 2021-05-26T16:43:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.137:6792/0 conn(0x7f29b8096ca0 legacy=0x7f29b8143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.137:6790/0 conn(0x7f29a40034b0 legacy=0x7f29b8129fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:30.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 monclient: found mon.c 2021-05-26T16:43:30.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:30.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:30.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b812a6e0 con 0x7f29a4003fa0 2021-05-26T16:43:30.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient: _finish_auth 0 2021-05-26T16:43:30.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:30.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29bd311700 5 monclient: authenticate success, global_id 5071 2021-05-26T16:43:30.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29bd311700 10 monclient: _renew_subs 2021-05-26T16:43:30.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29bd311700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:30.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b8138ca0 con 0x7f29a4003fa0 2021-05-26T16:43:30.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29bd311700 10 monclient: _renew_subs 2021-05-26T16:43:30.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29bd311700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:30.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b8117550 con 0x7f29a4003fa0 2021-05-26T16:43:30.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f29ac004f90 con 0x7f29a4003fa0 2021-05-26T16:43:30.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:30.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29ac005440 con 0x7f29a4003fa0 2021-05-26T16:43:30.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f29b57fa700 4 set_mon_vals no callback set 2021-05-26T16:43:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.416+0000 7f299effd700 10 monclient: dump: 2021-05-26T16:43:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.453 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.453 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.417+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f29ac00e9b0 con 0x7f29a4003fa0 2021-05-26T16:43:30.453 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.417+0000 7f29bd311700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:30.453 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.417+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f29900065a0 con 0x7f2990002840 2021-05-26T16:43:30.453 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.417+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(113..113 src has 1..113) v4 ==== 3941+0+0 (unknown 1850034729 0 0) 0x7f29ac03dce0 con 0x7f29a4003fa0 2021-05-26T16:43:30.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.417+0000 7f29b6ffd700 10 monclient: get_auth_request con 0x7f2998033380 auth_method 0 2021-05-26T16:43:30.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.419+0000 7f29b77fe700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6789/0 conn(0x7f2990002840 legacy=0x7f2990004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68013683 0 0) 0x7f29900065a0 con 0x7f2990002840 2021-05-26T16:43:30.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 10 monclient(hunting): my global_id is 104229 2021-05-26T16:43:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8118a20 con 0x7f2990002840 2021-05-26T16:43:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4094752751 0 0) 0x7f29b8118a20 con 0x7f2990002840 2021-05-26T16:43:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29900065a0 con 0x7f2990002840 2021-05-26T16:43:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29a80027b0 con 0x7f2990002840 2021-05-26T16:43:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 10 monclient: dump: 2021-05-26T16:43:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.458 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.458 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.458 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.458 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.458 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.459 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.459 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.459 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.459 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.459 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.460 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4022594291 0 0) 0x7f29900065a0 con 0x7f2990002840 2021-05-26T16:43:30.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.420+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2990009e40 con 0x7f2990002840 2021-05-26T16:43:30.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.421+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f29a8005890 con 0x7f2990002840 2021-05-26T16:43:30.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.421+0000 7f299effd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:30.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.421+0000 7f299effd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:30.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.421+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6789/0 conn(0x7f2990002840 legacy=0x7f2990004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.421+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6789/0 conn(0x7f2990002840 legacy=0x7f2990004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.428+0000 7f29bd311700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.428+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2990009ad0 con 0x7f2990008d90 2021-05-26T16:43:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f29b77fe700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6789/0 conn(0x7f2990008d90 legacy=0x7f2990009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603365724 0 0) 0x7f2990009ad0 con 0x7f2990008d90 2021-05-26T16:43:30.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 10 monclient(hunting): my global_id is 104238 2021-05-26T16:43:30.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29900065a0 con 0x7f2990008d90 2021-05-26T16:43:30.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3455295605 0 0) 0x7f29900065a0 con 0x7f2990008d90 2021-05-26T16:43:30.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2990009ad0 con 0x7f2990008d90 2021-05-26T16:43:30.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29a8003070 con 0x7f2990008d90 2021-05-26T16:43:30.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 10 monclient: dump: 2021-05-26T16:43:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.469 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4242162798 0 0) 0x7f2990009ad0 con 0x7f2990008d90 2021-05-26T16:43:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.431+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 --> v1:172.21.15.3:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2990008740 con 0x7f2990008d90 2021-05-26T16:43:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7324 (unknown 0 0 2945236857) 0x7f29a8007bc0 con 0x7f2990008d90 2021-05-26T16:43:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f299effd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f299effd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6789/0 conn(0x7f2990008d90 legacy=0x7f2990009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f299effd700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6789/0 conn(0x7f2990008d90 legacy=0x7f2990009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:30.471 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:30.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:30.472 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:30.472 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "leader", 2021-05-26T16:43:30.472 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:30.472 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:30.473 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:30.473 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:30.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:30.473 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:30.474 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:30.474 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:30.474 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:30.474 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:30.474 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:30.475 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.475 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 5, 2021-05-26T16:43:30.475 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:30.475 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:30.476 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:30.476 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:30.476 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:30.476 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:30.476 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:30.477 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:30.477 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:30.477 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:30.477 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:30.478 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:30.478 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.478 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:30.478 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:30.478 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:30.479 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:30.479 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:30.479 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:30.479 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:30.480 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:30.480 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:30.480 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:30.480 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:30.480 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:30.482 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:30.482 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:30.482 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:30.482 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:30.483 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:30.483 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:30.483 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:30.483 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:30.483 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:30.484 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:30.484 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:30.484 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:30.484 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:30.485 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:30.485 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:30.485 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:30.485 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:30.485 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:30.486 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:30.486 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:30.486 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.486 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:30.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.488 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.488 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.488 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.488 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:30.489 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.489 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.489 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.489 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:30.490 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:30.490 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.490 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.490 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.491 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.491 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:30.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:30.491 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.492 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.492 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.492 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.492 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:30.492 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.493 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.493 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.493 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:30.494 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:30.494 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.494 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.494 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.495 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.495 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:30.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:30.495 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.495 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.496 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.496 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.496 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:30.496 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.497 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.497 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.497 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:30.497 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:30.498 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.498 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.498 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.498 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.499 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:30.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:30.499 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.499 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:30.502 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.502 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.502 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.502 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.504 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.504 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.504 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:30.504 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.504 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.505 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.505 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:30.505 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:30.506 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.506 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.506 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.506 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.507 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:30.507 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:30.507 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.507 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.508 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.508 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.508 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:30.508 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.508 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.509 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.509 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:30.509 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:30.509 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.510 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.510 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.510 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.511 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:30.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:30.511 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.511 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.511 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.512 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.512 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:30.512 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.512 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.512 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.513 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:30.513 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:30.513 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.514 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.514 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.514 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.514 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:30.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:30.515 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.515 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.515 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.515 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.516 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:30.516 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.516 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.516 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.517 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:30.517 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:30.517 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.517 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.518 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.518 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.518 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:30.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:30.519 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.519 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.519 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.519 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.519 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:30.520 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.520 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.520 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.521 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:30.521 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:30.521 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.521 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.521 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.522 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.522 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.522 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:30.523 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:30.523 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.523 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:30.523 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:30.523 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:30.524 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.524 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.524 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:30.524 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.524 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:30.525 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:30.525 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:30.525 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.525 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.526 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:30.526 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:30.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.137:6812/30003 conn(0x7f2998033380 legacy=0x7f2998035840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 10 monclient: shutdown 2021-05-26T16:43:30.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:30.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 >> v1:172.21.15.3:6791/0 conn(0x7f29a4003fa0 legacy=0x7f29b8138590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29b77fe700 1 -- 172.21.15.3:0/2493491929 reap_dead start 2021-05-26T16:43:30.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 shutdown_connections 2021-05-26T16:43:30.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 >> 172.21.15.3:0/2493491929 conn(0x7f29b809cc00 msgr2=0x7f29b8099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:30.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 shutdown_connections 2021-05-26T16:43:30.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.432+0000 7f29bd311700 1 -- 172.21.15.3:0/2493491929 wait complete. 2021-05-26T16:43:30.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-05-26T16:43:30.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.658+0000 7faa501f6700 10 monclient: get_monmap_and_config 2021-05-26T16:43:30.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.658+0000 7faa501f6700 10 monclient: build_initial_monmap 2021-05-26T16:43:30.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.658+0000 7faa501f6700 10 monclient: monmap: 2021-05-26T16:43:30.661 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:30.661 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.661 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:30.658807+0000 2021-05-26T16:43:30.662 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:30.658807+0000 2021-05-26T16:43:30.662 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:30.662 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.662 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:30.663 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:30.663 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:30.664 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:30.664 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:30.664 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:30.664 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:30.665 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:30.665 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:30.665 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.658+0000 7faa501f6700 1 Processor -- start 2021-05-26T16:43:30.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.658+0000 7faa501f6700 1 -- start start 2021-05-26T16:43:30.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.658+0000 7faa501f6700 10 monclient: init 2021-05-26T16:43:30.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:30.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 10 monclient: _add_conns ranks=[0,2,7,4,1,3,5,8,6] 2021-05-26T16:43:30.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 10 monclient(hunting): picked mon.noname-a con 0x7faa48064a20 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:30.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 10 monclient(hunting): picked mon.noname-b con 0x7faa48063e30 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 10 monclient(hunting): picked mon.noname-i con 0x7faa480642e0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48059750 con 0x7faa48064a20 2021-05-26T16:43:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48064e00 con 0x7faa48063e30 2021-05-26T16:43:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4809c770 con 0x7faa480642e0 2021-05-26T16:43:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa501f6700 10 monclient(hunting): authenticate will time out at 968.290475s 2021-05-26T16:43:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa4d791700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7faa48063e30 0x7faa48132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54456/0 (socket says 172.21.15.3:54456) 2021-05-26T16:43:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.659+0000 7faa4d791700 1 -- 172.21.15.3:0/4078080676 learned_addr learned my addr 172.21.15.3:0/4078080676 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.661+0000 7faa4d791700 1 -- 172.21.15.3:0/4078080676 >> v1:172.21.15.3:6790/0 conn(0x7faa48063e30 legacy=0x7faa48132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.661+0000 7faa4df92700 1 -- 172.21.15.3:0/4078080676 >> v1:172.21.15.3:6789/0 conn(0x7faa48064a20 legacy=0x7faa48099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.661+0000 7faa4e793700 1 -- 172.21.15.3:0/4078080676 >> v1:172.21.15.137:6792/0 conn(0x7faa480642e0 legacy=0x7faa481357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595303682 0 0) 0x7faa48064e00 con 0x7faa48063e30 2021-05-26T16:43:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): my global_id is 5033 2021-05-26T16:43:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa30003270 con 0x7faa48063e30 2021-05-26T16:43:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173750453 0 0) 0x7faa48059750 con 0x7faa48064a20 2021-05-26T16:43:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): my global_id is 104247 2021-05-26T16:43:30.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48064e00 con 0x7faa48064a20 2021-05-26T16:43:30.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138649633 0 0) 0x7faa4809c770 con 0x7faa480642e0 2021-05-26T16:43:30.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.683 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient(hunting): my global_id is 104182 2021-05-26T16:43:30.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48059750 con 0x7faa480642e0 2021-05-26T16:43:30.684 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98317709 0 0) 0x7faa30003270 con 0x7faa48063e30 2021-05-26T16:43:30.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 >> v1:172.21.15.137:6792/0 conn(0x7faa480642e0 legacy=0x7faa481357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 >> v1:172.21.15.3:6789/0 conn(0x7faa48064a20 legacy=0x7faa48099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: _finish_hunting 0 2021-05-26T16:43:30.685 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 monclient: found mon.noname-b 2021-05-26T16:43:30.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:30.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:30.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480977a0 con 0x7faa48063e30 2021-05-26T16:43:30.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: _finish_auth 0 2021-05-26T16:43:30.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:30.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa38001a60 con 0x7faa48063e30 2021-05-26T16:43:30.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:30.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: dump: 2021-05-26T16:43:30.688 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.688 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.688 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.688 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.688 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.689 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.689 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.689 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.689 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.690 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.690 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.690 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.690 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.690 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.691 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.691 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa501f6700 5 monclient: authenticate success, global_id 5033 2021-05-26T16:43:30.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa501f6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:30.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faa38001d70 con 0x7faa48063e30 2021-05-26T16:43:30.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:30.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa501f6700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:30.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 1 -- 172.21.15.3:0/4078080676 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa38004930 con 0x7faa48063e30 2021-05-26T16:43:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa501f6700 4 set_mon_vals no callback set 2021-05-26T16:43:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa4cf90700 10 monclient: dump: 2021-05-26T16:43:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.694 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.694 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.694 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.697 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.662+0000 7faa501f6700 10 monclient: shutdown 2021-05-26T16:43:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 1 -- 172.21.15.3:0/4078080676 >> v1:172.21.15.3:6790/0 conn(0x7faa48063e30 legacy=0x7faa48132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 1 -- 172.21.15.3:0/4078080676 shutdown_connections 2021-05-26T16:43:30.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 1 -- 172.21.15.3:0/4078080676 >> 172.21.15.3:0/4078080676 conn(0x7faa480a0db0 msgr2=0x7faa4809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:30.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 1 -- 172.21.15.3:0/4078080676 shutdown_connections 2021-05-26T16:43:30.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 1 -- 172.21.15.3:0/4078080676 wait complete. 2021-05-26T16:43:30.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 10 monclient: build_initial_monmap 2021-05-26T16:43:30.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 10 monclient: monmap: 2021-05-26T16:43:30.700 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:30.700 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:30.700 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:30.700 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:30.701 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:30.701 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.701 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:30.702 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:30.702 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:30.702 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:30.702 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:30.702 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:30.703 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:30.703 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:30.703 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:30.703 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.663+0000 7faa501f6700 1 Processor -- start 2021-05-26T16:43:30.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 1 -- start start 2021-05-26T16:43:30.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient: init 2021-05-26T16:43:30.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:30.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient: _add_conns ranks=[3,5,7,6,2,0,1,8,4] 2021-05-26T16:43:30.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient(hunting): picked mon.noname-g con 0x7faa48063e30 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:30.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient(hunting): picked mon.noname-h con 0x7faa480642e0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:30.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient(hunting): picked mon.noname-i con 0x7faa48064a20 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:30.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48116ab0 con 0x7faa48063e30 2021-05-26T16:43:30.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48116d50 con 0x7faa480642e0 2021-05-26T16:43:30.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48116ff0 con 0x7faa48064a20 2021-05-26T16:43:30.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:30.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa501f6700 10 monclient(hunting): authenticate will time out at 968.295467s 2021-05-26T16:43:30.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa4e793700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7faa48064a20 0x7faa48144810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.3:56558/0 (socket says 172.21.15.3:56558) 2021-05-26T16:43:30.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa4e793700 1 -- 172.21.15.3:0/1701320470 learned_addr learned my addr 172.21.15.3:0/1701320470 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:30.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.664+0000 7faa4df92700 1 --1- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6790/0 conn(0x7faa48063e30 0x7faa4813c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.3:34798/0 (socket says 172.21.15.3:34798) 2021-05-26T16:43:30.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.666+0000 7faa4e793700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6792/0 conn(0x7faa48064a20 legacy=0x7faa48144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.708 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.666+0000 7faa4df92700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6790/0 conn(0x7faa48063e30 legacy=0x7faa4813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.666+0000 7faa4d791700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6791/0 conn(0x7faa480642e0 legacy=0x7faa481410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869345689 0 0) 0x7faa48116ff0 con 0x7faa48064a20 2021-05-26T16:43:30.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): my global_id is 104191 2021-05-26T16:43:30.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa28003270 con 0x7faa48064a20 2021-05-26T16:43:30.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760734503 0 0) 0x7faa48116ab0 con 0x7faa48063e30 2021-05-26T16:43:30.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): my global_id is 5007 2021-05-26T16:43:30.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48116ff0 con 0x7faa48063e30 2021-05-26T16:43:30.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443111349 0 0) 0x7faa48116d50 con 0x7faa480642e0 2021-05-26T16:43:30.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): my global_id is 5135 2021-05-26T16:43:30.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48116ab0 con 0x7faa480642e0 2021-05-26T16:43:30.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 357467307 0 0) 0x7faa48116ff0 con 0x7faa48063e30 2021-05-26T16:43:30.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa48116d50 con 0x7faa48063e30 2021-05-26T16:43:30.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa3c002240 con 0x7faa48063e30 2021-05-26T16:43:30.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:43:30.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:30.714 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.714 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.715 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.715 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.715 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.716 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.716 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.716 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.718 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.718 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.718 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:30.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3224344074 0 0) 0x7faa28003270 con 0x7faa48064a20 2021-05-26T16:43:30.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa48116ff0 con 0x7faa48064a20 2021-05-26T16:43:30.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa44002280 con 0x7faa48064a20 2021-05-26T16:43:30.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.720 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:30.720 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:30.720 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.720 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.720 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.721 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.721 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.721 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.721 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.722 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.722 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.722 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.722 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.723 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.723 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.723 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.723 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.723 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 474625296 0 0) 0x7faa48116ab0 con 0x7faa480642e0 2021-05-26T16:43:30.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa28003270 con 0x7faa480642e0 2021-05-26T16:43:30.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa38004870 con 0x7faa480642e0 2021-05-26T16:43:30.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:30.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:30.725 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.725 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.726 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.726 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.726 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.727 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.727 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.728 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.728 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.728 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.729 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.729 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.730 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.730 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.730 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.730 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2764789548 0 0) 0x7faa48116d50 con 0x7faa48063e30 2021-05-26T16:43:30.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6792/0 conn(0x7faa48064a20 legacy=0x7faa48144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6791/0 conn(0x7faa480642e0 legacy=0x7faa481410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:30.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 monclient: found mon.g 2021-05-26T16:43:30.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:30.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:43:30.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4812f2b0 con 0x7faa48063e30 2021-05-26T16:43:30.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:30.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:30.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa501f6700 5 monclient: authenticate success, global_id 5007 2021-05-26T16:43:30.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa501f6700 10 monclient: _renew_subs 2021-05-26T16:43:30.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa501f6700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:43:30.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4812ffb0 con 0x7faa48063e30 2021-05-26T16:43:30.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faa3c0024f0 con 0x7faa48063e30 2021-05-26T16:43:30.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:30.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa3c0029a0 con 0x7faa48063e30 2021-05-26T16:43:30.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa35ffb700 10 monclient: dump: 2021-05-26T16:43:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.738 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.738 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.738 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.738 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.739 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa501f6700 10 monclient: _renew_subs 2021-05-26T16:43:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa501f6700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:43:30.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa37fff700 4 set_mon_vals no callback set 2021-05-26T16:43:30.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.667+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.137:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4813cd00 con 0x7faa48063e30 2021-05-26T16:43:30.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.668+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7faa3c002bc0 con 0x7faa48063e30 2021-05-26T16:43:30.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.668+0000 7faa501f6700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:30.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.668+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7faa4806c030 con 0x7faa48130df0 2021-05-26T16:43:30.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.668+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.3 v1:172.21.15.137:6790/0 8 ==== osd_map(113..113 src has 1..113) v4 ==== 3941+0+0 (unknown 1850034729 0 0) 0x7faa3c03d970 con 0x7faa48063e30 2021-05-26T16:43:30.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.668+0000 7faa4e793700 10 monclient: get_auth_request con 0x7faa280333a0 auth_method 0 2021-05-26T16:43:30.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.670+0000 7faa4d791700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.3:6790/0 conn(0x7faa48130df0 legacy=0x7faa48058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301200223 0 0) 0x7faa4806c030 con 0x7faa48130df0 2021-05-26T16:43:30.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient(hunting): my global_id is 5042 2021-05-26T16:43:30.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48116d50 con 0x7faa48130df0 2021-05-26T16:43:30.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2145069141 0 0) 0x7faa48116d50 con 0x7faa48130df0 2021-05-26T16:43:30.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa4806c030 con 0x7faa48130df0 2021-05-26T16:43:30.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa38004f70 con 0x7faa48130df0 2021-05-26T16:43:30.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:30.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient: dump: 2021-05-26T16:43:30.745 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.745 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.745 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.746 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.746 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.746 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.746 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.747 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.747 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.747 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.747 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.747 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.748 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.748 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.748 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.749 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3685510743 0 0) 0x7faa4806c030 con 0x7faa48130df0 2021-05-26T16:43:30.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa480008d0 con 0x7faa48130df0 2021-05-26T16:43:30.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7faa38005210 con 0x7faa48130df0 2021-05-26T16:43:30.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:30.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:30.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.3:6790/0 conn(0x7faa48130df0 legacy=0x7faa48058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.671+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.3:6790/0 conn(0x7faa48130df0 legacy=0x7faa48058d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:30.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.678+0000 7faa501f6700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:30.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.678+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7faa48095250 con 0x7faa481297e0 2021-05-26T16:43:30.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.680+0000 7faa4d791700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.3:6790/0 conn(0x7faa481297e0 legacy=0x7faa48094b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.680+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38356046 0 0) 0x7faa48095250 con 0x7faa481297e0 2021-05-26T16:43:30.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.680+0000 7faa35ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.680+0000 7faa35ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.680+0000 7faa35ffb700 10 monclient(hunting): my global_id is 5051 2021-05-26T16:43:30.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.680+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4806c030 con 0x7faa481297e0 2021-05-26T16:43:30.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3161273361 0 0) 0x7faa4806c030 con 0x7faa481297e0 2021-05-26T16:43:30.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa48095250 con 0x7faa481297e0 2021-05-26T16:43:30.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faa38005a60 con 0x7faa481297e0 2021-05-26T16:43:30.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:30.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 10 monclient: dump: 2021-05-26T16:43:30.757 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.758 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.758 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.758 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.758 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.759 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.759 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.759 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.759 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.761 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4250695218 0 0) 0x7faa48095250 con 0x7faa481297e0 2021-05-26T16:43:30.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 --> v1:172.21.15.3:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faa48059440 con 0x7faa481297e0 2021-05-26T16:43:30.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 1868516188) 0x7faa380081c0 con 0x7faa481297e0 2021-05-26T16:43:30.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:30.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:30.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.3:6790/0 conn(0x7faa481297e0 legacy=0x7faa48094b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.681+0000 7faa35ffb700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.3:6790/0 conn(0x7faa481297e0 legacy=0x7faa48094b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:30.763 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:30.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:30.764 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:30.764 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:30.765 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:30.765 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:30.765 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:30.765 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:30.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:30.766 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:30.766 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:30.766 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:30.767 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:30.767 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:30.767 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:30.767 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.768 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 5, 2021-05-26T16:43:30.768 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:30.768 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:30.769 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:30.769 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:30.769 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:30.769 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:30.770 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:30.770 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:30.770 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:30.770 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:30.771 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:30.771 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:30.771 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.771 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:30.772 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:30.772 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:30.772 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:30.772 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:30.773 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:30.773 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:30.773 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:30.773 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:30.773 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:30.774 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:30.774 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.774 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:30.775 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:30.775 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:30.775 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:30.776 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:30.776 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:30.776 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:30.776 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:30.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:30.777 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:30.777 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:30.777 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:30.777 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:30.778 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:30.778 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:30.778 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:30.778 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:30.779 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:30.779 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:30.779 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:30.779 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:30.780 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:30.780 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:30.780 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:30.781 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.781 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:30.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.781 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:30.782 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.782 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:30.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:30.783 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.783 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.783 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.784 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.784 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:30.784 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.785 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.785 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.786 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:30.786 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:30.787 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.787 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.787 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.788 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.788 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:30.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:30.789 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.790 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.790 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.790 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.791 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:30.791 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.791 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.792 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.793 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:30.793 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:30.793 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.794 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.794 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.794 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.795 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:30.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:30.795 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.795 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.796 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.796 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.796 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:30.796 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.797 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.797 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.797 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:30.797 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:30.798 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.798 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.798 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.798 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.799 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.799 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:30.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:30.799 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.800 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.800 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.800 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.800 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:30.800 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.801 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.801 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.801 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:30.802 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:30.802 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.802 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.803 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.803 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.803 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:30.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:30.804 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.804 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.804 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.804 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.805 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:30.805 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.805 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.805 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.805 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.806 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:30.806 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:30.806 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.806 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.807 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.807 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.807 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:30.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:30.808 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.808 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.808 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.808 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.809 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:30.809 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.809 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.809 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.810 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:30.810 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:30.810 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.811 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.811 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.811 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.811 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:30.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:30.812 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.812 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.813 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.813 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.813 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:30.813 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.814 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.814 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.814 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:30.815 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:30.815 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.815 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.815 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.816 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.816 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:30.816 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:30.817 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.817 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.817 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.817 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.818 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:30.818 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.818 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.818 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.819 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:30.819 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:30.819 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.820 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.820 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.820 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.820 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.821 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:30.821 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:30.821 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:30.821 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:30.821 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.822 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:30.822 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:30.822 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:30.822 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.822 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.823 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:30.823 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:30.823 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:30.824 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:30.824 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:30.824 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.824 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.825 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:30.825 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:30.825 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.825 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:30.825 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:30.826 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:30.826 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.826 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:30.826 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:30.826 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:30.827 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:30.827 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:30.827 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:30.827 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:30.828 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:30.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:30.828 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:30.828 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:30.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6812/30003 conn(0x7faa280333a0 legacy=0x7faa28035860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 10 monclient: shutdown 2021-05-26T16:43:30.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:30.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 >> v1:172.21.15.137:6790/0 conn(0x7faa48063e30 legacy=0x7faa4813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa4e793700 1 -- 172.21.15.3:0/1701320470 reap_dead start 2021-05-26T16:43:30.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa4e793700 1 -- 172.21.15.3:0/1701320470 reap_dead start 2021-05-26T16:43:30.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 shutdown_connections 2021-05-26T16:43:30.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 >> 172.21.15.3:0/1701320470 conn(0x7faa480a0db0 msgr2=0x7faa480993e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:30.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 shutdown_connections 2021-05-26T16:43:30.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.682+0000 7faa501f6700 1 -- 172.21.15.3:0/1701320470 wait complete. 2021-05-26T16:43:30.833 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-05-26T16:43:30.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.947+0000 7fd241fe8700 10 monclient: get_monmap_and_config 2021-05-26T16:43:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.947+0000 7fd241fe8700 10 monclient: build_initial_monmap 2021-05-26T16:43:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.947+0000 7fd241fe8700 10 monclient: monmap: 2021-05-26T16:43:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:30.951 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.951 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:30.948046+0000 2021-05-26T16:43:30.951 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:30.948046+0000 2021-05-26T16:43:30.951 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:30.951 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:30.954 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 1 Processor -- start 2021-05-26T16:43:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 1 -- start start 2021-05-26T16:43:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient: init 2021-05-26T16:43:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:30.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient: _add_conns ranks=[7,4,6,5,0,2,8,3,1] 2021-05-26T16:43:30.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient(hunting): picked mon.noname-i con 0x7fd23c12cbd0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:30.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient(hunting): picked mon.noname-c con 0x7fd23c099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:30.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient(hunting): picked mon.noname-d con 0x7fd23c099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:30.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c046600 con 0x7fd23c099a30 2021-05-26T16:43:30.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c09b5e0 con 0x7fd23c099eb0 2021-05-26T16:43:30.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c12d8f0 con 0x7fd23c12cbd0 2021-05-26T16:43:30.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:30.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd241fe8700 10 monclient(hunting): authenticate will time out at 968.579689s 2021-05-26T16:43:30.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd233fff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fd23c099a30 0x7fd23c131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37942/0 (socket says 172.21.15.3:37942) 2021-05-26T16:43:30.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.948+0000 7fd233fff700 1 -- 172.21.15.3:0/286895334 learned_addr learned my addr 172.21.15.3:0/286895334 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:30.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2417e7700 1 -- 172.21.15.3:0/286895334 >> v1:172.21.15.3:6792/0 conn(0x7fd23c099eb0 legacy=0x7fd23c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd233fff700 1 -- 172.21.15.3:0/286895334 >> v1:172.21.15.3:6791/0 conn(0x7fd23c099a30 legacy=0x7fd23c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd240fe6700 1 -- 172.21.15.3:0/286895334 >> v1:172.21.15.137:6792/0 conn(0x7fd23c12cbd0 legacy=0x7fd23c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:30.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992353176 0 0) 0x7fd23c046600 con 0x7fd23c099a30 2021-05-26T16:43:30.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): my global_id is 5080 2021-05-26T16:43:30.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd228003270 con 0x7fd23c099a30 2021-05-26T16:43:30.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190169262 0 0) 0x7fd23c09b5e0 con 0x7fd23c099eb0 2021-05-26T16:43:30.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): my global_id is 4965 2021-05-26T16:43:30.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c046600 con 0x7fd23c099eb0 2021-05-26T16:43:30.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801664166 0 0) 0x7fd23c12d8f0 con 0x7fd23c12cbd0 2021-05-26T16:43:30.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:30.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:30.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient(hunting): my global_id is 104200 2021-05-26T16:43:30.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c09b5e0 con 0x7fd23c12cbd0 2021-05-26T16:43:30.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557162876 0 0) 0x7fd23c046600 con 0x7fd23c099eb0 2021-05-26T16:43:30.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 >> v1:172.21.15.137:6792/0 conn(0x7fd23c12cbd0 legacy=0x7fd23c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 >> v1:172.21.15.3:6791/0 conn(0x7fd23c099a30 legacy=0x7fd23c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:30.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: _finish_hunting 0 2021-05-26T16:43:30.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 monclient: found mon.noname-d 2021-05-26T16:43:30.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:30.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:43:30.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c09c2b0 con 0x7fd23c099eb0 2021-05-26T16:43:30.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: _finish_auth 0 2021-05-26T16:43:30.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:30.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd238001e30 con 0x7fd23c099eb0 2021-05-26T16:43:30.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd241fe8700 5 monclient: authenticate success, global_id 4965 2021-05-26T16:43:30.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd241fe8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:30.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:30.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: dump: 2021-05-26T16:43:30.985 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.986 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.986 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.986 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.987 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.987 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.988 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.988 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.988 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.989 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.989 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:30.990 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:30.990 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:30.990 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:30.991 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:30.991 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:30.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd241fe8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:30.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd238002280 con 0x7fd23c099eb0 2021-05-26T16:43:30.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:30.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 1 -- 172.21.15.3:0/286895334 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd238002730 con 0x7fd23c099eb0 2021-05-26T16:43:30.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd241fe8700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:30.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd241fe8700 4 set_mon_vals no callback set 2021-05-26T16:43:30.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:30.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:30.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.951+0000 7fd2337fe700 10 monclient: dump: 2021-05-26T16:43:30.996 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:30.996 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:30.997 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.997 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:30.997 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:30.998 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:30.998 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:30.998 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:30.999 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:30.999 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:30.999 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:31.000 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:31.000 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:31.000 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:31.001 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:31.001 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:31.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 10 monclient: shutdown 2021-05-26T16:43:31.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:31.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 1 -- 172.21.15.3:0/286895334 >> v1:172.21.15.3:6792/0 conn(0x7fd23c099eb0 legacy=0x7fd23c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:31.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 1 -- 172.21.15.3:0/286895334 shutdown_connections 2021-05-26T16:43:31.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 1 -- 172.21.15.3:0/286895334 >> 172.21.15.3:0/286895334 conn(0x7fd23c0a00c0 msgr2=0x7fd23c0a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:31.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 1 -- 172.21.15.3:0/286895334 shutdown_connections 2021-05-26T16:43:31.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 1 -- 172.21.15.3:0/286895334 wait complete. 2021-05-26T16:43:31.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 10 monclient: build_initial_monmap 2021-05-26T16:43:31.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.952+0000 7fd241fe8700 10 monclient: monmap: 2021-05-26T16:43:31.004 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:31.004 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:31.004 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:31.004 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:31.004 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:31.005 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:31.005 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:31.005 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:31.005 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:31.006 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:31.006 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:31.006 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:31.006 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:31.006 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:31.007 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 1 Processor -- start 2021-05-26T16:43:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 1 -- start start 2021-05-26T16:43:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient: init 2021-05-26T16:43:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient: _add_conns ranks=[0,5,7,3,4,8,2,1,6] 2021-05-26T16:43:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient(hunting): picked mon.noname-a con 0x7fd23c099a30 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient(hunting): picked mon.noname-h con 0x7fd23c099eb0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient(hunting): picked mon.noname-i con 0x7fd23c12cbd0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c116af0 con 0x7fd23c099a30 2021-05-26T16:43:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c116d20 con 0x7fd23c099eb0 2021-05-26T16:43:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c116fc0 con 0x7fd23c12cbd0 2021-05-26T16:43:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd241fe8700 10 monclient(hunting): authenticate will time out at 968.584813s 2021-05-26T16:43:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd240fe6700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd23c099a30 0x7fd23c13bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52436/0 (socket says 172.21.15.3:52436) 2021-05-26T16:43:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.953+0000 7fd240fe6700 1 -- 172.21.15.3:0/3805579456 learned_addr learned my addr 172.21.15.3:0/3805579456 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd240fe6700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6789/0 conn(0x7fd23c099a30 legacy=0x7fd23c13bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156660846 0 0) 0x7fd23c116af0 con 0x7fd23c099a30 2021-05-26T16:43:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd230ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd230ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd230ff9700 10 monclient(hunting): my global_id is 104256 2021-05-26T16:43:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c003270 con 0x7fd23c099a30 2021-05-26T16:43:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd2417e7700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.137:6792/0 conn(0x7fd23c12cbd0 legacy=0x7fd23c1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 DispatchQueue::entry inject delay of 0.002000 2021-05-26T16:43:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.956+0000 7fd233fff700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.137:6791/0 conn(0x7fd23c099eb0 legacy=0x7fd23c129820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2439222099 0 0) 0x7fd21c003270 con 0x7fd23c099a30 2021-05-26T16:43:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd23c116af0 con 0x7fd23c099a30 2021-05-26T16:43:31.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153792949 0 0) 0x7fd23c116d20 con 0x7fd23c099eb0 2021-05-26T16:43:31.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:31.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:31.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): my global_id is 5144 2021-05-26T16:43:31.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c003270 con 0x7fd23c099eb0 2021-05-26T16:43:31.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089022882 0 0) 0x7fd23c116fc0 con 0x7fd23c12cbd0 2021-05-26T16:43:31.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:31.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:31.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): my global_id is 104209 2021-05-26T16:43:31.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c116d20 con 0x7fd23c12cbd0 2021-05-26T16:43:31.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd22c001d50 con 0x7fd23c099a30 2021-05-26T16:43:31.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:31.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:31.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): dump: 2021-05-26T16:43:31.016 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:31.016 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:31.016 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.017 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.017 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:31.017 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:31.018 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:31.018 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:31.018 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:31.018 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:31.018 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:31.019 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:31.019 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:31.019 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:31.019 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:31.019 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:31.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:31.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3435750874 0 0) 0x7fd23c116af0 con 0x7fd23c099a30 2021-05-26T16:43:31.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.137:6792/0 conn(0x7fd23c12cbd0 legacy=0x7fd23c1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:31.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.137:6791/0 conn(0x7fd23c099eb0 legacy=0x7fd23c129820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:31.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:43:31.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 monclient: found mon.a 2021-05-26T16:43:31.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:31.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:31.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c117260 con 0x7fd23c099a30 2021-05-26T16:43:31.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient: _finish_auth 0 2021-05-26T16:43:31.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:31.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd241fe8700 5 monclient: authenticate success, global_id 104256 2021-05-26T16:43:31.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd241fe8700 10 monclient: _renew_subs 2021-05-26T16:43:31.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd241fe8700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:31.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c13ce40 con 0x7fd23c099a30 2021-05-26T16:43:31.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd241fe8700 10 monclient: _renew_subs 2021-05-26T16:43:31.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd241fe8700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:31.024 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c129f30 con 0x7fd23c099a30 2021-05-26T16:43:31.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd22c002080 con 0x7fd23c099a30 2021-05-26T16:43:31.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:31.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd22c0028b0 con 0x7fd23c099a30 2021-05-26T16:43:31.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:31.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd232ffd700 4 set_mon_vals no callback set 2021-05-26T16:43:31.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:31.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.958+0000 7fd230ff9700 10 monclient: dump: 2021-05-26T16:43:31.027 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:31.027 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:31.027 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.027 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.028 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:31.028 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:31.028 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:31.028 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:31.029 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:31.029 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:31.029 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:31.030 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:31.030 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:31.030 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:31.030 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:31.030 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:31.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.959+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fd22c002a50 con 0x7fd23c099a30 2021-05-26T16:43:31.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.959+0000 7fd241fe8700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:31.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.959+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd2140065a0 con 0x7fd214002840 2021-05-26T16:43:31.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.959+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(113..113 src has 1..113) v4 ==== 3941+0+0 (unknown 1850034729 0 0) 0x7fd22c03da80 con 0x7fd23c099a30 2021-05-26T16:43:31.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.959+0000 7fd2417e7700 10 monclient: get_auth_request con 0x7fd21c032bd0 auth_method 0 2021-05-26T16:43:31.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.961+0000 7fd233fff700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6791/0 conn(0x7fd214002840 legacy=0x7fd214004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203536122 0 0) 0x7fd2140065a0 con 0x7fd214002840 2021-05-26T16:43:31.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:31.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:31.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient(hunting): my global_id is 5089 2021-05-26T16:43:31.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c116af0 con 0x7fd214002840 2021-05-26T16:43:31.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 367595650 0 0) 0x7fd23c116af0 con 0x7fd214002840 2021-05-26T16:43:31.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2140065a0 con 0x7fd214002840 2021-05-26T16:43:31.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd224004530 con 0x7fd214002840 2021-05-26T16:43:31.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:31.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:31.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient: dump: 2021-05-26T16:43:31.035 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:31.036 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:31.036 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.036 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.036 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:31.036 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:31.037 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:31.037 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:31.037 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:31.037 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:31.038 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:31.038 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:31.038 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:31.038 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:31.039 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:31.039 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:31.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 945795710 0 0) 0x7fd2140065a0 con 0x7fd214002840 2021-05-26T16:43:31.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd214009e40 con 0x7fd214002840 2021-05-26T16:43:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fd224004840 con 0x7fd214002840 2021-05-26T16:43:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6791/0 conn(0x7fd214002840 legacy=0x7fd214004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.962+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6791/0 conn(0x7fd214002840 legacy=0x7fd214004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:31.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.969+0000 7fd241fe8700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:31.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.969+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd214007510 con 0x7fd2140068b0 2021-05-26T16:43:31.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd233fff700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6791/0 conn(0x7fd2140068b0 legacy=0x7fd214006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471564190 0 0) 0x7fd214007510 con 0x7fd2140068b0 2021-05-26T16:43:31.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:31.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:31.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 10 monclient(hunting): my global_id is 5098 2021-05-26T16:43:31.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2140065a0 con 0x7fd2140068b0 2021-05-26T16:43:31.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 332485075 0 0) 0x7fd2140065a0 con 0x7fd2140068b0 2021-05-26T16:43:31.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd214007510 con 0x7fd2140068b0 2021-05-26T16:43:31.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd224005050 con 0x7fd2140068b0 2021-05-26T16:43:31.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:31.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.971+0000 7fd230ff9700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:31.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 10 monclient: dump: 2021-05-26T16:43:31.046 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:31.046 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:31.047 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.047 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:31.047 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:31.047 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:31.048 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:31.048 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:31.048 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:31.049 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:31.049 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:31.049 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:31.049 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:31.049 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:31.050 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:31.050 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:31.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1515703595 0 0) 0x7fd214007510 con 0x7fd2140068b0 2021-05-26T16:43:31.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 --> v1:172.21.15.3:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd214008770 con 0x7fd2140068b0 2021-05-26T16:43:31.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 4014112077) 0x7fd2240073e0 con 0x7fd2140068b0 2021-05-26T16:43:31.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:31.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:31.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6791/0 conn(0x7fd2140068b0 legacy=0x7fd214006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:31.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd230ff9700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6791/0 conn(0x7fd2140068b0 legacy=0x7fd214006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:31.052 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:31.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:31.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:31.053 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:31.053 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:31.053 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:31.054 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:31.054 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:31.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:31.054 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:31.055 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:31.055 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:31.055 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:31.055 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:31.056 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:31.056 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:31.056 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 5, 2021-05-26T16:43:31.057 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:31.057 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:31.057 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:31.057 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:31.057 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:31.058 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:31.058 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:31.058 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:31.059 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:31.059 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:31.059 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:31.059 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:31.060 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:31.060 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:31.060 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:31.060 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:31.060 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:31.061 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:31.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:31.061 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:31.061 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:31.062 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:31.062 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:31.062 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:31.062 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.063 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:31.063 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:31.063 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:31.063 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:31.064 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:31.064 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:31.064 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:31.064 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:31.065 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:31.065 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:31.065 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:31.065 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:31.066 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:31.066 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:31.066 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:31.066 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:31.067 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:31.067 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:31.067 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:31.067 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:31.068 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:31.068 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:31.068 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:31.068 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:31.068 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:31.069 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:31.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.069 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:31.069 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.070 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:31.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:31.070 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.070 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.071 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.071 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.071 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:31.071 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.072 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.072 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.072 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:31.072 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:31.073 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.073 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.073 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.073 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.074 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:31.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:31.074 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.074 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.075 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.075 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.075 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:31.075 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.076 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.076 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.076 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:31.076 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:31.077 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.077 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.077 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.078 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.078 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:31.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:31.078 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.078 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.079 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.079 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.079 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:31.079 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.080 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.080 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.080 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:31.081 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:31.081 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.081 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.081 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.082 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.082 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:31.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:31.082 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.083 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.083 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.083 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.083 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:31.084 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.084 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.084 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.085 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:31.085 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:31.085 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.085 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.086 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.086 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.086 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:31.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:31.087 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.087 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.087 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.087 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.088 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:31.088 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.088 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.089 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.089 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:31.089 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:31.089 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.090 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.090 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.090 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.091 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:31.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:31.091 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.091 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.091 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.092 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.092 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:31.092 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.092 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.093 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.093 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:31.093 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:31.094 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.094 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.094 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.095 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:31.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:31.095 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.095 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.096 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.096 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.096 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:31.096 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.097 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.097 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:31.098 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:31.098 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.098 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.098 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.099 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:31.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:31.099 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.100 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.100 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.100 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.100 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:31.100 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.101 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.101 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.101 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:31.102 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:31.102 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.102 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.102 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.103 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.103 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:31.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:31.104 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:31.104 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:31.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.104 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:31.105 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:31.105 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:31.105 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.105 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.106 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:31.106 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:31.106 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:31.107 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:31.107 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:31.107 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.107 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.108 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:31.108 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:31.108 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.109 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:31.109 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:31.109 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:31.109 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.110 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:31.110 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:31.110 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.110 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:31.110 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:31.111 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:31.111 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.111 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:31.111 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:31.112 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:31.112 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:31.112 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:31.112 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:31.113 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:31.113 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:31.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:31.113 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:31.113 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:31.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.137:6812/30003 conn(0x7fd21c032bd0 legacy=0x7fd21c035090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:31.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 10 monclient: shutdown 2021-05-26T16:43:31.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:31.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 >> v1:172.21.15.3:6789/0 conn(0x7fd23c099a30 legacy=0x7fd23c13bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:31.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd2417e7700 1 -- 172.21.15.3:0/3805579456 reap_dead start 2021-05-26T16:43:31.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd2417e7700 1 -- 172.21.15.3:0/3805579456 reap_dead start 2021-05-26T16:43:31.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 shutdown_connections 2021-05-26T16:43:31.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 >> 172.21.15.3:0/3805579456 conn(0x7fd23c0a00c0 msgr2=0x7fd23c12a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:31.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 shutdown_connections 2021-05-26T16:43:31.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:30.972+0000 7fd241fe8700 1 -- 172.21.15.3:0/3805579456 wait complete. 2021-05-26T16:43:31.119 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2021-05-26T16:43:31.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.244+0000 7f2a04415700 10 monclient: get_monmap_and_config 2021-05-26T16:43:31.247 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.244+0000 7f2a04415700 10 monclient: build_initial_monmap 2021-05-26T16:43:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.244+0000 7f2a04415700 10 monclient: monmap: 2021-05-26T16:43:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:31.245509+0000 2021-05-26T16:43:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:31.245509+0000 2021-05-26T16:43:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:31.251 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.245+0000 7f2a04415700 1 Processor -- start 2021-05-26T16:43:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.245+0000 7f2a04415700 1 -- start start 2021-05-26T16:43:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.245+0000 7f2a04415700 10 monclient: init 2021-05-26T16:43:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 10 monclient: _add_conns ranks=[7,2,5,4,1,8,6,0,3] 2021-05-26T16:43:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 10 monclient(hunting): picked mon.noname-i con 0x7f29fc064a20 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 10 monclient(hunting): picked mon.noname-b con 0x7f29fc063e30 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:31.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 10 monclient(hunting): picked mon.noname-h con 0x7f29fc0642e0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:31.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc059750 con 0x7f29fc063e30 2021-05-26T16:43:31.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc064e00 con 0x7f29fc0642e0 2021-05-26T16:43:31.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc09c770 con 0x7f29fc064a20 2021-05-26T16:43:31.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:31.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a04415700 10 monclient(hunting): authenticate will time out at 968.877153s 2021-05-26T16:43:31.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a019b0700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f29fc063e30 0x7f29fc132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54490/0 (socket says 172.21.15.3:54490) 2021-05-26T16:43:31.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.246+0000 7f2a019b0700 1 -- 172.21.15.3:0/937127504 learned_addr learned my addr 172.21.15.3:0/937127504 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:31.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.248+0000 7f2a019b0700 1 -- 172.21.15.3:0/937127504 >> v1:172.21.15.3:6790/0 conn(0x7f29fc063e30 legacy=0x7f29fc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.248+0000 7f2a021b1700 1 -- 172.21.15.3:0/937127504 >> v1:172.21.15.137:6792/0 conn(0x7f29fc064a20 legacy=0x7f29fc099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:31.248+0000 7f2a029b2700 1 -- 172.21.15.3:0/937127504 >> v1:172.21.15.137:6791/0 conn(0x7f29fc0642e0 legacy=0x7f29fc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:31.305 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34829]: starting. 2021-05-26T16:43:31.306 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34829]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34828 2021-05-26T16:43:31.306 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34829]: created object 0... 2021-05-26T16:43:31.306 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34829]: created object 25... 2021-05-26T16:43:31.306 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34829]: created object 49... 2021-05-26T16:43:31.307 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34829]: finishing. 2021-05-26T16:43:31.307 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34829]: shutting down. 2021-05-26T16:43:32.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30878012 0 0) 0x7f29fc064e00 con 0x7f29fc0642e0 2021-05-26T16:43:32.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 10 monclient(hunting): my global_id is 5153 2021-05-26T16:43:32.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e4003270 con 0x7f29fc0642e0 2021-05-26T16:43:32.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597508728 0 0) 0x7f29fc09c770 con 0x7f29fc064a20 2021-05-26T16:43:32.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 10 monclient(hunting): my global_id is 104218 2021-05-26T16:43:32.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29fc064e00 con 0x7f29fc064a20 2021-05-26T16:43:32.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4163328903 0 0) 0x7f29e4003270 con 0x7f29fc0642e0 2021-05-26T16:43:32.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 >> v1:172.21.15.137:6792/0 conn(0x7f29fc064a20 legacy=0x7f29fc099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 >> v1:172.21.15.3:6790/0 conn(0x7f29fc063e30 legacy=0x7f29fc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 10 monclient: _finish_hunting 0 2021-05-26T16:43:32.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.001+0000 7f2a011af700 1 monclient: found mon.noname-h 2021-05-26T16:43:32.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:32.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.137:6791/0 2021-05-26T16:43:32.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0977a0 con 0x7f29fc0642e0 2021-05-26T16:43:32.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: _finish_auth 0 2021-05-26T16:43:32.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:32.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29f8001e30 con 0x7f29fc0642e0 2021-05-26T16:43:32.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2021-05-26T16:43:32.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: dump: 2021-05-26T16:43:32.011 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.011 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.012 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.012 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.012 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.012 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.012 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.013 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.013 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.013 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.013 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.013 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.014 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.014 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.014 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.014 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a04415700 5 monclient: authenticate success, global_id 5153 2021-05-26T16:43:32.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a04415700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:32.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 <== mon.5 v1:172.21.15.137:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f29f8002280 con 0x7f29fc0642e0 2021-05-26T16:43:32.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:32.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 1 -- 172.21.15.3:0/937127504 <== mon.5 v1:172.21.15.137:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29f8002730 con 0x7f29fc0642e0 2021-05-26T16:43:32.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:32.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a011af700 10 monclient: dump: 2021-05-26T16:43:32.016 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.016 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.017 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.017 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.017 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.017 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.019 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.019 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.019 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.019 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.019 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a04415700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:32.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.002+0000 7f2a04415700 4 set_mon_vals no callback set 2021-05-26T16:43:32.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.003+0000 7f2a04415700 10 monclient: shutdown 2021-05-26T16:43:32.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.003+0000 7f2a04415700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:32.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.003+0000 7f2a04415700 1 -- 172.21.15.3:0/937127504 >> v1:172.21.15.137:6791/0 conn(0x7f29fc0642e0 legacy=0x7f29fc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.003+0000 7f2a04415700 1 -- 172.21.15.3:0/937127504 shutdown_connections 2021-05-26T16:43:32.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.003+0000 7f2a04415700 1 -- 172.21.15.3:0/937127504 >> 172.21.15.3:0/937127504 conn(0x7f29fc0a0db0 msgr2=0x7f29fc09cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:32.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.003+0000 7f2a04415700 1 -- 172.21.15.3:0/937127504 shutdown_connections 2021-05-26T16:43:32.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.003+0000 7f2a04415700 1 -- 172.21.15.3:0/937127504 wait complete. 2021-05-26T16:43:32.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.004+0000 7f2a04415700 10 monclient: build_initial_monmap 2021-05-26T16:43:32.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.004+0000 7f2a04415700 10 monclient: monmap: 2021-05-26T16:43:32.022 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:32.022 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:32.022 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:32.023 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:32.023 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:32.023 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.023 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:32.024 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:32.024 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:32.024 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:32.024 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:32.024 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:32.025 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:32.025 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:32.025 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:32.025 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.004+0000 7f2a04415700 1 Processor -- start 2021-05-26T16:43:32.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 1 -- start start 2021-05-26T16:43:32.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient: init 2021-05-26T16:43:32.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:32.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient: _add_conns ranks=[6,8,7,3,2,5,4,0,1] 2021-05-26T16:43:32.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient(hunting): picked mon.noname-d con 0x7f29fc063e30 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:32.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient(hunting): picked mon.noname-e con 0x7f29fc0642e0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:32.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient(hunting): picked mon.noname-i con 0x7f29fc064a20 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:32.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc09c180 con 0x7f29fc063e30 2021-05-26T16:43:32.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc116e00 con 0x7f29fc064a20 2021-05-26T16:43:32.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc1170a0 con 0x7f29fc0642e0 2021-05-26T16:43:32.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:32.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a04415700 10 monclient(hunting): authenticate will time out at 969.636845s 2021-05-26T16:43:32.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.005+0000 7f2a021b1700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f29fc063e30 0x7f29fc13c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57854/0 (socket says 172.21.15.3:57854) 2021-05-26T16:43:32.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.006+0000 7f2a019b0700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f29fc0642e0 0x7f29fc141240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53536/0 (socket says 172.21.15.3:53536) 2021-05-26T16:43:32.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.006+0000 7f2a021b1700 1 -- 172.21.15.3:0/456207426 learned_addr learned my addr 172.21.15.3:0/456207426 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:32.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f2a021b1700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29fc063e30 legacy=0x7f29fc13c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f2a019b0700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6793/0 conn(0x7f29fc0642e0 legacy=0x7f29fc141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f2a029b2700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.137:6792/0 conn(0x7f29fc064a20 legacy=0x7f29fc144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937942959 0 0) 0x7f29fc09c180 con 0x7f29fc063e30 2021-05-26T16:43:32.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): my global_id is 4974 2021-05-26T16:43:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29dc003270 con 0x7f29fc063e30 2021-05-26T16:43:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329643746 0 0) 0x7f29fc116e00 con 0x7f29fc064a20 2021-05-26T16:43:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): my global_id is 104227 2021-05-26T16:43:32.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29fc09c180 con 0x7f29fc064a20 2021-05-26T16:43:32.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545609386 0 0) 0x7f29fc1170a0 con 0x7f29fc0642e0 2021-05-26T16:43:32.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): my global_id is 104255 2021-05-26T16:43:32.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29fc116e00 con 0x7f29fc0642e0 2021-05-26T16:43:32.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 313320661 0 0) 0x7f29fc09c180 con 0x7f29fc064a20 2021-05-26T16:43:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29fc1170a0 con 0x7f29fc064a20 2021-05-26T16:43:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29f8002730 con 0x7f29fc064a20 2021-05-26T16:43:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2021-05-26T16:43:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): dump: 2021-05-26T16:43:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.045 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.045 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.045 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.045 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.045 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.046 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.046 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:32.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2391528542 0 0) 0x7f29dc003270 con 0x7f29fc063e30 2021-05-26T16:43:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29fc09c180 con 0x7f29fc063e30 2021-05-26T16:43:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.008+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1453155944 0 0) 0x7f29fc116e00 con 0x7f29fc0642e0 2021-05-26T16:43:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29dc003270 con 0x7f29fc0642e0 2021-05-26T16:43:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29ec001d70 con 0x7f29fc063e30 2021-05-26T16:43:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient(hunting): dump: 2021-05-26T16:43:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.050 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.050 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.050 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.050 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.051 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29f0001c90 con 0x7f29fc0642e0 2021-05-26T16:43:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient(hunting): dump: 2021-05-26T16:43:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.056 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3991376193 0 0) 0x7f29fc1170a0 con 0x7f29fc064a20 2021-05-26T16:43:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6793/0 conn(0x7f29fc0642e0 legacy=0x7f29fc141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29fc063e30 legacy=0x7f29fc13c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 monclient: found mon.i 2021-05-26T16:43:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:43:32.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.137:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc12e2f0 con 0x7f29fc064a20 2021-05-26T16:43:32.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:32.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:32.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a04415700 5 monclient: authenticate success, global_id 104227 2021-05-26T16:43:32.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a04415700 10 monclient: _renew_subs 2021-05-26T16:43:32.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a04415700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:43:32.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.137:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc12efc0 con 0x7f29fc064a20 2021-05-26T16:43:32.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a04415700 10 monclient: _renew_subs 2021-05-26T16:43:32.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a04415700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:43:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.137:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc13ce80 con 0x7f29fc064a20 2021-05-26T16:43:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f29f8001e60 con 0x7f29fc064a20 2021-05-26T16:43:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29f8003020 con 0x7f29fc064a20 2021-05-26T16:43:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f2a009ae700 4 set_mon_vals no callback set 2021-05-26T16:43:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.009+0000 7f29ea7fc700 10 monclient: dump: 2021-05-26T16:43:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.062 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.062 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.062 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.062 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.064 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.010+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f29f800eca0 con 0x7f29fc064a20 2021-05-26T16:43:32.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.010+0000 7f2a04415700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:32.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.010+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f29e00065a0 con 0x7f29e0002840 2021-05-26T16:43:32.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.010+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.7 v1:172.21.15.137:6792/0 8 ==== osd_map(114..114 src has 1..114) v4 ==== 3941+0+0 (unknown 2542809470 0 0) 0x7f29f803dd50 con 0x7f29fc064a20 2021-05-26T16:43:32.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.010+0000 7f2a019b0700 10 monclient: get_auth_request con 0x7f29dc033580 auth_method 0 2021-05-26T16:43:32.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.012+0000 7f2a021b1700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29e0002840 legacy=0x7f29e0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.012+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080634545 0 0) 0x7f29e00065a0 con 0x7f29e0002840 2021-05-26T16:43:32.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.012+0000 7f29ea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.012+0000 7f29ea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.012+0000 7f29ea7fc700 10 monclient(hunting): my global_id is 4983 2021-05-26T16:43:32.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29fc1170a0 con 0x7f29e0002840 2021-05-26T16:43:32.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2150983559 0 0) 0x7f29fc1170a0 con 0x7f29e0002840 2021-05-26T16:43:32.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29e00065a0 con 0x7f29e0002840 2021-05-26T16:43:32.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29ec0024e0 con 0x7f29e0002840 2021-05-26T16:43:32.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:32.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 10 monclient: dump: 2021-05-26T16:43:32.069 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.069 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.069 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.069 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.070 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.070 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.070 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.070 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.070 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.071 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.071 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.071 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.071 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.072 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.072 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.072 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3444053666 0 0) 0x7f29e00065a0 con 0x7f29e0002840 2021-05-26T16:43:32.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.013+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29e0009e40 con 0x7f29e0002840 2021-05-26T16:43:32.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.014+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f29ec002a00 con 0x7f29e0002840 2021-05-26T16:43:32.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.014+0000 7f29ea7fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:32.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.014+0000 7f29ea7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:32.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.014+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29e0002840 legacy=0x7f29e0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.014+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29e0002840 legacy=0x7f29e0004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:32.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.021+0000 7f2a04415700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:32.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.021+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f29e0007510 con 0x7f29e00068b0 2021-05-26T16:43:32.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f2a021b1700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29e00068b0 legacy=0x7f29e0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545271129 0 0) 0x7f29e0007510 con 0x7f29e00068b0 2021-05-26T16:43:32.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 10 monclient(hunting): my global_id is 4992 2021-05-26T16:43:32.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e00065a0 con 0x7f29e00068b0 2021-05-26T16:43:32.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1527628109 0 0) 0x7f29e00065a0 con 0x7f29e00068b0 2021-05-26T16:43:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29e0007510 con 0x7f29e00068b0 2021-05-26T16:43:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f29ec005850 con 0x7f29e00068b0 2021-05-26T16:43:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 10 monclient: dump: 2021-05-26T16:43:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.079 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.079 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.079 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.079 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.080 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.080 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.080 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 879477301 0 0) 0x7f29e0007510 con 0x7f29e00068b0 2021-05-26T16:43:32.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.024+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 --> v1:172.21.15.3:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f29e0008770 con 0x7f29e00068b0 2021-05-26T16:43:32.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 572141631) 0x7f29ec007bb0 con 0x7f29e00068b0 2021-05-26T16:43:32.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f29ea7fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:32.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f29ea7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:32.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29e00068b0 legacy=0x7f29e0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f29ea7fc700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.3:6792/0 conn(0x7f29e00068b0 legacy=0x7f29e0006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:32.082 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:32.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:32.083 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:32.083 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:32.083 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:32.083 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:32.083 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:32.084 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:32.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:32.084 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:32.084 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:32.085 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:32.085 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:32.085 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:32.085 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:32.086 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.086 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 6, 2021-05-26T16:43:32.086 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:32.086 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:32.086 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:32.087 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.087 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.087 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.087 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.088 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.088 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.088 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.088 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.088 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.089 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.089 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:32.089 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:32.089 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.089 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.091 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.091 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.091 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.091 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.092 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:32.092 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:32.092 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:32.092 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:32.093 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:32.093 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:32.093 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:32.093 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:32.093 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:32.094 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:32.094 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:32.094 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:32.094 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:32.095 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:32.095 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:32.095 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.095 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.095 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.096 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.096 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.096 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.096 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.097 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.097 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.097 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.097 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:32.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.098 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:32.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.098 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:32.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:32.099 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.099 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.099 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.100 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:32.100 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.100 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.100 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.101 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:32.101 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:32.101 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.101 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.102 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.102 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:32.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:32.103 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.103 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.103 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.103 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.104 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:32.104 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.104 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.104 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.105 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:32.105 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:32.105 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.105 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.106 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.106 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.106 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:32.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:32.107 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.107 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.107 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.107 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.108 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:32.108 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.108 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.108 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.109 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:32.109 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:32.109 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.109 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.110 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.110 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.110 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:32.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:32.111 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.111 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.111 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.111 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.112 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:32.112 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.112 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.112 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.113 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:32.113 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:32.113 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.113 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.113 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.114 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.114 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:32.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:32.115 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.115 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.115 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.115 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.116 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:32.116 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.116 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.116 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.117 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:32.117 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:32.117 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.117 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.117 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.118 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.118 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:32.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:32.119 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.119 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.119 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.119 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.119 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:32.120 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.120 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.120 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.121 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:32.121 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:32.121 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.121 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.121 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.122 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.122 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:32.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:32.122 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.123 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.123 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.123 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.123 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:32.124 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.124 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.124 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.124 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:32.125 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:32.125 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.125 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.125 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.126 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.126 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:32.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:32.126 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.127 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.127 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.127 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:32.127 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.128 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.128 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.128 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:32.129 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:32.129 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.129 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.129 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.130 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.130 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:32.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:32.130 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.130 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.131 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.131 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.131 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:32.131 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.132 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.132 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.132 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:32.132 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:32.133 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.133 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.133 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.133 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.134 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.134 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:32.134 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:32.134 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.135 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:32.135 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:32.135 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:32.135 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.136 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.136 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:32.136 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.136 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:32.136 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:32.137 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:32.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.137 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.138 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:32.138 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:32.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.137:6812/30003 conn(0x7f29dc033580 legacy=0x7f29dc035a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 10 monclient: shutdown 2021-05-26T16:43:32.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:32.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 >> v1:172.21.15.137:6792/0 conn(0x7f29fc064a20 legacy=0x7f29fc144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a029b2700 1 -- 172.21.15.3:0/456207426 reap_dead start 2021-05-26T16:43:32.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a029b2700 1 -- 172.21.15.3:0/456207426 reap_dead start 2021-05-26T16:43:32.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 shutdown_connections 2021-05-26T16:43:32.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 >> 172.21.15.3:0/456207426 conn(0x7f29fc0a0db0 msgr2=0x7f29fc099e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:32.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 shutdown_connections 2021-05-26T16:43:32.142 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.025+0000 7f2a04415700 1 -- 172.21.15.3:0/456207426 wait complete. 2021-05-26T16:43:32.142 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2021-05-26T16:43:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.269+0000 7f589c981700 10 monclient: get_monmap_and_config 2021-05-26T16:43:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.269+0000 7f589c981700 10 monclient: build_initial_monmap 2021-05-26T16:43:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.269+0000 7f589c981700 10 monclient: monmap: 2021-05-26T16:43:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:32.270239+0000 2021-05-26T16:43:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:32.270239+0000 2021-05-26T16:43:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:32.276 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:32.276 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 1 Processor -- start 2021-05-26T16:43:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 1 -- start start 2021-05-26T16:43:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient: init 2021-05-26T16:43:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient: _add_conns ranks=[3,2,5,8,1,4,0,6,7] 2021-05-26T16:43:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient(hunting): picked mon.noname-g con 0x7f589812cbd0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient(hunting): picked mon.noname-b con 0x7f5898099a30 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient(hunting): picked mon.noname-h con 0x7f5898099eb0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5898046600 con 0x7f5898099a30 2021-05-26T16:43:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589809b5e0 con 0x7f589812cbd0 2021-05-26T16:43:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589812d8f0 con 0x7f5898099eb0 2021-05-26T16:43:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.270+0000 7f589c981700 10 monclient(hunting): authenticate will time out at 969.901944s 2021-05-26T16:43:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.271+0000 7f5896ffd700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f5898099a30 0x7f5898131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54510/0 (socket says 172.21.15.3:54510) 2021-05-26T16:43:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.271+0000 7f5896ffd700 1 -- 172.21.15.3:0/3577097910 learned_addr learned my addr 172.21.15.3:0/3577097910 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.273+0000 7f5896ffd700 1 -- 172.21.15.3:0/3577097910 >> v1:172.21.15.3:6790/0 conn(0x7f5898099a30 legacy=0x7f5898131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.273+0000 7f58977fe700 1 -- 172.21.15.3:0/3577097910 >> v1:172.21.15.137:6790/0 conn(0x7f589812cbd0 legacy=0x7f589812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.273+0000 7f5897fff700 1 -- 172.21.15.3:0/3577097910 >> v1:172.21.15.137:6791/0 conn(0x7f5898099eb0 legacy=0x7f5898135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50510452 0 0) 0x7f589812d8f0 con 0x7f5898099eb0 2021-05-26T16:43:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 10 monclient(hunting): my global_id is 5162 2021-05-26T16:43:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c003270 con 0x7f5898099eb0 2021-05-26T16:43:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686060584 0 0) 0x7f589809b5e0 con 0x7f589812cbd0 2021-05-26T16:43:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 10 monclient(hunting): my global_id is 5016 2021-05-26T16:43:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.477+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f589812d8f0 con 0x7f589812cbd0 2021-05-26T16:43:32.483 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34830]: starting. 2021-05-26T16:43:32.483 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34830]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34828 2021-05-26T16:43:32.483 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34830]: shutting down. 2021-05-26T16:43:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079567432 0 0) 0x7f587c003270 con 0x7f5898099eb0 2021-05-26T16:43:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 >> v1:172.21.15.137:6790/0 conn(0x7f589812cbd0 legacy=0x7f589812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 >> v1:172.21.15.3:6790/0 conn(0x7f5898099a30 legacy=0x7f5898131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 1 monclient: found mon.noname-h 2021-05-26T16:43:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.137:6791/0 2021-05-26T16:43:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589809c2b0 con 0x7f5898099eb0 2021-05-26T16:43:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f588c001d60 con 0x7f5898099eb0 2021-05-26T16:43:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2021-05-26T16:43:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f58967fc700 10 monclient: dump: 2021-05-26T16:43:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.490 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.490 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.490 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.490 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.490 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.491 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f589c981700 5 monclient: authenticate success, global_id 5162 2021-05-26T16:43:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.478+0000 7f589c981700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 <== mon.5 v1:172.21.15.137:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f588c002070 con 0x7f5898099eb0 2021-05-26T16:43:32.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f58967fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:32.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f58967fc700 1 -- 172.21.15.3:0/3577097910 <== mon.5 v1:172.21.15.137:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f588c0025c0 con 0x7f5898099eb0 2021-05-26T16:43:32.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f58967fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f58967fc700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:32.492 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f58967fc700 10 monclient: dump: 2021-05-26T16:43:32.493 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.493 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.493 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.493 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.494 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.494 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.494 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.494 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.494 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.495 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.495 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.495 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.495 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.495 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.496 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f589c981700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.479+0000 7f589c981700 4 set_mon_vals no callback set 2021-05-26T16:43:32.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.480+0000 7f589c981700 10 monclient: shutdown 2021-05-26T16:43:32.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.480+0000 7f589c981700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:32.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.480+0000 7f589c981700 1 -- 172.21.15.3:0/3577097910 >> v1:172.21.15.137:6791/0 conn(0x7f5898099eb0 legacy=0x7f5898135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.482+0000 7f589c981700 1 -- 172.21.15.3:0/3577097910 shutdown_connections 2021-05-26T16:43:32.497 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.482+0000 7f589c981700 1 -- 172.21.15.3:0/3577097910 >> 172.21.15.3:0/3577097910 conn(0x7f58980a00c0 msgr2=0x7f58980a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.482+0000 7f589c981700 1 -- 172.21.15.3:0/3577097910 shutdown_connections 2021-05-26T16:43:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.482+0000 7f589c981700 1 -- 172.21.15.3:0/3577097910 wait complete. 2021-05-26T16:43:32.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.483+0000 7f589c981700 10 monclient: build_initial_monmap 2021-05-26T16:43:32.506 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.483+0000 7f589c981700 10 monclient: monmap: 2021-05-26T16:43:32.507 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:32.507 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:32.507 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:32.510 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.484+0000 7f589c981700 1 Processor -- start 2021-05-26T16:43:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.484+0000 7f589c981700 1 -- start start 2021-05-26T16:43:32.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.484+0000 7f589c981700 10 monclient: init 2021-05-26T16:43:32.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:32.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 10 monclient: _add_conns ranks=[4,5,1,6,2,7,0,3,8] 2021-05-26T16:43:32.511 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 10 monclient(hunting): picked mon.noname-c con 0x7f5898099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 10 monclient(hunting): picked mon.noname-h con 0x7f5898099eb0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 10 monclient(hunting): picked mon.noname-f con 0x7f589812cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589809b850 con 0x7f589812cbd0 2021-05-26T16:43:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5898141070 con 0x7f5898099a30 2021-05-26T16:43:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5898069150 con 0x7f5898099eb0 2021-05-26T16:43:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f589c981700 10 monclient(hunting): authenticate will time out at 970.116183s 2021-05-26T16:43:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f58977fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f5898099a30 0x7f5898140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:37984/0 (socket says 172.21.15.3:37984) 2021-05-26T16:43:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.485+0000 7f58977fe700 1 -- 172.21.15.3:0/1019303412 learned_addr learned my addr 172.21.15.3:0/1019303412 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f58977fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6791/0 conn(0x7f5898099a30 legacy=0x7f5898140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f5896ffd700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.137:6791/0 conn(0x7f5898099eb0 legacy=0x7f5898140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f5897fff700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.137:6789/0 conn(0x7f589812cbd0 legacy=0x7f58981486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120577534 0 0) 0x7f5898141070 con 0x7f5898099a30 2021-05-26T16:43:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f58837fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f58837fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f58837fe700 10 monclient(hunting): my global_id is 5107 2021-05-26T16:43:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.487+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5878003270 con 0x7f5898099a30 2021-05-26T16:43:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103033053 0 0) 0x7f5898069150 con 0x7f5898099eb0 2021-05-26T16:43:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): my global_id is 5171 2021-05-26T16:43:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5898141070 con 0x7f5898099eb0 2021-05-26T16:43:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862130261 0 0) 0x7f589809b850 con 0x7f589812cbd0 2021-05-26T16:43:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): my global_id is 4996 2021-05-26T16:43:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5898069150 con 0x7f589812cbd0 2021-05-26T16:43:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2669093208 0 0) 0x7f5878003270 con 0x7f5898099a30 2021-05-26T16:43:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f589809b850 con 0x7f5898099a30 2021-05-26T16:43:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5884001d00 con 0x7f5898099a30 2021-05-26T16:43:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:43:32.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): dump: 2021-05-26T16:43:32.519 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.519 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.519 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.522 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:32.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4007391243 0 0) 0x7f5898141070 con 0x7f5898099eb0 2021-05-26T16:43:32.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5878003270 con 0x7f5898099eb0 2021-05-26T16:43:32.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5888001c50 con 0x7f5898099eb0 2021-05-26T16:43:32.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): dump: 2021-05-26T16:43:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.527 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3425970146 0 0) 0x7f5898069150 con 0x7f589812cbd0 2021-05-26T16:43:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5898141070 con 0x7f589812cbd0 2021-05-26T16:43:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f588c0025c0 con 0x7f589812cbd0 2021-05-26T16:43:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:32.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient(hunting): dump: 2021-05-26T16:43:32.529 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.529 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.529 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.529 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.530 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.530 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.530 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.530 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.530 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.532 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.532 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.532 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2068543587 0 0) 0x7f5878003270 con 0x7f5898099eb0 2021-05-26T16:43:32.532 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6791/0 conn(0x7f5898099a30 legacy=0x7f5898140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.137:6789/0 conn(0x7f589812cbd0 legacy=0x7f58981486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient: _finish_hunting 0 2021-05-26T16:43:32.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 monclient: found mon.h 2021-05-26T16:43:32.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:32.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:43:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.137:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980693f0 con 0x7f5898099eb0 2021-05-26T16:43:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 10 monclient: _finish_auth 0 2021-05-26T16:43:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f589c981700 5 monclient: authenticate success, global_id 5171 2021-05-26T16:43:32.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f589c981700 10 monclient: _renew_subs 2021-05-26T16:43:32.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f589c981700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:43:32.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.137:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898067240 con 0x7f5898099eb0 2021-05-26T16:43:32.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f589c981700 10 monclient: _renew_subs 2021-05-26T16:43:32.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f589c981700 10 monclient: _send_mon_message to mon.h at v1:172.21.15.137:6791/0 2021-05-26T16:43:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.137:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5898069930 con 0x7f5898099eb0 2021-05-26T16:43:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.488+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f58880048a0 con 0x7f5898099eb0 2021-05-26T16:43:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58837fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5888004dd0 con 0x7f5898099eb0 2021-05-26T16:43:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58837fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58957fa700 4 set_mon_vals no callback set 2021-05-26T16:43:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58837fe700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58837fe700 10 monclient: dump: 2021-05-26T16:43:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.540 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.540 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.540 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.540 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.540 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.541 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f5888004fb0 con 0x7f5898099eb0 2021-05-26T16:43:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f589c981700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f58700065a0 con 0x7f5870002840 2021-05-26T16:43:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.489+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.5 v1:172.21.15.137:6791/0 8 ==== osd_map(115..115 src has 1..115) v4 ==== 3549+0+0 (unknown 1233996175 0 0) 0x7f588803d830 con 0x7f5898099eb0 2021-05-26T16:43:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.490+0000 7f5897fff700 10 monclient: get_auth_request con 0x7f5878033360 auth_method 0 2021-05-26T16:43:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58977fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6793/0 conn(0x7f5870002840 legacy=0x7f5870004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974068144 0 0) 0x7f58700065a0 con 0x7f5870002840 2021-05-26T16:43:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 10 monclient(hunting): my global_id is 104273 2021-05-26T16:43:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5878003270 con 0x7f5870002840 2021-05-26T16:43:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3717333623 0 0) 0x7f5878003270 con 0x7f5870002840 2021-05-26T16:43:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58700065a0 con 0x7f5870002840 2021-05-26T16:43:32.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5884001fb0 con 0x7f5870002840 2021-05-26T16:43:32.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:32.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 10 monclient: dump: 2021-05-26T16:43:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.548 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 887964872 0 0) 0x7f58700065a0 con 0x7f5870002840 2021-05-26T16:43:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.492+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5870009e40 con 0x7f5870002840 2021-05-26T16:43:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.493+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f5884002a40 con 0x7f5870002840 2021-05-26T16:43:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.493+0000 7f58837fe700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.493+0000 7f58837fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.493+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6793/0 conn(0x7f5870002840 legacy=0x7f5870004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.493+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6793/0 conn(0x7f5870002840 legacy=0x7f5870004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.500+0000 7f589c981700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.500+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5870009ad0 con 0x7f5870008d90 2021-05-26T16:43:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58977fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6793/0 conn(0x7f5870008d90 legacy=0x7f5870009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855794379 0 0) 0x7f5870009ad0 con 0x7f5870008d90 2021-05-26T16:43:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 10 monclient(hunting): my global_id is 104291 2021-05-26T16:43:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58700065a0 con 0x7f5870008d90 2021-05-26T16:43:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1125971568 0 0) 0x7f58700065a0 con 0x7f5870008d90 2021-05-26T16:43:32.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5870009ad0 con 0x7f5870008d90 2021-05-26T16:43:32.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5884002d50 con 0x7f5870008d90 2021-05-26T16:43:32.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:32.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 10 monclient: dump: 2021-05-26T16:43:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.556 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.556 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 710536020 0 0) 0x7f5870009ad0 con 0x7f5870008d90 2021-05-26T16:43:32.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.503+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 --> v1:172.21.15.3:6793/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5870008740 con 0x7f5870008d90 2021-05-26T16:43:32.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 1452219980) 0x7f5884007ae0 con 0x7f5870008d90 2021-05-26T16:43:32.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f58837fe700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:32.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f58837fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:32.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6793/0 conn(0x7f5870008d90 legacy=0x7f5870009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f58837fe700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.3:6793/0 conn(0x7f5870008d90 legacy=0x7f5870009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:32.558 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:32.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:32.559 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:32.559 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:32.559 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:32.559 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:32.560 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:32.560 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:32.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:32.560 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:32.560 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:32.561 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:32.561 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:32.561 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:32.561 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:32.562 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.562 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 7, 2021-05-26T16:43:32.562 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:32.562 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:32.563 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:32.563 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.563 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.563 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.563 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.564 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.564 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.564 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.564 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.565 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.565 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.565 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:32.565 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:32.565 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.566 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.566 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.566 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.566 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.566 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.567 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.567 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.567 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.567 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.568 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:32.568 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:32.568 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:32.568 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:32.569 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:32.569 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:32.569 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:32.569 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:32.569 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:32.570 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:32.570 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:32.570 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:32.570 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:32.571 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:32.571 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:32.571 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.571 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.572 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.572 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.572 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.572 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.572 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.573 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.573 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.573 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.573 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:32.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.574 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:32.574 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.574 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:32.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:32.575 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.575 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.575 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.575 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.575 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:32.576 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.576 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.576 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.577 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:32.577 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:32.577 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.577 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.577 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.578 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.578 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:32.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:32.579 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.579 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.579 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.579 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.579 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:32.580 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.580 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.580 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.580 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:32.581 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:32.581 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.581 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.581 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.582 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.582 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:32.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:32.582 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.583 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.583 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.583 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.583 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:32.584 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.584 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.584 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.584 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:32.585 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:32.585 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.585 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.585 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.586 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.586 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:32.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:32.586 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.587 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.587 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.587 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.587 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:32.588 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.588 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.588 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.588 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:32.589 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:32.589 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.589 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.589 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.590 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.590 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:32.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:32.590 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.591 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.591 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.591 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.591 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:32.591 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.592 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.592 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.592 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:32.592 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:32.593 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.593 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.593 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.593 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.594 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:32.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:32.594 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.594 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.595 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.595 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.595 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:32.595 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.595 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.596 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.596 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:32.596 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:32.597 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.597 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.597 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.597 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.598 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:32.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:32.598 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.598 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.599 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.599 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.599 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:32.599 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.599 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.600 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.600 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:32.600 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:32.600 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.601 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.601 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.601 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.603 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.603 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:32.603 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.603 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.603 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.604 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:32.604 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:32.604 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.605 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.605 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.605 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.605 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:32.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:32.606 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.606 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.606 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.607 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.607 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:32.607 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.607 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.607 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.608 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:32.608 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:32.608 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.608 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.609 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.609 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.609 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.610 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:32.610 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:32.610 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.610 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:32.610 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:32.611 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:32.611 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.611 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.611 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:32.611 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.612 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:32.612 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:32.612 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:32.612 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.613 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.613 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:32.613 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.137:6812/30003 conn(0x7f5878033360 legacy=0x7f5878035820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f589c981700 10 monclient: shutdown 2021-05-26T16:43:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f589c981700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 >> v1:172.21.15.137:6791/0 conn(0x7f5898099eb0 legacy=0x7f5898140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.504+0000 7f5897fff700 1 -- 172.21.15.3:0/1019303412 reap_dead start 2021-05-26T16:43:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.505+0000 7f5897fff700 1 -- 172.21.15.3:0/1019303412 reap_dead start 2021-05-26T16:43:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.505+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 shutdown_connections 2021-05-26T16:43:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.505+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 >> 172.21.15.3:0/1019303412 conn(0x7f58980a00c0 msgr2=0x7f5898097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.505+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 shutdown_connections 2021-05-26T16:43:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.505+0000 7f589c981700 1 -- 172.21.15.3:0/1019303412 wait complete. 2021-05-26T16:43:32.618 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2021-05-26T16:43:32.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.735+0000 7fef75d9a700 10 monclient: get_monmap_and_config 2021-05-26T16:43:32.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.735+0000 7fef75d9a700 10 monclient: build_initial_monmap 2021-05-26T16:43:32.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.735+0000 7fef75d9a700 10 monclient: monmap: 2021-05-26T16:43:32.738 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:32.738 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.738 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:32.735619+0000 2021-05-26T16:43:32.738 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:32.735619+0000 2021-05-26T16:43:32.739 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:32.739 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.739 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:32.739 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:32.740 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:32.740 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:32.740 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:32.740 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:32.740 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:32.741 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:32.741 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:32.741 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.735+0000 7fef75d9a700 1 Processor -- start 2021-05-26T16:43:32.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.735+0000 7fef75d9a700 1 -- start start 2021-05-26T16:43:32.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.735+0000 7fef75d9a700 10 monclient: init 2021-05-26T16:43:32.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:32.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 10 monclient: _add_conns ranks=[6,1,0,4,5,3,8,2,7] 2021-05-26T16:43:32.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 10 monclient(hunting): picked mon.noname-d con 0x7fef70063e20 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:32.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 10 monclient(hunting): picked mon.noname-f con 0x7fef70094c80 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:32.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 10 monclient(hunting): picked mon.noname-a con 0x7fef700996d0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:32.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70059750 con 0x7fef700996d0 2021-05-26T16:43:32.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70064830 con 0x7fef70094c80 2021-05-26T16:43:32.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70064ad0 con 0x7fef70063e20 2021-05-26T16:43:32.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:32.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef75d9a700 10 monclient(hunting): authenticate will time out at 970.367357s 2021-05-26T16:43:32.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef6ffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fef700996d0 0x7fef70135b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52488/0 (socket says 172.21.15.3:52488) 2021-05-26T16:43:32.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.736+0000 7fef6ffff700 1 -- 172.21.15.3:0/630752621 learned_addr learned my addr 172.21.15.3:0/630752621 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:32.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6ffff700 1 -- 172.21.15.3:0/630752621 >> v1:172.21.15.3:6789/0 conn(0x7fef700996d0 legacy=0x7fef70135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6f7fe700 1 -- 172.21.15.3:0/630752621 >> v1:172.21.15.3:6792/0 conn(0x7fef70063e20 legacy=0x7fef700988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962297256 0 0) 0x7fef70059750 con 0x7fef700996d0 2021-05-26T16:43:32.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 10 monclient(hunting): my global_id is 104274 2021-05-26T16:43:32.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef5c003270 con 0x7fef700996d0 2021-05-26T16:43:32.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6effd700 1 -- 172.21.15.3:0/630752621 >> v1:172.21.15.137:6789/0 conn(0x7fef70094c80 legacy=0x7fef70098fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523058527 0 0) 0x7fef70064ad0 con 0x7fef70063e20 2021-05-26T16:43:32.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 10 monclient(hunting): my global_id is 5019 2021-05-26T16:43:32.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.738+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef70059750 con 0x7fef70063e20 2021-05-26T16:43:32.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313606157 0 0) 0x7fef70059750 con 0x7fef70063e20 2021-05-26T16:43:32.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 >> v1:172.21.15.137:6789/0 conn(0x7fef70094c80 legacy=0x7fef70098fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 >> v1:172.21.15.3:6789/0 conn(0x7fef700996d0 legacy=0x7fef70135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:32.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 monclient: found mon.noname-d 2021-05-26T16:43:32.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:32.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:43:32.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70064d70 con 0x7fef70063e20 2021-05-26T16:43:32.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:32.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:32.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef64001ab0 con 0x7fef70063e20 2021-05-26T16:43:32.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 5 monclient: authenticate success, global_id 5019 2021-05-26T16:43:32.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:32.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:32.762 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: dump: 2021-05-26T16:43:32.762 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.762 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.763 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.763 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.763 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.763 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.763 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.764 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.764 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.764 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.764 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.764 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.765 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.765 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.765 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.765 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:32.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6f7fe700 1 --1- 172.21.15.3:0/630752621 >> v1:172.21.15.3:6792/0 conn(0x7fef70063e20 0x7fef700988b0 :-1 s=OPENED pgs=248 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7fef64001f00 config(0 keys) v1 2021-05-26T16:43:32.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fef64001f00 con 0x7fef70063e20 2021-05-26T16:43:32.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:32.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:32.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 4 set_mon_vals no callback set 2021-05-26T16:43:32.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 10 monclient: shutdown 2021-05-26T16:43:32.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:32.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 1 -- 172.21.15.3:0/630752621 >> v1:172.21.15.3:6792/0 conn(0x7fef70063e20 legacy=0x7fef700988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 1 -- 172.21.15.3:0/630752621 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef640023b0 con 0x7fef70063e20 2021-05-26T16:43:32.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef6e7fc700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:43:32.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 1 -- 172.21.15.3:0/630752621 shutdown_connections 2021-05-26T16:43:32.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 1 -- 172.21.15.3:0/630752621 >> 172.21.15.3:0/630752621 conn(0x7fef7009a9b0 msgr2=0x7fef7009ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:32.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 1 -- 172.21.15.3:0/630752621 shutdown_connections 2021-05-26T16:43:32.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.739+0000 7fef75d9a700 1 -- 172.21.15.3:0/630752621 wait complete. 2021-05-26T16:43:32.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.740+0000 7fef75d9a700 10 monclient: build_initial_monmap 2021-05-26T16:43:32.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.740+0000 7fef75d9a700 10 monclient: monmap: 2021-05-26T16:43:32.770 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:32.770 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:32.770 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:32.770 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:32.771 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:32.771 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.771 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:32.771 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:32.772 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:32.772 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:32.772 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:32.772 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:32.772 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:32.773 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:32.773 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:32.773 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.740+0000 7fef75d9a700 1 Processor -- start 2021-05-26T16:43:32.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.740+0000 7fef75d9a700 1 -- start start 2021-05-26T16:43:32.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.740+0000 7fef75d9a700 10 monclient: init 2021-05-26T16:43:32.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:32.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 10 monclient: _add_conns ranks=[5,6,0,4,2,8,1,7,3] 2021-05-26T16:43:32.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 10 monclient(hunting): picked mon.noname-h con 0x7fef70063e20 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 10 monclient(hunting): picked mon.noname-d con 0x7fef70094c80 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 10 monclient(hunting): picked mon.noname-a con 0x7fef700996d0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7011a270 con 0x7fef700996d0 2021-05-26T16:43:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7011a4a0 con 0x7fef70063e20 2021-05-26T16:43:32.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70097a80 con 0x7fef70094c80 2021-05-26T16:43:32.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:32.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef75d9a700 10 monclient(hunting): authenticate will time out at 970.372323s 2021-05-26T16:43:32.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef6effd700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fef70094c80 0x7fef701412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57892/0 (socket says 172.21.15.3:57892) 2021-05-26T16:43:32.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef6effd700 1 -- 172.21.15.3:0/1979794544 learned_addr learned my addr 172.21.15.3:0/1979794544 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.741+0000 7fef6ffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fef700996d0 0x7fef70144a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52494/0 (socket says 172.21.15.3:52494) 2021-05-26T16:43:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef6ffff700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.3:6789/0 conn(0x7fef700996d0 legacy=0x7fef70144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef6effd700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.3:6792/0 conn(0x7fef70094c80 legacy=0x7fef701412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793151363 0 0) 0x7fef7011a270 con 0x7fef700996d0 2021-05-26T16:43:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 10 monclient(hunting): my global_id is 104283 2021-05-26T16:43:32.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef50003270 con 0x7fef700996d0 2021-05-26T16:43:32.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367324154 0 0) 0x7fef70097a80 con 0x7fef70094c80 2021-05-26T16:43:32.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 10 monclient(hunting): my global_id is 5028 2021-05-26T16:43:32.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef6f7fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6791/0 conn(0x7fef70063e20 legacy=0x7fef7012cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.743+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef7011a270 con 0x7fef70094c80 2021-05-26T16:43:32.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4015657115 0 0) 0x7fef7011a270 con 0x7fef70094c80 2021-05-26T16:43:32.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef70097a80 con 0x7fef70094c80 2021-05-26T16:43:32.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3472536818 0 0) 0x7fef50003270 con 0x7fef700996d0 2021-05-26T16:43:32.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef7011a270 con 0x7fef700996d0 2021-05-26T16:43:32.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef58001f00 con 0x7fef70094c80 2021-05-26T16:43:32.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:32.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): dump: 2021-05-26T16:43:32.782 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.782 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.782 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.782 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.783 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.783 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.783 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.783 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.783 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.784 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.784 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.784 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.784 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.785 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef60002010 con 0x7fef700996d0 2021-05-26T16:43:32.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:32.786 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): dump: 2021-05-26T16:43:32.786 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.787 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.787 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.787 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.787 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.787 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.788 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.788 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.788 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.788 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.789 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.789 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.789 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.789 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.789 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.790 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182144303 0 0) 0x7fef7011a4a0 con 0x7fef70063e20 2021-05-26T16:43:32.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient(hunting): my global_id is 5198 2021-05-26T16:43:32.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef50003270 con 0x7fef70063e20 2021-05-26T16:43:32.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2660803829 0 0) 0x7fef70097a80 con 0x7fef70094c80 2021-05-26T16:43:32.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6791/0 conn(0x7fef70063e20 legacy=0x7fef7012cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.3:6789/0 conn(0x7fef700996d0 legacy=0x7fef70144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient: _finish_hunting 0 2021-05-26T16:43:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 monclient: found mon.d 2021-05-26T16:43:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:32.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:32.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70069870 con 0x7fef70094c80 2021-05-26T16:43:32.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient: _finish_auth 0 2021-05-26T16:43:32.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:32.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef75d9a700 5 monclient: authenticate success, global_id 5028 2021-05-26T16:43:32.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef75d9a700 10 monclient: _renew_subs 2021-05-26T16:43:32.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef75d9a700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:32.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef70118f00 con 0x7fef70094c80 2021-05-26T16:43:32.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef75d9a700 10 monclient: _renew_subs 2021-05-26T16:43:32.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef75d9a700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7012d4f0 con 0x7fef70094c80 2021-05-26T16:43:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fef580024c0 con 0x7fef70094c80 2021-05-26T16:43:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef58002970 con 0x7fef70094c80 2021-05-26T16:43:32.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef6dffb700 4 set_mon_vals no callback set 2021-05-26T16:43:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.744+0000 7fef577fe700 10 monclient: dump: 2021-05-26T16:43:32.796 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.797 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.797 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.797 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.797 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.798 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.798 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.798 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.798 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.798 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.799 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.799 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.799 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.799 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.800 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.800 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.745+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fef58002b50 con 0x7fef70094c80 2021-05-26T16:43:32.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.745+0000 7fef75d9a700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:32.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.745+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fef480065a0 con 0x7fef48002840 2021-05-26T16:43:32.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.745+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(115..115 src has 1..115) v4 ==== 3549+0+0 (unknown 1233996175 0 0) 0x7fef5803d850 con 0x7fef70094c80 2021-05-26T16:43:32.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.745+0000 7fef6ffff700 10 monclient: get_auth_request con 0x7fef50033020 auth_method 0 2021-05-26T16:43:32.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.747+0000 7fef6f7fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6789/0 conn(0x7fef48002840 legacy=0x7fef48004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.747+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539098547 0 0) 0x7fef480065a0 con 0x7fef48002840 2021-05-26T16:43:32.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.747+0000 7fef577fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.747+0000 7fef577fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.747+0000 7fef577fe700 10 monclient(hunting): my global_id is 5032 2021-05-26T16:43:32.802 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.747+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef70097a80 con 0x7fef48002840 2021-05-26T16:43:32.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.747+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 468381761 0 0) 0x7fef70097a80 con 0x7fef48002840 2021-05-26T16:43:32.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef480065a0 con 0x7fef48002840 2021-05-26T16:43:32.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef640023f0 con 0x7fef48002840 2021-05-26T16:43:32.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.803 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:32.804 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 10 monclient: dump: 2021-05-26T16:43:32.804 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.804 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.804 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.805 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.805 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.805 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.805 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.805 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.806 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.806 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.806 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.806 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.806 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.807 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.807 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.807 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.807 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1498116113 0 0) 0x7fef480065a0 con 0x7fef48002840 2021-05-26T16:43:32.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef48009e40 con 0x7fef48002840 2021-05-26T16:43:32.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fef64001870 con 0x7fef48002840 2021-05-26T16:43:32.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:32.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:32.808 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6789/0 conn(0x7fef48002840 legacy=0x7fef48004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.748+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6789/0 conn(0x7fef48002840 legacy=0x7fef48004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:32.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.755+0000 7fef75d9a700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:32.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.755+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fef48009ab0 con 0x7fef48008d70 2021-05-26T16:43:32.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.757+0000 7fef6f7fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6789/0 conn(0x7fef48008d70 legacy=0x7fef48009200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.757+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326133053 0 0) 0x7fef48009ab0 con 0x7fef48008d70 2021-05-26T16:43:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.757+0000 7fef577fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.757+0000 7fef577fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.757+0000 7fef577fe700 10 monclient(hunting): my global_id is 5041 2021-05-26T16:43:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.757+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef480065a0 con 0x7fef48008d70 2021-05-26T16:43:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 399554827 0 0) 0x7fef480065a0 con 0x7fef48008d70 2021-05-26T16:43:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef48009ab0 con 0x7fef48008d70 2021-05-26T16:43:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fef64002c30 con 0x7fef48008d70 2021-05-26T16:43:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 10 monclient: dump: 2021-05-26T16:43:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:32.816 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:32.816 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:32.816 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:32.816 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:32.817 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1553074264 0 0) 0x7fef48009ab0 con 0x7fef48008d70 2021-05-26T16:43:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 --> v1:172.21.15.137:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fef48008740 con 0x7fef48008d70 2021-05-26T16:43:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 3145116310) 0x7fef64005650 con 0x7fef48008d70 2021-05-26T16:43:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6789/0 conn(0x7fef48008d70 legacy=0x7fef48009200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.758+0000 7fef577fe700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6789/0 conn(0x7fef48008d70 legacy=0x7fef48009200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:32.819 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:32.820 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:32.820 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:32.820 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:32.821 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:32.821 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:32.821 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:32.821 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:32.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:32.822 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:32.822 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:32.822 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:32.822 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:32.823 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:32.823 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:32.823 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.823 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 7, 2021-05-26T16:43:32.824 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:32.824 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:32.824 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:32.824 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.824 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.825 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.825 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.825 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.825 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.826 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.826 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.826 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.826 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.827 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:32.827 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:32.827 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.827 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.828 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.828 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.828 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.828 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.828 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.829 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.829 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.829 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.830 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:32.830 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:32.830 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:32.830 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:32.831 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:32.831 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:32.831 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:32.831 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:32.831 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:32.832 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:32.832 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:32.832 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:32.832 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:32.833 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:32.833 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:32.833 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:32.833 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:32.833 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:32.834 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:32.834 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:32.834 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:32.834 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:32.835 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:32.835 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:32.835 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.835 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:32.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.836 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:32.836 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.836 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:32.836 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:32.837 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.837 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.837 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.837 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.837 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:32.838 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.838 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.838 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.839 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:32.839 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:32.839 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.839 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.840 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.840 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.840 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.840 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:32.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:32.841 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.841 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.841 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.841 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.842 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:32.842 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.842 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.842 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.843 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:32.843 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:32.843 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.843 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.844 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.844 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.844 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:32.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:32.845 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.845 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.845 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.845 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.846 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:32.846 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.846 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.846 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.863 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:32.863 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:32.863 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.864 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.864 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.864 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.864 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:32.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:32.865 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.865 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.865 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.866 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.866 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:32.866 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.866 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.866 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.867 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:32.867 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:32.867 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.868 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.868 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.868 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.868 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:32.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:32.869 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:32.869 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:32.869 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.870 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:32.870 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:32.870 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:32.870 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.870 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.871 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:32.871 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:32.871 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:32.872 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:32.872 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:32.872 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.872 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.873 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:32.873 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:32.873 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.873 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:32.874 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:32.874 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:32.874 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.874 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:32.874 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:32.875 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:32.875 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:32.875 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:32.875 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:43:32.876 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:32.876 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:32.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:32.876 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:32.876 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:32.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.137:6812/30003 conn(0x7fef50033020 legacy=0x7fef500354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 10 monclient: shutdown 2021-05-26T16:43:32.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:32.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 >> v1:172.21.15.3:6792/0 conn(0x7fef70094c80 legacy=0x7fef701412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:32.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef6ffff700 1 -- 172.21.15.3:0/1979794544 reap_dead start 2021-05-26T16:43:32.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef6ffff700 1 -- 172.21.15.3:0/1979794544 reap_dead start 2021-05-26T16:43:32.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 shutdown_connections 2021-05-26T16:43:32.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 >> 172.21.15.3:0/1979794544 conn(0x7fef7009a9b0 msgr2=0x7fef7009c590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:32.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 shutdown_connections 2021-05-26T16:43:32.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.759+0000 7fef75d9a700 1 -- 172.21.15.3:0/1979794544 wait complete. 2021-05-26T16:43:32.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2021-05-26T16:43:32.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.995+0000 7fa8afa52700 10 monclient: get_monmap_and_config 2021-05-26T16:43:32.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.995+0000 7fa8afa52700 10 monclient: build_initial_monmap 2021-05-26T16:43:32.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.995+0000 7fa8afa52700 10 monclient: monmap: 2021-05-26T16:43:32.998 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:32.999 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:32.999 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:32.996096+0000 2021-05-26T16:43:32.999 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:32.996096+0000 2021-05-26T16:43:32.999 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:32.999 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.000 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:33.000 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:33.000 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:33.000 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:33.000 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:33.001 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:33.001 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:33.001 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:33.001 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:33.002 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 1 Processor -- start 2021-05-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 1 -- start start 2021-05-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient: init 2021-05-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient: _add_conns ranks=[2,4,1,8,6,3,7,0,5] 2021-05-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient(hunting): picked mon.noname-b con 0x7fa8a8064a20 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient(hunting): picked mon.noname-c con 0x7fa8a8063e30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient(hunting): picked mon.noname-f con 0x7fa8a80642e0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a8059750 con 0x7fa8a80642e0 2021-05-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a8064e00 con 0x7fa8a8064a20 2021-05-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a809c770 con 0x7fa8a8063e30 2021-05-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8afa52700 10 monclient(hunting): authenticate will time out at 970.627763s 2021-05-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8ad7ee700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fa8a8064a20 0x7fa8a8099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54544/0 (socket says 172.21.15.3:54544) 2021-05-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8acfed700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fa8a8063e30 0x7fa8a8132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38014/0 (socket says 172.21.15.3:38014) 2021-05-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.996+0000 7fa8ad7ee700 1 -- 172.21.15.3:0/1430995971 learned_addr learned my addr 172.21.15.3:0/1430995971 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa8acfed700 1 -- 172.21.15.3:0/1430995971 >> v1:172.21.15.3:6791/0 conn(0x7fa8a8063e30 legacy=0x7fa8a8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa8ad7ee700 1 -- 172.21.15.3:0/1430995971 >> v1:172.21.15.3:6790/0 conn(0x7fa8a8064a20 legacy=0x7fa8a8099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa8adfef700 1 -- 172.21.15.3:0/1430995971 >> v1:172.21.15.137:6789/0 conn(0x7fa8a80642e0 legacy=0x7fa8a81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562585716 0 0) 0x7fa8a809c770 con 0x7fa8a8063e30 2021-05-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa897fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa897fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa897fff700 10 monclient(hunting): my global_id is 5143 2021-05-26T16:43:33.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:32.999+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa890003270 con 0x7fa8a8063e30 2021-05-26T16:43:33.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.002+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597515874 0 0) 0x7fa8a8064e00 con 0x7fa8a8064a20 2021-05-26T16:43:33.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.002+0000 7fa897fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.002+0000 7fa897fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.002+0000 7fa897fff700 10 monclient(hunting): my global_id is 5069 2021-05-26T16:43:33.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.002+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a809c770 con 0x7fa8a8064a20 2021-05-26T16:43:33.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.002+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150606936 0 0) 0x7fa8a8059750 con 0x7fa8a80642e0 2021-05-26T16:43:33.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient(hunting): my global_id is 5050 2021-05-26T16:43:33.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a8064e00 con 0x7fa8a80642e0 2021-05-26T16:43:33.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4191650627 0 0) 0x7fa8a809c770 con 0x7fa8a8064a20 2021-05-26T16:43:33.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 >> v1:172.21.15.3:6791/0 conn(0x7fa8a8063e30 legacy=0x7fa8a8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 >> v1:172.21.15.137:6789/0 conn(0x7fa8a80642e0 legacy=0x7fa8a81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:33.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 monclient: found mon.noname-b 2021-05-26T16:43:33.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:33.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80977a0 con 0x7fa8a8064a20 2021-05-26T16:43:33.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: _finish_auth 0 2021-05-26T16:43:33.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:33.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa89c001a60 con 0x7fa8a8064a20 2021-05-26T16:43:33.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:33.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: dump: 2021-05-26T16:43:33.023 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.024 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.024 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.024 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.024 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.024 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.025 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.025 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.025 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.025 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.025 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.026 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.026 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.026 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.026 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.027 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa8afa52700 5 monclient: authenticate success, global_id 5069 2021-05-26T16:43:33.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa8afa52700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:33.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa89c001d70 con 0x7fa8a8064a20 2021-05-26T16:43:33.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:33.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 1 -- 172.21.15.3:0/1430995971 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa89c004930 con 0x7fa8a8064a20 2021-05-26T16:43:33.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa8afa52700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:33.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa8afa52700 4 set_mon_vals no callback set 2021-05-26T16:43:33.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:33.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa897fff700 10 monclient: dump: 2021-05-26T16:43:33.029 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.029 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.030 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.030 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.030 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.030 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.031 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.031 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.031 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.031 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.031 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.032 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.032 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.032 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.032 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.033 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa8afa52700 10 monclient: shutdown 2021-05-26T16:43:33.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa8afa52700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:33.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.003+0000 7fa8afa52700 1 -- 172.21.15.3:0/1430995971 >> v1:172.21.15.3:6790/0 conn(0x7fa8a8064a20 legacy=0x7fa8a8099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.004+0000 7fa8afa52700 1 -- 172.21.15.3:0/1430995971 shutdown_connections 2021-05-26T16:43:33.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.004+0000 7fa8afa52700 1 -- 172.21.15.3:0/1430995971 >> 172.21.15.3:0/1430995971 conn(0x7fa8a80a0db0 msgr2=0x7fa8a809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:33.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.004+0000 7fa8afa52700 1 -- 172.21.15.3:0/1430995971 shutdown_connections 2021-05-26T16:43:33.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.004+0000 7fa8afa52700 1 -- 172.21.15.3:0/1430995971 wait complete. 2021-05-26T16:43:33.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.004+0000 7fa8afa52700 10 monclient: build_initial_monmap 2021-05-26T16:43:33.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.004+0000 7fa8afa52700 10 monclient: monmap: 2021-05-26T16:43:33.035 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:33.035 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:33.035 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:33.035 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:33.036 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:33.036 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.036 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:33.036 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:33.036 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:33.037 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:33.037 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:33.037 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:33.037 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:33.038 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:33.038 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:33.038 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 1 Processor -- start 2021-05-26T16:43:33.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 1 -- start start 2021-05-26T16:43:33.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient: init 2021-05-26T16:43:33.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:33.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient: _add_conns ranks=[2,8,1,6,7,3,5,4,0] 2021-05-26T16:43:33.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient(hunting): picked mon.noname-b con 0x7fa8a8063e30 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:33.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient(hunting): picked mon.noname-e con 0x7fa8a80642e0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:33.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient(hunting): picked mon.noname-f con 0x7fa8a8064a20 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:33.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a8116cf0 con 0x7fa8a8064a20 2021-05-26T16:43:33.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a809c180 con 0x7fa8a8063e30 2021-05-26T16:43:33.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a8116f20 con 0x7fa8a80642e0 2021-05-26T16:43:33.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:33.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8afa52700 10 monclient(hunting): authenticate will time out at 970.636838s 2021-05-26T16:43:33.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8acfed700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fa8a80642e0 0x7fa8a81410e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53586/0 (socket says 172.21.15.3:53586) 2021-05-26T16:43:33.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.005+0000 7fa8acfed700 1 -- 172.21.15.3:0/367641047 learned_addr learned my addr 172.21.15.3:0/367641047 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:33.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8ad7ee700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.3:6790/0 conn(0x7fa8a8063e30 legacy=0x7fa8a8129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8acfed700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.3:6793/0 conn(0x7fa8a80642e0 legacy=0x7fa8a81410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8adfef700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6789/0 conn(0x7fa8a8064a20 legacy=0x7fa8a8144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284039190 0 0) 0x7fa8a809c180 con 0x7fa8a8063e30 2021-05-26T16:43:33.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): my global_id is 5078 2021-05-26T16:43:33.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa888003270 con 0x7fa8a8063e30 2021-05-26T16:43:33.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906241128 0 0) 0x7fa8a8116f20 con 0x7fa8a80642e0 2021-05-26T16:43:33.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): my global_id is 104300 2021-05-26T16:43:33.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a809c180 con 0x7fa8a80642e0 2021-05-26T16:43:33.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768136905 0 0) 0x7fa8a8116cf0 con 0x7fa8a8064a20 2021-05-26T16:43:33.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): my global_id is 5059 2021-05-26T16:43:33.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a8116f20 con 0x7fa8a8064a20 2021-05-26T16:43:33.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3849926576 0 0) 0x7fa888003270 con 0x7fa8a8063e30 2021-05-26T16:43:33.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa8a8116cf0 con 0x7fa8a8063e30 2021-05-26T16:43:33.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa89c001a90 con 0x7fa8a8063e30 2021-05-26T16:43:33.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:33.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): dump: 2021-05-26T16:43:33.047 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.047 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.047 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.047 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.047 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.048 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.048 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.048 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.048 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.048 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.049 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.049 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.049 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.049 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.049 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.050 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:33.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3912890202 0 0) 0x7fa8a809c180 con 0x7fa8a80642e0 2021-05-26T16:43:33.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa888003270 con 0x7fa8a80642e0 2021-05-26T16:43:33.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa898001360 con 0x7fa8a80642e0 2021-05-26T16:43:33.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:33.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): dump: 2021-05-26T16:43:33.051 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.052 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.052 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.052 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.052 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.052 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.053 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.053 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.053 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.053 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.053 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.054 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.054 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.054 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.054 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.054 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 281277342 0 0) 0x7fa8a8116f20 con 0x7fa8a8064a20 2021-05-26T16:43:33.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa8a809c180 con 0x7fa8a8064a20 2021-05-26T16:43:33.055 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa8a4002280 con 0x7fa8a8064a20 2021-05-26T16:43:33.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:33.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient(hunting): dump: 2021-05-26T16:43:33.056 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.056 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.057 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.057 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.057 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.057 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.058 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.058 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.058 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.058 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.058 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.059 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.059 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.059 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.059 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.060 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2885762765 0 0) 0x7fa8a8116cf0 con 0x7fa8a8063e30 2021-05-26T16:43:33.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.3:6793/0 conn(0x7fa8a80642e0 legacy=0x7fa8a81410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6789/0 conn(0x7fa8a8064a20 legacy=0x7fa8a8144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient: _finish_hunting 0 2021-05-26T16:43:33.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 monclient: found mon.b 2021-05-26T16:43:33.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:33.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a81171c0 con 0x7fa8a8063e30 2021-05-26T16:43:33.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient: _finish_auth 0 2021-05-26T16:43:33.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:33.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8afa52700 5 monclient: authenticate success, global_id 5078 2021-05-26T16:43:33.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8afa52700 10 monclient: _renew_subs 2021-05-26T16:43:33.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8afa52700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a812f430 con 0x7fa8a8063e30 2021-05-26T16:43:33.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8afa52700 10 monclient: _renew_subs 2021-05-26T16:43:33.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8afa52700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a812a050 con 0x7fa8a8063e30 2021-05-26T16:43:33.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa89c004c20 con 0x7fa8a8063e30 2021-05-26T16:43:33.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:33.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa89c0050d0 con 0x7fa8a8063e30 2021-05-26T16:43:33.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8977fe700 4 set_mon_vals no callback set 2021-05-26T16:43:33.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.008+0000 7fa8957fa700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:33.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.009+0000 7fa8957fa700 10 monclient: dump: 2021-05-26T16:43:33.065 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.065 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.066 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.066 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.066 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.066 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.067 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.067 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.067 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.067 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.067 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.068 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.068 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.068 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.068 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.069 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.009+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fa89c0052b0 con 0x7fa8a8063e30 2021-05-26T16:43:33.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.009+0000 7fa8afa52700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:33.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.009+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa8800065a0 con 0x7fa880002840 2021-05-26T16:43:33.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.009+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(115..115 src has 1..115) v4 ==== 3549+0+0 (unknown 1233996175 0 0) 0x7fa89c03d970 con 0x7fa8a8063e30 2021-05-26T16:43:33.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.009+0000 7fa8adfef700 10 monclient: get_auth_request con 0x7fa8880333b0 auth_method 0 2021-05-26T16:43:33.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8acfed700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6790/0 conn(0x7fa880002840 legacy=0x7fa880004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515247498 0 0) 0x7fa8800065a0 con 0x7fa880002840 2021-05-26T16:43:33.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 10 monclient(hunting): my global_id is 5025 2021-05-26T16:43:33.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a8116cf0 con 0x7fa880002840 2021-05-26T16:43:33.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2698059413 0 0) 0x7fa8a8116cf0 con 0x7fa880002840 2021-05-26T16:43:33.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa8800065a0 con 0x7fa880002840 2021-05-26T16:43:33.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa898004bb0 con 0x7fa880002840 2021-05-26T16:43:33.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:33.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 10 monclient: dump: 2021-05-26T16:43:33.073 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.073 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.073 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.073 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.073 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.074 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.074 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.074 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.074 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.075 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.075 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.075 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.075 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.075 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.076 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.076 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2459462962 0 0) 0x7fa8800065a0 con 0x7fa880002840 2021-05-26T16:43:33.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.012+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa880009e40 con 0x7fa880002840 2021-05-26T16:43:33.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.013+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fa8980050a0 con 0x7fa880002840 2021-05-26T16:43:33.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.013+0000 7fa8957fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:33.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.013+0000 7fa8957fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:33.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.013+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6790/0 conn(0x7fa880002840 legacy=0x7fa880004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.013+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6790/0 conn(0x7fa880002840 legacy=0x7fa880004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:33.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.019+0000 7fa8afa52700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:33.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.019+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa880007510 con 0x7fa8800068b0 2021-05-26T16:43:33.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8acfed700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6790/0 conn(0x7fa8800068b0 legacy=0x7fa880006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625282926 0 0) 0x7fa880007510 con 0x7fa8800068b0 2021-05-26T16:43:33.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 10 monclient(hunting): my global_id is 5034 2021-05-26T16:43:33.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8800065a0 con 0x7fa8800068b0 2021-05-26T16:43:33.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3539489825 0 0) 0x7fa8800065a0 con 0x7fa8800068b0 2021-05-26T16:43:33.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa880007510 con 0x7fa8800068b0 2021-05-26T16:43:33.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa898005800 con 0x7fa8800068b0 2021-05-26T16:43:33.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:33.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.022+0000 7fa8957fa700 10 monclient: dump: 2021-05-26T16:43:33.083 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.083 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.083 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.083 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.083 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.084 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.084 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.084 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.084 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.085 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.085 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.085 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.085 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.085 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.086 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.086 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2815160455 0 0) 0x7fa880007510 con 0x7fa8800068b0 2021-05-26T16:43:33.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 --> v1:172.21.15.137:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa880008770 con 0x7fa8800068b0 2021-05-26T16:43:33.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7662 (unknown 0 0 2046660829) 0x7fa898005a30 con 0x7fa8800068b0 2021-05-26T16:43:33.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8957fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:33.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8957fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:33.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6790/0 conn(0x7fa8800068b0 legacy=0x7fa880006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.087 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8957fa700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6790/0 conn(0x7fa8800068b0 legacy=0x7fa880006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:33.088 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:33.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:33.088 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:33.089 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:33.089 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:33.089 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:33.089 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:33.089 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:33.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:33.090 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:33.090 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:33.090 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:33.091 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:33.091 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:33.091 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:33.091 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.091 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 7, 2021-05-26T16:43:33.092 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:33.092 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:33.092 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:33.092 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.093 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.093 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.093 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.093 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.093 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.094 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.094 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.094 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.094 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.095 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:33.095 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:33.095 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.095 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.095 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.096 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.096 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.096 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.096 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.097 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.097 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.097 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.097 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:33.098 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:33.098 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:33.098 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:33.098 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:33.099 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:33.099 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:33.099 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:33.099 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:33.099 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:33.100 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:33.100 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:33.100 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:33.100 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:33.100 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:33.101 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.101 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.101 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.101 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.102 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.102 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.102 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.102 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.102 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.103 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.103 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:33.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.103 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:33.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.104 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:33.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:33.104 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.104 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.105 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.105 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:33.105 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.106 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.106 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.106 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:33.107 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:33.107 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.107 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.107 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.108 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.108 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:33.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:33.108 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.109 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.109 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.109 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.109 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:33.109 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.110 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.110 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.110 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:33.110 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:33.111 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.111 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.111 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.111 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.112 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:33.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:33.112 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.112 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.113 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.113 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.113 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:33.113 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.113 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.114 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.114 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:33.114 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:33.114 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.115 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.115 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.115 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.116 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:33.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:33.116 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.116 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.116 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.117 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.117 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:33.117 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.117 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.117 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.118 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:33.118 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:33.118 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.119 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.119 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.119 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.119 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:33.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:33.120 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.120 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.121 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.121 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:33.121 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.121 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.121 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.122 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:33.122 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:33.122 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.122 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.123 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.123 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.123 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:33.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:33.124 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.124 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.124 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.124 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.125 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:33.125 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.125 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.125 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.126 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:33.126 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:33.126 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.126 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.127 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.127 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:33.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:33.128 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.128 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.128 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.128 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.129 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:33.129 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.129 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.129 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.130 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:33.130 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:33.130 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.130 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.131 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.131 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.131 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:33.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:33.132 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.132 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.132 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.132 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.133 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:33.133 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.133 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.133 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.134 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:33.134 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:33.134 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.134 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.135 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.135 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.135 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:33.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:33.136 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.136 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.136 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.136 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.136 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:33.137 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.137 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.137 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:33.138 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:33.138 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.138 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.138 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.138 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.139 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.139 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:33.139 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:33.140 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.140 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.140 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.140 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:33.140 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.141 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.141 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:33.141 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.141 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.141 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.142 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4 2021-05-26T16:43:33.142 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.142 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.142 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:33.143 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.143 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.143 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.143 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:33.143 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.144 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.144 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": [ 2021-05-26T16:43:33.144 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.144 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.144 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.145 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:33.145 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.145 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.145 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:33.146 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.137:6812/30003 conn(0x7fa8880333b0 legacy=0x7fa888035870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8afa52700 10 monclient: shutdown 2021-05-26T16:43:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8afa52700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 >> v1:172.21.15.3:6790/0 conn(0x7fa8a8063e30 legacy=0x7fa8a8129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8adfef700 1 -- 172.21.15.3:0/367641047 reap_dead start 2021-05-26T16:43:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8adfef700 1 -- 172.21.15.3:0/367641047 reap_dead start 2021-05-26T16:43:33.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 shutdown_connections 2021-05-26T16:43:33.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.023+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 >> 172.21.15.3:0/367641047 conn(0x7fa8a80a0db0 msgr2=0x7fa8a809ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:33.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.024+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 shutdown_connections 2021-05-26T16:43:33.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.024+0000 7fa8afa52700 1 -- 172.21.15.3:0/367641047 wait complete. 2021-05-26T16:43:33.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2021-05-26T16:43:33.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.265+0000 7fbb835df700 10 monclient: get_monmap_and_config 2021-05-26T16:43:33.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.265+0000 7fbb835df700 10 monclient: build_initial_monmap 2021-05-26T16:43:33.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.265+0000 7fbb835df700 10 monclient: monmap: 2021-05-26T16:43:33.268 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:33.268 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.268 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:33.265770+0000 2021-05-26T16:43:33.269 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:33.265770+0000 2021-05-26T16:43:33.269 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:33.269 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.269 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:33.269 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:33.270 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:33.270 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:33.270 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:33.270 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:33.271 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:33.271 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:33.271 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:33.271 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.265+0000 7fbb835df700 1 Processor -- start 2021-05-26T16:43:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.265+0000 7fbb835df700 1 -- start start 2021-05-26T16:43:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.265+0000 7fbb835df700 10 monclient: init 2021-05-26T16:43:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 10 monclient: _add_conns ranks=[1,2,3,8,6,5,0,4,7] 2021-05-26T16:43:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 10 monclient(hunting): picked mon.noname-f con 0x7fbb7c096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 10 monclient(hunting): picked mon.noname-b con 0x7fbb7c12d460 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 10 monclient(hunting): picked mon.noname-g con 0x7fbb7c12d910 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c059750 con 0x7fbb7c096ca0 2021-05-26T16:43:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c09c760 con 0x7fbb7c12d460 2021-05-26T16:43:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c09ca00 con 0x7fbb7c12d910 2021-05-26T16:43:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb835df700 10 monclient(hunting): authenticate will time out at 970.897480s 2021-05-26T16:43:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb80b7a700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fbb7c12d460 0x7fbb7c1320e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54562/0 (socket says 172.21.15.3:54562) 2021-05-26T16:43:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.266+0000 7fbb80b7a700 1 -- 172.21.15.3:0/2693790698 learned_addr learned my addr 172.21.15.3:0/2693790698 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:33.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb80b7a700 1 -- 172.21.15.3:0/2693790698 >> v1:172.21.15.3:6790/0 conn(0x7fbb7c12d460 legacy=0x7fbb7c1320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb81b7c700 1 -- 172.21.15.3:0/2693790698 >> v1:172.21.15.137:6790/0 conn(0x7fbb7c12d910 legacy=0x7fbb7c135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb8137b700 1 -- 172.21.15.3:0/2693790698 >> v1:172.21.15.137:6789/0 conn(0x7fbb7c096ca0 legacy=0x7fbb7c12cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388158809 0 0) 0x7fbb7c09c760 con 0x7fbb7c12d460 2021-05-26T16:43:33.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb6bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb6bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb6bfff700 10 monclient(hunting): my global_id is 5087 2021-05-26T16:43:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.268+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb64003270 con 0x7fbb7c12d460 2021-05-26T16:43:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1324478123 0 0) 0x7fbb64003270 con 0x7fbb7c12d460 2021-05-26T16:43:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 >> v1:172.21.15.137:6790/0 conn(0x7fbb7c12d910 legacy=0x7fbb7c135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 >> v1:172.21.15.137:6789/0 conn(0x7fbb7c096ca0 legacy=0x7fbb7c12cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 monclient: found mon.noname-b 2021-05-26T16:43:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:33.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c097730 con 0x7fbb7c12d460 2021-05-26T16:43:33.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: _finish_auth 0 2021-05-26T16:43:33.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb6c001a60 con 0x7fbb7c12d460 2021-05-26T16:43:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: dump: 2021-05-26T16:43:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.292 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.292 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.292 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.292 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.292 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.294 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 5 monclient: authenticate success, global_id 5087 2021-05-26T16:43:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850699069 0 0) 0x7fbb7c09ca00 con 0x7fbb7c12d910 2021-05-26T16:43:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:33.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:43:33.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbb6c001d70 con 0x7fbb7c12d460 2021-05-26T16:43:33.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:33.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 1 -- 172.21.15.3:0/2693790698 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb6c004930 con 0x7fbb7c12d460 2021-05-26T16:43:33.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:33.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 4 set_mon_vals no callback set 2021-05-26T16:43:33.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:33.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb6bfff700 10 monclient: dump: 2021-05-26T16:43:33.297 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.297 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.297 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.297 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.297 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.298 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.298 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.298 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.298 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.299 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.299 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.299 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.299 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.299 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.300 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.300 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 10 monclient: shutdown 2021-05-26T16:43:33.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:33.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 1 -- 172.21.15.3:0/2693790698 >> v1:172.21.15.3:6790/0 conn(0x7fbb7c12d460 legacy=0x7fbb7c1320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 1 -- 172.21.15.3:0/2693790698 shutdown_connections 2021-05-26T16:43:33.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 1 -- 172.21.15.3:0/2693790698 >> 172.21.15.3:0/2693790698 conn(0x7fbb7c0a00e0 msgr2=0x7fbb7c0a04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:33.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 1 -- 172.21.15.3:0/2693790698 shutdown_connections 2021-05-26T16:43:33.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.269+0000 7fbb835df700 1 -- 172.21.15.3:0/2693790698 wait complete. 2021-05-26T16:43:33.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.270+0000 7fbb835df700 10 monclient: build_initial_monmap 2021-05-26T16:43:33.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.270+0000 7fbb835df700 10 monclient: monmap: 2021-05-26T16:43:33.302 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:33.302 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:33.303 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:33.303 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:33.303 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:33.303 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.303 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:33.304 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:33.304 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:33.304 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:33.304 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:33.304 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:33.305 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:33.305 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:33.305 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:33.305 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.270+0000 7fbb835df700 1 Processor -- start 2021-05-26T16:43:33.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.270+0000 7fbb835df700 1 -- start start 2021-05-26T16:43:33.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.270+0000 7fbb835df700 10 monclient: init 2021-05-26T16:43:33.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:33.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 10 monclient: _add_conns ranks=[2,6,3,5,8,4,0,1,7] 2021-05-26T16:43:33.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 10 monclient(hunting): picked mon.noname-b con 0x7fbb7c096ca0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:33.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 10 monclient(hunting): picked mon.noname-d con 0x7fbb7c12d460 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:33.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 10 monclient(hunting): picked mon.noname-g con 0x7fbb7c12d910 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:33.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c0943f0 con 0x7fbb7c096ca0 2021-05-26T16:43:33.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c116c80 con 0x7fbb7c12d910 2021-05-26T16:43:33.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c116f20 con 0x7fbb7c12d460 2021-05-26T16:43:33.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:33.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb835df700 10 monclient(hunting): authenticate will time out at 970.902379s 2021-05-26T16:43:33.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb8137b700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fbb7c096ca0 0x7fbb7c0935d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54566/0 (socket says 172.21.15.3:54566) 2021-05-26T16:43:33.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.271+0000 7fbb8137b700 1 -- 172.21.15.3:0/3719914618 learned_addr learned my addr 172.21.15.3:0/3719914618 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:33.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb8137b700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.3:6790/0 conn(0x7fbb7c096ca0 legacy=0x7fbb7c0935d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb80b7a700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.3:6792/0 conn(0x7fbb7c12d460 legacy=0x7fbb7c093ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb81b7c700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6790/0 conn(0x7fbb7c12d910 legacy=0x7fbb7c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933000913 0 0) 0x7fbb7c0943f0 con 0x7fbb7c096ca0 2021-05-26T16:43:33.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): my global_id is 5096 2021-05-26T16:43:33.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb5c003270 con 0x7fbb7c096ca0 2021-05-26T16:43:33.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679773321 0 0) 0x7fbb7c116f20 con 0x7fbb7c12d460 2021-05-26T16:43:33.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): my global_id is 5037 2021-05-26T16:43:33.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c0943f0 con 0x7fbb7c12d460 2021-05-26T16:43:33.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714134702 0 0) 0x7fbb7c116c80 con 0x7fbb7c12d910 2021-05-26T16:43:33.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 10 monclient(hunting): my global_id is 5052 2021-05-26T16:43:33.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.273+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c116f20 con 0x7fbb7c12d910 2021-05-26T16:43:33.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 942216548 0 0) 0x7fbb5c003270 con 0x7fbb7c096ca0 2021-05-26T16:43:33.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb7c116c80 con 0x7fbb7c096ca0 2021-05-26T16:43:33.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb70001ce0 con 0x7fbb7c096ca0 2021-05-26T16:43:33.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:33.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): dump: 2021-05-26T16:43:33.314 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.314 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.315 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.315 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.315 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.315 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.316 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.316 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.316 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.316 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.316 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.317 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.317 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.317 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.317 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.317 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:33.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 451166278 0 0) 0x7fbb7c0943f0 con 0x7fbb7c12d460 2021-05-26T16:43:33.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb5c003270 con 0x7fbb7c12d460 2021-05-26T16:43:33.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb6c004870 con 0x7fbb7c12d460 2021-05-26T16:43:33.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:33.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): dump: 2021-05-26T16:43:33.319 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.319 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.320 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.320 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.320 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.320 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.322 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2232009499 0 0) 0x7fbb7c116f20 con 0x7fbb7c12d910 2021-05-26T16:43:33.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb7c0943f0 con 0x7fbb7c12d910 2021-05-26T16:43:33.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb78001fc0 con 0x7fbb7c12d910 2021-05-26T16:43:33.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:33.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient(hunting): dump: 2021-05-26T16:43:33.324 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.324 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.324 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.325 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.325 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.325 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.325 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.326 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.326 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.326 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.326 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.326 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.327 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.327 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.327 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.327 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1049432943 0 0) 0x7fbb7c116c80 con 0x7fbb7c096ca0 2021-05-26T16:43:33.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.3:6792/0 conn(0x7fbb7c12d460 legacy=0x7fbb7c093ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6790/0 conn(0x7fbb7c12d910 legacy=0x7fbb7c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient: _finish_hunting 0 2021-05-26T16:43:33.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 monclient: found mon.b 2021-05-26T16:43:33.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:33.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0950a0 con 0x7fbb7c096ca0 2021-05-26T16:43:33.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient: _finish_auth 0 2021-05-26T16:43:33.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:33.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb835df700 5 monclient: authenticate success, global_id 5096 2021-05-26T16:43:33.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb835df700 10 monclient: _renew_subs 2021-05-26T16:43:33.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb835df700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c095da0 con 0x7fbb7c096ca0 2021-05-26T16:43:33.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb835df700 10 monclient: _renew_subs 2021-05-26T16:43:33.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb835df700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:33.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c1174a0 con 0x7fbb7c096ca0 2021-05-26T16:43:33.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbb70002440 con 0x7fbb7c096ca0 2021-05-26T16:43:33.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:33.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb700028f0 con 0x7fbb7c096ca0 2021-05-26T16:43:33.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb6b7fe700 4 set_mon_vals no callback set 2021-05-26T16:43:33.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:33.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.274+0000 7fbb697fa700 10 monclient: dump: 2021-05-26T16:43:33.333 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.333 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.333 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.333 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.334 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.334 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.334 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.334 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.334 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.335 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.335 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.335 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.335 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.335 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.336 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.336 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.275+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fbb70002b10 con 0x7fbb7c096ca0 2021-05-26T16:43:33.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.275+0000 7fbb835df700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:33.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.275+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbb540065a0 con 0x7fbb54002840 2021-05-26T16:43:33.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.275+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(115..115 src has 1..115) v4 ==== 3549+0+0 (unknown 1233996175 0 0) 0x7fbb7003d870 con 0x7fbb7c096ca0 2021-05-26T16:43:33.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.275+0000 7fbb80b7a700 10 monclient: get_auth_request con 0x7fbb5c033380 auth_method 0 2021-05-26T16:43:33.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.277+0000 7fbb81b7c700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6791/0 conn(0x7fbb54002840 legacy=0x7fbb54004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426849812 0 0) 0x7fbb540065a0 con 0x7fbb54002840 2021-05-26T16:43:33.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient(hunting): my global_id is 5207 2021-05-26T16:43:33.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c116c80 con 0x7fbb54002840 2021-05-26T16:43:33.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 700725545 0 0) 0x7fbb7c116c80 con 0x7fbb54002840 2021-05-26T16:43:33.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb540065a0 con 0x7fbb54002840 2021-05-26T16:43:33.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb780027b0 con 0x7fbb54002840 2021-05-26T16:43:33.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:33.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient: dump: 2021-05-26T16:43:33.340 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.340 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.340 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.340 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.341 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.341 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.341 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.341 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.342 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.342 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.342 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.342 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.342 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.343 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.343 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.343 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1285093313 0 0) 0x7fbb540065a0 con 0x7fbb54002840 2021-05-26T16:43:33.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb54009e40 con 0x7fbb54002840 2021-05-26T16:43:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fbb78002da0 con 0x7fbb54002840 2021-05-26T16:43:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6791/0 conn(0x7fbb54002840 legacy=0x7fbb54004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.278+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6791/0 conn(0x7fbb54002840 legacy=0x7fbb54004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.285+0000 7fbb835df700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.285+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbb54007510 con 0x7fbb540068b0 2021-05-26T16:43:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb81b7c700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6791/0 conn(0x7fbb540068b0 legacy=0x7fbb54006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326796874 0 0) 0x7fbb54007510 con 0x7fbb540068b0 2021-05-26T16:43:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 10 monclient(hunting): my global_id is 5216 2021-05-26T16:43:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb540065a0 con 0x7fbb540068b0 2021-05-26T16:43:33.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3547782625 0 0) 0x7fbb540065a0 con 0x7fbb540068b0 2021-05-26T16:43:33.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb54007510 con 0x7fbb540068b0 2021-05-26T16:43:33.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbb78005bd0 con 0x7fbb540068b0 2021-05-26T16:43:33.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:33.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 10 monclient: dump: 2021-05-26T16:43:33.350 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.350 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.350 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.352 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.352 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.352 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.352 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.353 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.353 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.353 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.353 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3397421699 0 0) 0x7fbb54007510 con 0x7fbb540068b0 2021-05-26T16:43:33.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.288+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 --> v1:172.21.15.137:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbb54008770 con 0x7fbb540068b0 2021-05-26T16:43:33.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 328400053) 0x7fbb78006000 con 0x7fbb540068b0 2021-05-26T16:43:33.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb697fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:33.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb697fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:33.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6791/0 conn(0x7fbb540068b0 legacy=0x7fbb54006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb697fa700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6791/0 conn(0x7fbb540068b0 legacy=0x7fbb54006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:33.355 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:33.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:33.356 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:33.356 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:33.356 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:33.356 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:33.357 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:33.357 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:33.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:33.357 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:33.357 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:33.358 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:33.358 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:33.358 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:33.358 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:33.359 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.359 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 8, 2021-05-26T16:43:33.359 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:33.359 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:33.359 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:33.360 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.360 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.360 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.360 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.361 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.361 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.361 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.362 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.362 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.362 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.363 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:33.363 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:33.364 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.364 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.364 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.365 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.365 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.366 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.366 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.367 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.367 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.367 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.368 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:33.369 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:33.369 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:33.369 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:33.370 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:33.370 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:33.371 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:33.371 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:33.372 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:33.372 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:33.372 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:33.373 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:33.373 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:33.374 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:33.374 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:33.375 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.375 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.375 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.376 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.376 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.377 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.377 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.378 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.378 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.378 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.378 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:33.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.379 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:33.379 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.379 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:33.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:33.380 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.380 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.380 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.380 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.380 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:33.381 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.381 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.381 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.381 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:33.382 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:33.382 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.382 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.382 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.383 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:33.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:33.384 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.384 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.384 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.384 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.384 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:33.385 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.385 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.385 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.385 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:33.386 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:33.386 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.386 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.386 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.387 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.387 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:33.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:33.387 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.388 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.388 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.388 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.388 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:33.388 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.389 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.389 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.389 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:33.389 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:33.390 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.390 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.390 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.390 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.391 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:33.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:33.391 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.391 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.392 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.392 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.392 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:33.392 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.392 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.393 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.393 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:33.393 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:33.393 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.394 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.394 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.394 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.395 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:33.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:33.395 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.395 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.395 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.396 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.396 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:33.396 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.396 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.396 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.397 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:33.397 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:33.397 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.397 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.398 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.398 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:33.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:33.399 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.399 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.399 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.399 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.400 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:33.400 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.400 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.400 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.401 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:33.401 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:33.401 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.401 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.402 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.402 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.402 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:33.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:33.403 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.403 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.403 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.403 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.403 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:33.404 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.404 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.404 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.405 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:33.405 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:33.405 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.405 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.405 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.406 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.406 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:33.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:33.406 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.407 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.407 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.407 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.407 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:33.408 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.408 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.408 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.408 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:33.409 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:33.409 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.409 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.409 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.410 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:33.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:33.410 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.411 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.411 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.411 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.411 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:33.411 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.412 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.412 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.412 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:33.413 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:33.413 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.413 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.413 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.413 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.414 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.414 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:33.414 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:33.415 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.415 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.415 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.415 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:33.415 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.416 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.416 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:33.416 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.416 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.416 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.417 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:33.417 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.417 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.417 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:33.417 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.418 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.418 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.418 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:43:33.418 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.419 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.419 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:33.419 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:33.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.137:6812/30003 conn(0x7fbb5c033380 legacy=0x7fbb5c035840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 10 monclient: shutdown 2021-05-26T16:43:33.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:33.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 >> v1:172.21.15.3:6790/0 conn(0x7fbb7c096ca0 legacy=0x7fbb7c0935d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb81b7c700 1 -- 172.21.15.3:0/3719914618 reap_dead start 2021-05-26T16:43:33.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb81b7c700 1 -- 172.21.15.3:0/3719914618 reap_dead start 2021-05-26T16:43:33.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 shutdown_connections 2021-05-26T16:43:33.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 >> 172.21.15.3:0/3719914618 conn(0x7fbb7c0a00e0 msgr2=0x7fbb7c09e340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:33.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 shutdown_connections 2021-05-26T16:43:33.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.289+0000 7fbb835df700 1 -- 172.21.15.3:0/3719914618 wait complete. 2021-05-26T16:43:33.424 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2021-05-26T16:43:33.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.546+0000 7faef9726700 10 monclient: get_monmap_and_config 2021-05-26T16:43:33.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.546+0000 7faef9726700 10 monclient: build_initial_monmap 2021-05-26T16:43:33.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.546+0000 7faef9726700 10 monclient: monmap: 2021-05-26T16:43:33.549 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:33.547196+0000 2021-05-26T16:43:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:33.547196+0000 2021-05-26T16:43:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:33.553 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:33.553 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 1 Processor -- start 2021-05-26T16:43:33.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 1 -- start start 2021-05-26T16:43:33.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient: init 2021-05-26T16:43:33.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:33.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient: _add_conns ranks=[8,7,4,6,0,5,2,3,1] 2021-05-26T16:43:33.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient(hunting): picked mon.noname-e con 0x7faef412cbd0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:33.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient(hunting): picked mon.noname-i con 0x7faef4099a30 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:33.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient(hunting): picked mon.noname-c con 0x7faef4099eb0 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:33.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef4046600 con 0x7faef4099eb0 2021-05-26T16:43:33.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef409b5e0 con 0x7faef4099a30 2021-05-26T16:43:33.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef412d8f0 con 0x7faef412cbd0 2021-05-26T16:43:33.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:33.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.547+0000 7faef9726700 10 monclient(hunting): authenticate will time out at 971.178906s 2021-05-26T16:43:33.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.548+0000 7faef3fff700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7faef412cbd0 0x7faef412d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53620/0 (socket says 172.21.15.3:53620) 2021-05-26T16:43:33.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.548+0000 7faef3fff700 1 -- 172.21.15.3:0/3733678014 learned_addr learned my addr 172.21.15.3:0/3733678014 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:33.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.548+0000 7faef8f25700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7faef4099eb0 0x7faef4135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38056/0 (socket says 172.21.15.3:38056) 2021-05-26T16:43:33.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef3fff700 1 -- 172.21.15.3:0/3733678014 >> v1:172.21.15.3:6793/0 conn(0x7faef412cbd0 legacy=0x7faef412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef8f25700 1 -- 172.21.15.3:0/3733678014 >> v1:172.21.15.3:6791/0 conn(0x7faef4099eb0 legacy=0x7faef4135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997350087 0 0) 0x7faef412d8f0 con 0x7faef412cbd0 2021-05-26T16:43:33.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient(hunting): my global_id is 104309 2021-05-26T16:43:33.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed8003270 con 0x7faef412cbd0 2021-05-26T16:43:33.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977995845 0 0) 0x7faef4046600 con 0x7faef4099eb0 2021-05-26T16:43:33.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient(hunting): my global_id is 5152 2021-05-26T16:43:33.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef412d8f0 con 0x7faef4099eb0 2021-05-26T16:43:33.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef37fe700 1 -- 172.21.15.3:0/3733678014 >> v1:172.21.15.137:6792/0 conn(0x7faef4099a30 legacy=0x7faef4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3456483446 0 0) 0x7faed8003270 con 0x7faef412cbd0 2021-05-26T16:43:33.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 >> v1:172.21.15.137:6792/0 conn(0x7faef4099a30 legacy=0x7faef4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 >> v1:172.21.15.3:6791/0 conn(0x7faef4099eb0 legacy=0x7faef4135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:33.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 monclient: found mon.noname-e 2021-05-26T16:43:33.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:33.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:43:33.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef409c2b0 con 0x7faef412cbd0 2021-05-26T16:43:33.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient: _finish_auth 0 2021-05-26T16:43:33.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:33.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee0001a60 con 0x7faef412cbd0 2021-05-26T16:43:33.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef9726700 5 monclient: authenticate success, global_id 104309 2021-05-26T16:43:33.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef9726700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:33.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:33.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient: dump: 2021-05-26T16:43:33.574 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.574 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.575 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.575 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.575 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.575 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.576 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.576 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.576 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.576 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.577 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.577 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.577 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.577 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.577 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.578 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef9726700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:33.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef3fff700 1 --1- 172.21.15.3:0/3733678014 >> v1:172.21.15.3:6793/0 conn(0x7faef412cbd0 0x7faef412d1e0 :-1 s=OPENED pgs=120 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7faee0004930 mon_map magic: 0 v1 2021-05-26T16:43:33.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faee0001d70 con 0x7faef412cbd0 2021-05-26T16:43:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef2ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef9726700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.550+0000 7faef9726700 4 set_mon_vals no callback set 2021-05-26T16:43:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 10 monclient: shutdown 2021-05-26T16:43:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 1 -- 172.21.15.3:0/3733678014 >> v1:172.21.15.3:6793/0 conn(0x7faef412cbd0 legacy=0x7faef412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef2ffd700 1 -- 172.21.15.3:0/3733678014 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee0004930 con 0x7faef412cbd0 2021-05-26T16:43:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef2ffd700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:43:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 1 -- 172.21.15.3:0/3733678014 shutdown_connections 2021-05-26T16:43:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 1 -- 172.21.15.3:0/3733678014 >> 172.21.15.3:0/3733678014 conn(0x7faef40a00c0 msgr2=0x7faef40a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 1 -- 172.21.15.3:0/3733678014 shutdown_connections 2021-05-26T16:43:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 1 -- 172.21.15.3:0/3733678014 wait complete. 2021-05-26T16:43:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 10 monclient: build_initial_monmap 2021-05-26T16:43:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.551+0000 7faef9726700 10 monclient: monmap: 2021-05-26T16:43:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:33.585 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 1 Processor -- start 2021-05-26T16:43:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 1 -- start start 2021-05-26T16:43:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient: init 2021-05-26T16:43:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient: _add_conns ranks=[6,8,4,2,0,1,3,5,7] 2021-05-26T16:43:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient(hunting): picked mon.noname-d con 0x7faef4099a30 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient(hunting): picked mon.noname-e con 0x7faef4099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient(hunting): picked mon.noname-c con 0x7faef412cbd0 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef4094560 con 0x7faef412cbd0 2021-05-26T16:43:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef4116740 con 0x7faef4099a30 2021-05-26T16:43:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef41169e0 con 0x7faef4099eb0 2021-05-26T16:43:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef9726700 10 monclient(hunting): authenticate will time out at 971.183750s 2021-05-26T16:43:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef3fff700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7faef4099a30 0x7faef4093740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57946/0 (socket says 172.21.15.3:57946) 2021-05-26T16:43:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef8f25700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7faef412cbd0 0x7faef41441c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38060/0 (socket says 172.21.15.3:38060) 2021-05-26T16:43:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.552+0000 7faef3fff700 1 -- 172.21.15.3:0/659347846 learned_addr learned my addr 172.21.15.3:0/659347846 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:33.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef37fe700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.3:6793/0 conn(0x7faef4099eb0 legacy=0x7faef4093e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef8f25700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.3:6791/0 conn(0x7faef412cbd0 legacy=0x7faef41441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef3fff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.3:6792/0 conn(0x7faef4099a30 legacy=0x7faef4093740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588879634 0 0) 0x7faef4094560 con 0x7faef412cbd0 2021-05-26T16:43:33.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): my global_id is 5161 2021-05-26T16:43:33.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed4003270 con 0x7faef412cbd0 2021-05-26T16:43:33.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650210914 0 0) 0x7faef41169e0 con 0x7faef4099eb0 2021-05-26T16:43:33.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): my global_id is 104318 2021-05-26T16:43:33.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef4094560 con 0x7faef4099eb0 2021-05-26T16:43:33.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849792255 0 0) 0x7faef4116740 con 0x7faef4099a30 2021-05-26T16:43:33.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): my global_id is 5046 2021-05-26T16:43:33.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef41169e0 con 0x7faef4099a30 2021-05-26T16:43:33.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 606024207 0 0) 0x7faed4003270 con 0x7faef412cbd0 2021-05-26T16:43:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faef4116740 con 0x7faef412cbd0 2021-05-26T16:43:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 107602743 0 0) 0x7faef4094560 con 0x7faef4099eb0 2021-05-26T16:43:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faed4003270 con 0x7faef4099eb0 2021-05-26T16:43:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee80016a0 con 0x7faef412cbd0 2021-05-26T16:43:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:43:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): dump: 2021-05-26T16:43:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.597 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3635950971 0 0) 0x7faef41169e0 con 0x7faef4099a30 2021-05-26T16:43:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faef4094560 con 0x7faef4099a30 2021-05-26T16:43:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee4001ca0 con 0x7faef4099eb0 2021-05-26T16:43:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): dump: 2021-05-26T16:43:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.600 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.600 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.600 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.600 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.601 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.601 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.601 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.601 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.601 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.602 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.602 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.602 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.602 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee0004870 con 0x7faef4099a30 2021-05-26T16:43:33.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:33.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient(hunting): dump: 2021-05-26T16:43:33.603 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.604 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.604 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.604 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.604 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.605 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.605 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.605 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.605 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.605 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.606 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.606 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.606 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.606 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.606 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.607 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2106857412 0 0) 0x7faef4116740 con 0x7faef412cbd0 2021-05-26T16:43:33.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.3:6793/0 conn(0x7faef4099eb0 legacy=0x7faef4093e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.3:6792/0 conn(0x7faef4099a30 legacy=0x7faef4093740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:33.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 monclient: found mon.c 2021-05-26T16:43:33.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:33.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:33.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4116c80 con 0x7faef412cbd0 2021-05-26T16:43:33.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 10 monclient: _finish_auth 0 2021-05-26T16:43:33.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faedffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:33.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef9726700 5 monclient: authenticate success, global_id 5161 2021-05-26T16:43:33.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef9726700 10 monclient: _renew_subs 2021-05-26T16:43:33.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef9726700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef40951c0 con 0x7faef412cbd0 2021-05-26T16:43:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef9726700 10 monclient: _renew_subs 2021-05-26T16:43:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef9726700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:43:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.555+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faef4117040 con 0x7faef412cbd0 2021-05-26T16:43:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faee8004ea0 con 0x7faef412cbd0 2021-05-26T16:43:33.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:33.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee8001d50 con 0x7faef412cbd0 2021-05-26T16:43:33.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:43:33.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faef27fc700 4 set_mon_vals no callback set 2021-05-26T16:43:33.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 10 monclient: dump: 2021-05-26T16:43:33.612 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.612 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.612 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.612 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.613 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.613 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.613 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.613 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.613 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.614 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.614 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.614 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.614 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.614 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.615 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7faee800e760 con 0x7faef412cbd0 2021-05-26T16:43:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faef9726700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7faef406cab0 con 0x7faef409dd10 2021-05-26T16:43:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.556+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(116..116 src has 1..116) v4 ==== 3941+0+0 (unknown 1641460001 0 0) 0x7faee803dd20 con 0x7faef412cbd0 2021-05-26T16:43:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.557+0000 7faef37fe700 10 monclient: get_auth_request con 0x7faed4033410 auth_method 0 2021-05-26T16:43:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faef3fff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.137:6792/0 conn(0x7faef409dd10 legacy=0x7faef409e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021379342 0 0) 0x7faef406cab0 con 0x7faef409dd10 2021-05-26T16:43:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 10 monclient(hunting): my global_id is 104254 2021-05-26T16:43:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef4116740 con 0x7faef409dd10 2021-05-26T16:43:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3952216741 0 0) 0x7faef4116740 con 0x7faef409dd10 2021-05-26T16:43:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faef406cab0 con 0x7faef409dd10 2021-05-26T16:43:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee0001540 con 0x7faef409dd10 2021-05-26T16:43:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 10 monclient: dump: 2021-05-26T16:43:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.620 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.620 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.620 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.620 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.620 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.621 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.621 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.621 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.621 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.621 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.622 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.622 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.622 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 309311507 0 0) 0x7faef406cab0 con 0x7faef409dd10 2021-05-26T16:43:33.622 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.559+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faef406c030 con 0x7faef409dd10 2021-05-26T16:43:33.623 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.560+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7faee00050d0 con 0x7faef409dd10 2021-05-26T16:43:33.623 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.560+0000 7faedffff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:33.623 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.560+0000 7faedffff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:33.623 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.560+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.137:6792/0 conn(0x7faef409dd10 legacy=0x7faef409e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.624 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.560+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.137:6792/0 conn(0x7faef409dd10 legacy=0x7faef409e0f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:33.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.566+0000 7faef9726700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:33.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.566+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7faef4069b10 con 0x7faef4027d00 2021-05-26T16:43:33.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faef3fff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.137:6792/0 conn(0x7faef4027d00 legacy=0x7faef4149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:33.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533611284 0 0) 0x7faef4069b10 con 0x7faef4027d00 2021-05-26T16:43:33.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:33.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:33.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 10 monclient(hunting): my global_id is 104263 2021-05-26T16:43:33.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef406cab0 con 0x7faef4027d00 2021-05-26T16:43:33.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2627439256 0 0) 0x7faef406cab0 con 0x7faef4027d00 2021-05-26T16:43:33.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faef4069b10 con 0x7faef4027d00 2021-05-26T16:43:33.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7faee00058e0 con 0x7faef4027d00 2021-05-26T16:43:33.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:33.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:33.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 10 monclient: dump: 2021-05-26T16:43:33.629 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:33.629 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:33.629 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.630 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:33.630 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:33.630 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:33.630 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:33.630 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:33.631 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:33.631 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:33.631 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:33.631 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:33.631 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:33.632 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:33.632 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:33.632 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:33.633 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 396418144 0 0) 0x7faef4069b10 con 0x7faef4027d00 2021-05-26T16:43:33.633 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.569+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 --> v1:172.21.15.137:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faef41172f0 con 0x7faef4027d00 2021-05-26T16:43:33.633 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 2837390491) 0x7faee0005a90 con 0x7faef4027d00 2021-05-26T16:43:33.634 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faedffff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:33.634 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faedffff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:33.634 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.137:6792/0 conn(0x7faef4027d00 legacy=0x7faef4149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.634 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faedffff700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.137:6792/0 conn(0x7faef4027d00 legacy=0x7faef4149900 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:33.635 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:33.635 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:33.635 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:33.635 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:33.636 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 16, 2021-05-26T16:43:33.636 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:33.636 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:33.636 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:33.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:33.637 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:33.637 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:43:33.637 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:33.637 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:33.637 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:33.638 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:33.638 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.638 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 8, 2021-05-26T16:43:33.638 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:33.639 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:33.639 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:33.639 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.639 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.639 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.640 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.640 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.640 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.640 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.641 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.641 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.641 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.641 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:33.641 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:33.642 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.642 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.642 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.642 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.642 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.643 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.643 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.643 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.643 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.643 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.644 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.644 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:33.644 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:33.644 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:33.644 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:33.645 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:33.645 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:33.645 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:33.645 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:33.645 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:33.646 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:33.646 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:33.646 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:33.646 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:33.647 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:33.647 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:33.647 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:33.647 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:33.647 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:33.648 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:33.648 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:33.648 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:33.648 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:33.649 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:33.649 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:33.649 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.649 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:33.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.650 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:33.650 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.650 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:33.650 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:33.651 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.651 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.651 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.651 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.651 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:33.652 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.652 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.652 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.652 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.652 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:33.653 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:33.653 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.653 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.653 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.654 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.654 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.654 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:33.654 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:33.654 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.655 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.655 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.655 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.655 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:33.655 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.656 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.656 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.656 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.656 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:33.657 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:33.657 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.657 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.657 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.657 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.658 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.658 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:33.658 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:33.658 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.658 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.659 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.659 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.659 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:33.659 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.660 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.660 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.660 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:33.660 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:33.661 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.661 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.661 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.662 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.662 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:33.662 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:33.662 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.662 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.663 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.663 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.663 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:33.663 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.663 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.664 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.664 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.664 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:33.664 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:33.665 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.665 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.665 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.665 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.666 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:33.666 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:33.666 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.666 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.666 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.667 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.667 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:33.667 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.667 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.667 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.668 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.668 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:33.668 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:33.668 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.669 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.669 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.669 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.669 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.669 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:33.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:33.670 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.670 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.670 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.670 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.671 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:33.671 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.671 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.671 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.672 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:33.672 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:33.672 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.672 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.673 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.673 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.673 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.673 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:33.673 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:33.674 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.674 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.674 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.674 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.674 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:33.675 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.675 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.675 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.675 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:33.676 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:33.676 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.676 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.676 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.676 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.677 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.677 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:33.677 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:33.677 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.678 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.678 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.678 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.678 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:33.678 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.679 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.679 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.679 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:33.679 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:33.680 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.680 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.680 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.680 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.680 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.681 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:33.681 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:33.681 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:33.681 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:33.682 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.682 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:33.682 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:33.682 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:33.682 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.683 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.683 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.683 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:33.683 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:33.683 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:33.684 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:33.684 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:33.684 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.684 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.685 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:33.685 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:33.685 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.685 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.686 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.686 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:33.686 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.686 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:33.686 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:33.687 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:33.687 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:33.687 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:33.687 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:33.687 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:33.688 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:33.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:33.688 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:33.688 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:33.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.137:6812/30003 conn(0x7faed4033410 legacy=0x7faed40358d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 10 monclient: shutdown 2021-05-26T16:43:33.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:33.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 >> v1:172.21.15.3:6791/0 conn(0x7faef412cbd0 legacy=0x7faef41441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:33.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef8f25700 1 -- 172.21.15.3:0/659347846 reap_dead start 2021-05-26T16:43:33.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef8f25700 1 -- 172.21.15.3:0/659347846 reap_dead start 2021-05-26T16:43:33.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 shutdown_connections 2021-05-26T16:43:33.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 >> 172.21.15.3:0/659347846 conn(0x7faef40a00c0 msgr2=0x7faef412b060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:33.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 shutdown_connections 2021-05-26T16:43:33.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:33.570+0000 7faef9726700 1 -- 172.21.15.3:0/659347846 wait complete. 2021-05-26T16:43:33.693 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2021-05-26T16:43:33.693 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'i'] 2021-05-26T16:43:33.693 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2021-05-26T16:43:33.693 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-05-26T16:43:33.694 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-05-26T16:43:33.694 INFO:teuthology.orchestra.run:waiting for 300 2021-05-26T16:43:33.704 INFO:tasks.ceph.mon.c:Stopped 2021-05-26T16:43:33.704 INFO:tasks.mon_thrash:Sending STOP to mon a 2021-05-26T16:43:33.705 INFO:tasks.ceph.mon.a:Sent signal 19 2021-05-26T16:43:33.705 INFO:tasks.mon_thrash:Sending STOP to mon i 2021-05-26T16:43:33.705 INFO:tasks.ceph.mon.i:Sent signal 19 2021-05-26T16:43:33.706 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2021-05-26T16:43:43.497 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:43.497 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.498 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:43.498 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:43.498 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:43.499 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:43:43.499 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.499 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:43.499 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:43.500 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:43.500 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:43.500 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.501 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:43.501 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:43.501 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:43.502 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:43.502 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.502 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.503 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.503 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.503 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:43.503 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.504 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.504 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.504 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.504 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:43.504 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.505 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.505 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.506 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.506 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:43.507 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.507 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.508 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.508 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.508 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:43.509 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.509 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.509 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.509 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.510 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:43.510 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.511 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.511 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.511 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.512 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:43.512 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.512 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.512 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.512 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.513 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:43.513 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.513 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:43.513 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:43.514 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:43.514 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:43.514 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.515 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:43.515 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:43.515 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:43.515 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:43.516 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:43.516 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:43.516 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:43.516 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.707 INFO:tasks.mon_thrash:Sending CONT to mon a 2021-05-26T16:43:48.708 INFO:tasks.ceph.mon.a:Sent signal 18 2021-05-26T16:43:48.709 INFO:tasks.mon_thrash:Sending CONT to mon i 2021-05-26T16:43:48.709 INFO:tasks.ceph.mon.i:Sent signal 18 2021-05-26T16:43:48.710 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2021-05-26T16:43:48.711 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:43:48.714 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:48.714 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.715 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.715 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.715 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.715 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:48.716 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.716 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.716 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.716 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.717 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:48.717 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.717 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.718 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.718 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.718 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:48.719 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.719 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.719 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.719 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.720 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:43:48.720 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.721 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.721 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.721 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.722 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:43:48.722 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.722 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.723 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.723 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.723 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:43:48.724 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.724 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.724 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.724 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.725 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:43:48.725 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.726 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.726 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.726 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.727 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:48.727 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.727 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.727 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.728 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.728 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:48.728 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.728 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.728 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.729 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.729 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:43:48.729 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.729 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:43:48.730 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:43:48.730 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:43:48.731 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:48.732 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.732 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:48.732 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:48.732 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:48.733 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:48.733 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.733 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:48.733 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:48.734 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:48.734 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:43:48.734 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.735 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:48.735 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:48.735 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:48.735 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:43:48.736 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.736 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:48.736 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:48.736 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:48.737 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:43:48.737 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.737 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:48.738 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:48.738 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:48.738 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:48.739 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.739 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:48.739 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:48.739 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:48.739 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:43:48.740 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:43:48.740 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:43:48.741 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:43:48.741 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:43:48.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.837+0000 7f492d49a700 10 monclient: get_monmap_and_config 2021-05-26T16:43:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.837+0000 7f492d49a700 10 monclient: build_initial_monmap 2021-05-26T16:43:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.837+0000 7f492d49a700 10 monclient: monmap: 2021-05-26T16:43:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:48.838904+0000 2021-05-26T16:43:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:48.838904+0000 2021-05-26T16:43:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:48.844 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:48.844 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:48.844 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:48.844 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:48.844 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.837+0000 7f492d49a700 1 Processor -- start 2021-05-26T16:43:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.837+0000 7f492d49a700 1 -- start start 2021-05-26T16:43:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.837+0000 7f492d49a700 10 monclient: init 2021-05-26T16:43:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 10 monclient: _add_conns ranks=[4,6,5,7,1,2,3,0,8] 2021-05-26T16:43:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 10 monclient(hunting): picked mon.noname-c con 0x7f4928064aa0 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 10 monclient(hunting): picked mon.noname-d con 0x7f4928099c40 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 10 monclient(hunting): picked mon.noname-h con 0x7f492809a0c0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4928059750 con 0x7f4928064aa0 2021-05-26T16:43:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492809a530 con 0x7f492809a0c0 2021-05-26T16:43:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492809c4e0 con 0x7f4928099c40 2021-05-26T16:43:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f492d49a700 10 monclient(hunting): authenticate will time out at 986.470429s 2021-05-26T16:43:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f4926ffd700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7f4928064aa0 legacy=0x7f4928063f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:48.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f49267fc700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f4928099c40 0x7f4928132070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:57998/0 (socket says 172.21.15.3:57998) 2021-05-26T16:43:48.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.838+0000 7f49267fc700 1 -- 172.21.15.3:0/1846177337 learned_addr learned my addr 172.21.15.3:0/1846177337 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:48.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.840+0000 7f49267fc700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6792/0 conn(0x7f4928099c40 legacy=0x7f4928132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:48.850 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:48.840+0000 7f49277fe700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.137:6791/0 conn(0x7f492809a0c0 legacy=0x7f49281357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:49.039+0000 7f4926ffd700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6791/0 conn(0x7f4928064aa0 legacy=0x7f4928063f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:49.440+0000 7f4926ffd700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6791/0 conn(0x7f4928064aa0 legacy=0x7f4928063f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:50.241+0000 7f4926ffd700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6791/0 conn(0x7f4928064aa0 legacy=0x7f4928063f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:51.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 10 monclient(hunting): tick 2021-05-26T16:43:51.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 1 monclient(hunting): continuing hunt 2021-05-26T16:43:51.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:43:51.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6792/0 conn(0x7f4928099c40 legacy=0x7f4928132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:51.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.137:6791/0 conn(0x7f492809a0c0 legacy=0x7f49281357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:51.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6791/0 conn(0x7f4928064aa0 legacy=0x7f4928063f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:51.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 10 monclient: _add_conns ranks=[8,3,2,0,7,1] 2021-05-26T16:43:51.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 10 monclient(hunting): picked mon.noname-e con 0x7f49080035e0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:51.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 10 monclient(hunting): picked mon.noname-g con 0x7f4908007270 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 10 monclient(hunting): picked mon.noname-b con 0x7f490800afe0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 1 -- 172.21.15.3:0/1846177337 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492809c780 con 0x7f490800afe0 2021-05-26T16:43:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 1 -- 172.21.15.3:0/1846177337 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4928059750 con 0x7f4908007270 2021-05-26T16:43:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 1 -- 172.21.15.3:0/1846177337 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4908010e20 con 0x7f49080035e0 2021-05-26T16:43:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.839+0000 7f4924ff9700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:51.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.841+0000 7f4926ffd700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6793/0 conn(0x7f49080035e0 legacy=0x7f4908005a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:51.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.841+0000 7f49277fe700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6790/0 conn(0x7f490800afe0 legacy=0x7f490800d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:51.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:51.841+0000 7f49267fc700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.137:6790/0 conn(0x7f4908007270 legacy=0x7f4908009710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:53.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.732+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827490197 0 0) 0x7f492809c780 con 0x7f490800afe0 2021-05-26T16:43:53.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.732+0000 7f4925ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:53.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.732+0000 7f4925ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:53.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.732+0000 7f4925ffb700 10 monclient(hunting): my global_id is 5105 2021-05-26T16:43:53.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.732+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4914003270 con 0x7f490800afe0 2021-05-26T16:43:53.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99412496 0 0) 0x7f4928059750 con 0x7f4908007270 2021-05-26T16:43:53.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:53.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:53.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient(hunting): my global_id is 5061 2021-05-26T16:43:53.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f492809c780 con 0x7f4908007270 2021-05-26T16:43:53.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689012489 0 0) 0x7f4908010e20 con 0x7f49080035e0 2021-05-26T16:43:53.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:53.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:53.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient(hunting): my global_id is 104327 2021-05-26T16:43:53.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4928059750 con 0x7f49080035e0 2021-05-26T16:43:53.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2379862868 0 0) 0x7f492809c780 con 0x7f4908007270 2021-05-26T16:43:53.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6793/0 conn(0x7f49080035e0 legacy=0x7f4908005a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:53.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.3:6790/0 conn(0x7f490800afe0 legacy=0x7f490800d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:53.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:53.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 monclient: found mon.noname-g 2021-05-26T16:43:53.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f49277fe700 1 -- 172.21.15.3:0/1846177337 reap_dead start 2021-05-26T16:43:53.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:53.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.137:6790/0 2021-05-26T16:43:53.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080120d0 con 0x7f4908007270 2021-05-26T16:43:53.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:53.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:53.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f491c001a20 con 0x7f4908007270 2021-05-26T16:43:53.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:53.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:43:53.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: dump: 2021-05-26T16:43:53.745 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:53.746 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:53.746 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.746 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.747 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:53.747 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:53.747 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:53.747 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:53.748 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:53.748 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:53.748 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:53.748 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:53.748 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:53.749 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:53.749 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:53.749 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:53.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f492d49a700 5 monclient: authenticate success, global_id 5061 2021-05-26T16:43:53.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f492d49a700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:53.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 <== mon.3 v1:172.21.15.137:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f491c001d30 con 0x7f4908007270 2021-05-26T16:43:53.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:53.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 1 -- 172.21.15.3:0/1846177337 <== mon.3 v1:172.21.15.137:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f491c004930 con 0x7f4908007270 2021-05-26T16:43:53.750 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f492d49a700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:53.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f492d49a700 4 set_mon_vals no callback set 2021-05-26T16:43:53.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:53.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:53.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.733+0000 7f4925ffb700 10 monclient: dump: 2021-05-26T16:43:53.751 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:53.752 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:53.752 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.752 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.752 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:53.752 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:53.753 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:53.753 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:53.753 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:53.753 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:53.753 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:53.754 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:53.754 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:53.754 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:53.754 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:53.755 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:53.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.734+0000 7f492d49a700 10 monclient: shutdown 2021-05-26T16:43:53.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.734+0000 7f492d49a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:53.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.734+0000 7f492d49a700 1 -- 172.21.15.3:0/1846177337 >> v1:172.21.15.137:6790/0 conn(0x7f4908007270 legacy=0x7f4908009710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:53.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.734+0000 7f492d49a700 1 -- 172.21.15.3:0/1846177337 shutdown_connections 2021-05-26T16:43:53.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.734+0000 7f492d49a700 1 -- 172.21.15.3:0/1846177337 >> 172.21.15.3:0/1846177337 conn(0x7f492805e1e0 msgr2=0x7f492809cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:53.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.734+0000 7f492d49a700 1 -- 172.21.15.3:0/1846177337 shutdown_connections 2021-05-26T16:43:53.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.734+0000 7f492d49a700 1 -- 172.21.15.3:0/1846177337 wait complete. 2021-05-26T16:43:53.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.735+0000 7f492d49a700 10 monclient: build_initial_monmap 2021-05-26T16:43:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.735+0000 7f492d49a700 10 monclient: monmap: 2021-05-26T16:43:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:53.759 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:53.759 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:53.759 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:53.759 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:53.760 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:53.760 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:53.760 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:53.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.736+0000 7f492d49a700 1 Processor -- start 2021-05-26T16:43:53.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.736+0000 7f492d49a700 1 -- start start 2021-05-26T16:43:53.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.736+0000 7f492d49a700 10 monclient: init 2021-05-26T16:43:53.761 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:53.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 10 monclient: _add_conns ranks=[2,7,1,6,5,0,4,8,3] 2021-05-26T16:43:53.767 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 10 monclient(hunting): picked mon.noname-b con 0x7f492813c130 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:53.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 10 monclient(hunting): picked mon.noname-i con 0x7f492812a0a0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:53.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 10 monclient(hunting): picked mon.noname-f con 0x7f492813c510 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:53.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4928116e90 con 0x7f492813c510 2021-05-26T16:43:53.768 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4928117130 con 0x7f492813c130 2021-05-26T16:43:53.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49281173d0 con 0x7f492812a0a0 2021-05-26T16:43:53.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:53.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f492d49a700 10 monclient(hunting): authenticate will time out at 991.369388s 2021-05-26T16:43:53.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f4926ffd700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f492813c130 0x7f4928129990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54668/0 (socket says 172.21.15.3:54668) 2021-05-26T16:43:53.769 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.737+0000 7f4926ffd700 1 -- 172.21.15.3:0/614690303 learned_addr learned my addr 172.21.15.3:0/614690303 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:53.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f4926ffd700 1 -- 172.21.15.3:0/614690303 >> v1:172.21.15.3:6790/0 conn(0x7f492813c130 legacy=0x7f4928129990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:53.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f49267fc700 1 -- 172.21.15.3:0/614690303 >> v1:172.21.15.137:6792/0 conn(0x7f492812a0a0 legacy=0x7f4928141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:53.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219572304 0 0) 0x7f4928117130 con 0x7f492813c130 2021-05-26T16:43:53.770 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f490effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:53.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f490effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:53.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f490effd700 10 monclient(hunting): my global_id is 5114 2021-05-26T16:43:53.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f49277fe700 1 -- 172.21.15.3:0/614690303 >> v1:172.21.15.137:6789/0 conn(0x7f492813c510 legacy=0x7f4928144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:53.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.739+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49080100d0 con 0x7f492813c130 2021-05-26T16:43:53.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562591765 0 0) 0x7f49281173d0 con 0x7f492812a0a0 2021-05-26T16:43:53.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:53.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:53.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): my global_id is 104272 2021-05-26T16:43:53.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4928117130 con 0x7f492812a0a0 2021-05-26T16:43:53.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868700229 0 0) 0x7f4928116e90 con 0x7f492813c510 2021-05-26T16:43:53.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:53.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:53.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): my global_id is 5077 2021-05-26T16:43:53.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49281173d0 con 0x7f492813c510 2021-05-26T16:43:53.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1165216876 0 0) 0x7f49080100d0 con 0x7f492813c130 2021-05-26T16:43:53.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4928116e90 con 0x7f492813c130 2021-05-26T16:43:53.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4910004640 con 0x7f492813c130 2021-05-26T16:43:53.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): dump: 2021-05-26T16:43:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:53.777 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:53.777 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:53.777 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:53.777 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:53.777 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:53.778 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:53.778 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:53.778 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:53.778 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:53.778 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:53.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1502543509 0 0) 0x7f4928117130 con 0x7f492812a0a0 2021-05-26T16:43:53.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49080100d0 con 0x7f492812a0a0 2021-05-26T16:43:53.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f491c004870 con 0x7f492812a0a0 2021-05-26T16:43:53.779 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:53.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:53.780 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): dump: 2021-05-26T16:43:53.780 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:53.780 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:53.780 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.781 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.781 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:53.781 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:53.781 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:53.781 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:53.782 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:53.782 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:53.782 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:53.782 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:53.783 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:53.783 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:53.783 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:53.783 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:53.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2141336471 0 0) 0x7f49281173d0 con 0x7f492813c510 2021-05-26T16:43:53.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4928117130 con 0x7f492813c510 2021-05-26T16:43:53.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4918001fa0 con 0x7f492813c510 2021-05-26T16:43:53.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:53.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:53.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient(hunting): dump: 2021-05-26T16:43:53.785 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:53.785 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:53.785 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.785 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.786 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:53.786 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:53.786 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:53.786 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:53.786 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:53.787 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:53.787 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:53.787 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:53.787 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:53.788 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:53.788 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:53.788 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:53.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2381984285 0 0) 0x7f4928116e90 con 0x7f492813c130 2021-05-26T16:43:53.788 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 >> v1:172.21.15.137:6792/0 conn(0x7f492812a0a0 legacy=0x7f4928141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 >> v1:172.21.15.137:6789/0 conn(0x7f492813c510 legacy=0x7f4928144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 monclient: found mon.b 2021-05-26T16:43:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492813c9a0 con 0x7f492813c130 2021-05-26T16:43:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 10 monclient: _finish_auth 0 2021-05-26T16:43:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f490effd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f492d49a700 5 monclient: authenticate success, global_id 5114 2021-05-26T16:43:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f492d49a700 10 monclient: _renew_subs 2021-05-26T16:43:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f492d49a700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492812e6a0 con 0x7f492813c130 2021-05-26T16:43:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f492d49a700 10 monclient: _renew_subs 2021-05-26T16:43:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f492d49a700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.740+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4928146470 con 0x7f492813c130 2021-05-26T16:43:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4910004b10 con 0x7f492813c130 2021-05-26T16:43:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:53.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f4910004fc0 con 0x7f492813c130 2021-05-26T16:43:53.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:53.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:53.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f49257fa700 4 set_mon_vals no callback set 2021-05-26T16:43:53.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 10 monclient: dump: 2021-05-26T16:43:53.794 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:53.794 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:53.794 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.794 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:53.794 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:53.797 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:53.797 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:53.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f4910005120 con 0x7f492813c130 2021-05-26T16:43:53.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.741+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(116..116 src has 1..116) v4 ==== 3941+0+0 (unknown 1641460001 0 0) 0x7f491003db20 con 0x7f492813c130 2021-05-26T16:43:53.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.742+0000 7f492d49a700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.742+0000 7f492d49a700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.742+0000 7f492d49a700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.742+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4904004db0 con 0x7f492813c130 2021-05-26T16:43:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.742+0000 7f49267fc700 10 monclient: get_auth_request con 0x7f4908034770 auth_method 0 2021-05-26T16:43:53.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.747+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f4910013610 con 0x7f492813c130 2021-05-26T16:43:53.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.747+0000 7f490effd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:53.799 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.747+0000 7f490effd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:53.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.972+0000 7f492d49a700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:43:53.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.972+0000 7f492d49a700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:43:53.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.972+0000 7f492d49a700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:43:53.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.972+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 --> v1:172.21.15.3:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f49040055e0 con 0x7f492813c130 2021-05-26T16:43:53.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.972+0000 7f490effd700 1 -- 172.21.15.3:0/614690303 <== mon.2 v1:172.21.15.3:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2638 (unknown 254746657 0 1030987518) 0x7f4910013200 con 0x7f492813c130 2021-05-26T16:43:53.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.972+0000 7f490effd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:43:53.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.972+0000 7f490effd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:53.978 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":22,"quorum":[0,1,2,3,5,6,7,8],"quorum_names":["a","f","b","g","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:43:53.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 >> v1:172.21.15.137:6812/30003 conn(0x7f4908034770 legacy=0x7f4908036c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:53.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 10 monclient: shutdown 2021-05-26T16:43:53.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:53.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 >> v1:172.21.15.3:6790/0 conn(0x7f492813c130 legacy=0x7f4928129990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:53.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 shutdown_connections 2021-05-26T16:43:53.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 >> 172.21.15.3:0/614690303 conn(0x7f4908007270 msgr2=0x7f492809f230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:53.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 shutdown_connections 2021-05-26T16:43:53.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:53.974+0000 7f492d49a700 1 -- 172.21.15.3:0/614690303 wait complete. 2021-05-26T16:43:53.989 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2021-05-26T16:43:53.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-05-26T16:43:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.102+0000 7fc81f415700 10 monclient: get_monmap_and_config 2021-05-26T16:43:54.106 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.102+0000 7fc81f415700 10 monclient: build_initial_monmap 2021-05-26T16:43:54.106 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.102+0000 7fc81f415700 10 monclient: monmap: 2021-05-26T16:43:54.106 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:54.104209+0000 2021-05-26T16:43:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:54.104209+0000 2021-05-26T16:43:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:54.110 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:54.110 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:54.110 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 1 Processor -- start 2021-05-26T16:43:54.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 1 -- start start 2021-05-26T16:43:54.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient: init 2021-05-26T16:43:54.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:54.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient: _add_conns ranks=[8,4,7,5,3,6,1,0,2] 2021-05-26T16:43:54.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient(hunting): picked mon.noname-e con 0x7fc81812cbd0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:54.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient(hunting): picked mon.noname-c con 0x7fc818099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:54.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient(hunting): picked mon.noname-i con 0x7fc818099eb0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:54.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc818046600 con 0x7fc818099a30 2021-05-26T16:43:54.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81809b5e0 con 0x7fc818099eb0 2021-05-26T16:43:54.131 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81812d8f0 con 0x7fc81812cbd0 2021-05-26T16:43:54.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:54.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81f415700 10 monclient(hunting): authenticate will time out at 991.735857s 2021-05-26T16:43:54.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.103+0000 7fc81dc12700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7fc818099a30 legacy=0x7fc818131f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:54.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.104+0000 7fc81e413700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fc81812cbd0 0x7fc81812d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53718/0 (socket says 172.21.15.3:53718) 2021-05-26T16:43:54.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.104+0000 7fc81e413700 1 -- 172.21.15.3:0/2838138960 learned_addr learned my addr 172.21.15.3:0/2838138960 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81e413700 1 -- 172.21.15.3:0/2838138960 >> v1:172.21.15.3:6793/0 conn(0x7fc81812cbd0 legacy=0x7fc81812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537877813 0 0) 0x7fc81812d8f0 con 0x7fc81812cbd0 2021-05-26T16:43:54.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient(hunting): my global_id is 104336 2021-05-26T16:43:54.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc800003270 con 0x7fc81812cbd0 2021-05-26T16:43:54.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81ec14700 1 -- 172.21.15.3:0/2838138960 >> v1:172.21.15.137:6792/0 conn(0x7fc818099eb0 legacy=0x7fc818135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448690042 0 0) 0x7fc800003270 con 0x7fc81812cbd0 2021-05-26T16:43:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 >> v1:172.21.15.137:6792/0 conn(0x7fc818099eb0 legacy=0x7fc818135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 >> v1:172.21.15.3:6791/0 conn(0x7fc818099a30 legacy=0x7fc818131f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:54.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: _finish_hunting 0 2021-05-26T16:43:54.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 monclient: found mon.noname-e 2021-05-26T16:43:54.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:54.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:43:54.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81809c2b0 con 0x7fc81812cbd0 2021-05-26T16:43:54.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: _finish_auth 0 2021-05-26T16:43:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81f415700 5 monclient: authenticate success, global_id 104336 2021-05-26T16:43:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81f415700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc808001a60 con 0x7fc81812cbd0 2021-05-26T16:43:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: dump: 2021-05-26T16:43:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.143 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.143 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.143 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.146 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.146 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.147 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.147 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81f415700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:54.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc808001d70 con 0x7fc81812cbd0 2021-05-26T16:43:54.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:54.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 1 -- 172.21.15.3:0/2838138960 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc808004930 con 0x7fc81812cbd0 2021-05-26T16:43:54.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81f415700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:54.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81f415700 4 set_mon_vals no callback set 2021-05-26T16:43:54.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.151 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:54.151 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.106+0000 7fc81d411700 10 monclient: dump: 2021-05-26T16:43:54.151 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.152 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.152 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.153 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.153 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.154 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.154 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.154 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.155 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.155 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.156 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.156 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.157 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.157 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.157 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.158 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 10 monclient: shutdown 2021-05-26T16:43:54.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:54.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 1 -- 172.21.15.3:0/2838138960 >> v1:172.21.15.3:6793/0 conn(0x7fc81812cbd0 legacy=0x7fc81812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 1 -- 172.21.15.3:0/2838138960 shutdown_connections 2021-05-26T16:43:54.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 1 -- 172.21.15.3:0/2838138960 >> 172.21.15.3:0/2838138960 conn(0x7fc8180a00c0 msgr2=0x7fc8180a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:54.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 1 -- 172.21.15.3:0/2838138960 shutdown_connections 2021-05-26T16:43:54.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 1 -- 172.21.15.3:0/2838138960 wait complete. 2021-05-26T16:43:54.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 10 monclient: build_initial_monmap 2021-05-26T16:43:54.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.107+0000 7fc81f415700 10 monclient: monmap: 2021-05-26T16:43:54.163 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:54.163 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:54.163 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:54.164 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:54.164 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:54.165 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.165 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:54.166 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:54.166 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:54.167 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:54.167 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:54.167 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:54.168 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:54.168 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:54.169 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:54.169 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 1 Processor -- start 2021-05-26T16:43:54.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 1 -- start start 2021-05-26T16:43:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient: init 2021-05-26T16:43:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient: _add_conns ranks=[3,6,1,2,7,8,4,5,0] 2021-05-26T16:43:54.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient(hunting): picked mon.noname-g con 0x7fc818099a30 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:54.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient(hunting): picked mon.noname-d con 0x7fc818099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:54.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient(hunting): picked mon.noname-f con 0x7fc81812cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:54.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc818117cd0 con 0x7fc81812cbd0 2021-05-26T16:43:54.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81811a850 con 0x7fc818099a30 2021-05-26T16:43:54.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81811aaf0 con 0x7fc818099eb0 2021-05-26T16:43:54.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:54.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81f415700 10 monclient(hunting): authenticate will time out at 991.740575s 2021-05-26T16:43:54.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81dc12700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fc818099eb0 0x7fc8181175c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58042/0 (socket says 172.21.15.3:58042) 2021-05-26T16:43:54.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.108+0000 7fc81dc12700 1 -- 172.21.15.3:0/1560365941 learned_addr learned my addr 172.21.15.3:0/1560365941 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:54.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.110+0000 7fc81dc12700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6792/0 conn(0x7fc818099eb0 legacy=0x7fc8181175c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.110+0000 7fc81e413700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.137:6790/0 conn(0x7fc818099a30 legacy=0x7fc818116eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81ec14700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.137:6789/0 conn(0x7fc81812cbd0 legacy=0x7fc818144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719079006 0 0) 0x7fc81811aaf0 con 0x7fc818099eb0 2021-05-26T16:43:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): my global_id is 5055 2021-05-26T16:43:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f8003270 con 0x7fc818099eb0 2021-05-26T16:43:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332877861 0 0) 0x7fc81811a850 con 0x7fc818099a30 2021-05-26T16:43:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): my global_id is 5070 2021-05-26T16:43:54.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81811aaf0 con 0x7fc818099a30 2021-05-26T16:43:54.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519154448 0 0) 0x7fc818117cd0 con 0x7fc81812cbd0 2021-05-26T16:43:54.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): my global_id is 5086 2021-05-26T16:43:54.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81811a850 con 0x7fc81812cbd0 2021-05-26T16:43:54.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 255089685 0 0) 0x7fc7f8003270 con 0x7fc818099eb0 2021-05-26T16:43:54.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc818117cd0 con 0x7fc818099eb0 2021-05-26T16:43:54.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc80c004380 con 0x7fc818099eb0 2021-05-26T16:43:54.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:54.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): dump: 2021-05-26T16:43:54.184 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.184 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.185 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.185 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.185 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.185 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.185 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.186 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.186 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.186 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.186 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.187 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.187 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.187 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.187 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.187 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:54.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1751046321 0 0) 0x7fc81811aaf0 con 0x7fc818099a30 2021-05-26T16:43:54.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7f8003270 con 0x7fc818099a30 2021-05-26T16:43:54.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc808001320 con 0x7fc818099a30 2021-05-26T16:43:54.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:54.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): dump: 2021-05-26T16:43:54.189 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.189 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.190 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.190 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.190 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.190 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.190 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.191 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.191 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.191 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.191 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.191 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.192 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.192 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.192 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.192 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3348262474 0 0) 0x7fc81811a850 con 0x7fc81812cbd0 2021-05-26T16:43:54.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc81811aaf0 con 0x7fc81812cbd0 2021-05-26T16:43:54.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc814002020 con 0x7fc81812cbd0 2021-05-26T16:43:54.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient(hunting): dump: 2021-05-26T16:43:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.197 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4020533704 0 0) 0x7fc818117cd0 con 0x7fc818099eb0 2021-05-26T16:43:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.137:6790/0 conn(0x7fc818099a30 legacy=0x7fc818116eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.137:6789/0 conn(0x7fc81812cbd0 legacy=0x7fc818144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 monclient: found mon.d 2021-05-26T16:43:54.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:54.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:54.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8181189f0 con 0x7fc818099eb0 2021-05-26T16:43:54.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:54.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:54.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81f415700 5 monclient: authenticate success, global_id 5055 2021-05-26T16:43:54.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81f415700 10 monclient: _renew_subs 2021-05-26T16:43:54.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81f415700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:54.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc818119f90 con 0x7fc818099eb0 2021-05-26T16:43:54.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81f415700 10 monclient: _renew_subs 2021-05-26T16:43:54.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81f415700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:54.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc818119620 con 0x7fc818099eb0 2021-05-26T16:43:54.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc80c004610 con 0x7fc818099eb0 2021-05-26T16:43:54.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:54.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc80c004ac0 con 0x7fc818099eb0 2021-05-26T16:43:54.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc81cc10700 4 set_mon_vals no callback set 2021-05-26T16:43:54.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:54.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.111+0000 7fc8067fc700 10 monclient: dump: 2021-05-26T16:43:54.203 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.203 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.203 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.204 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.204 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.204 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.204 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.204 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.205 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.205 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.205 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.205 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.205 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.206 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.206 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.206 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.206 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.112+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fc80c004c20 con 0x7fc818099eb0 2021-05-26T16:43:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.112+0000 7fc81f415700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.112+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(116..116 src has 1..116) v4 ==== 3941+0+0 (unknown 1641460001 0 0) 0x7fc80c03dab0 con 0x7fc818099eb0 2021-05-26T16:43:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.112+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc7fc0065a0 con 0x7fc7fc002840 2021-05-26T16:43:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.112+0000 7fc81e413700 10 monclient: get_auth_request con 0x7fc7f8033340 auth_method 0 2021-05-26T16:43:54.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.114+0000 7fc81ec14700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6789/0 conn(0x7fc7fc002840 legacy=0x7fc7fc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161156763 0 0) 0x7fc7fc0065a0 con 0x7fc7fc002840 2021-05-26T16:43:54.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient(hunting): my global_id is 104292 2021-05-26T16:43:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc818117cd0 con 0x7fc7fc002840 2021-05-26T16:43:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3830620304 0 0) 0x7fc818117cd0 con 0x7fc7fc002840 2021-05-26T16:43:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7fc0065a0 con 0x7fc7fc002840 2021-05-26T16:43:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc8140027b0 con 0x7fc7fc002840 2021-05-26T16:43:54.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:54.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient: dump: 2021-05-26T16:43:54.210 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.210 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.211 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.211 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.211 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.211 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.212 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.212 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.212 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.212 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.212 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.213 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.213 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.213 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.213 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.214 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2246455393 0 0) 0x7fc7fc0065a0 con 0x7fc7fc002840 2021-05-26T16:43:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7fc009e40 con 0x7fc7fc002840 2021-05-26T16:43:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fc814002c70 con 0x7fc7fc002840 2021-05-26T16:43:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6789/0 conn(0x7fc7fc002840 legacy=0x7fc7fc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.115+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6789/0 conn(0x7fc7fc002840 legacy=0x7fc7fc004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.122+0000 7fc81f415700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.122+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc7fc007510 con 0x7fc7fc0068b0 2021-05-26T16:43:54.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.124+0000 7fc81ec14700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6789/0 conn(0x7fc7fc0068b0 legacy=0x7fc7fc006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.124+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515692291 0 0) 0x7fc7fc007510 con 0x7fc7fc0068b0 2021-05-26T16:43:54.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.124+0000 7fc8067fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.124+0000 7fc8067fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.124+0000 7fc8067fc700 10 monclient(hunting): my global_id is 104301 2021-05-26T16:43:54.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.124+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7fc0065a0 con 0x7fc7fc0068b0 2021-05-26T16:43:54.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1220500447 0 0) 0x7fc7fc0065a0 con 0x7fc7fc0068b0 2021-05-26T16:43:54.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7fc007510 con 0x7fc7fc0068b0 2021-05-26T16:43:54.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc814003110 con 0x7fc7fc0068b0 2021-05-26T16:43:54.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:54.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 10 monclient: dump: 2021-05-26T16:43:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.223 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.223 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.223 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.223 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.224 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.224 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.224 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3198364656 0 0) 0x7fc7fc007510 con 0x7fc7fc0068b0 2021-05-26T16:43:54.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 --> v1:172.21.15.3:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc7fc008770 con 0x7fc7fc0068b0 2021-05-26T16:43:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7313 (unknown 0 0 406919871) 0x7fc814005ee0 con 0x7fc7fc0068b0 2021-05-26T16:43:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6789/0 conn(0x7fc7fc0068b0 legacy=0x7fc7fc006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.125+0000 7fc8067fc700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6789/0 conn(0x7fc7fc0068b0 legacy=0x7fc7fc006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:54.226 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:54.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:54.227 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:54.227 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "leader", 2021-05-26T16:43:54.227 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:54.227 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:54.227 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:54.228 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:54.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:54.228 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:54.228 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:54.229 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:54.229 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:54.229 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:54.229 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.229 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 0, 2021-05-26T16:43:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.233 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:54.233 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:54.233 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.233 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.234 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.234 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.234 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.234 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.235 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.235 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.235 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.235 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.236 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:54.236 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:54.236 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:54.236 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:54.236 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:54.237 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:54.237 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:54.237 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:54.237 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:54.238 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:54.238 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:54.238 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:54.238 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:54.239 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:54.239 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:54.239 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.239 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.239 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.240 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.240 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.240 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.240 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.241 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.241 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.241 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.241 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:54.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.242 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:54.242 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.242 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:54.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:54.243 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.243 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.243 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.243 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.243 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:54.244 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.244 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.244 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.244 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:54.245 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:54.245 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.245 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.245 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.246 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.246 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:54.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:54.246 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.247 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.247 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.247 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.247 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:54.248 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.248 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.248 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.248 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.248 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:54.249 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:54.249 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.249 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.249 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.250 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.250 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:54.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:54.250 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.251 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.251 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.251 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.251 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:54.251 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.252 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.252 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.252 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:54.253 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:54.253 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.253 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.253 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.254 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.254 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:54.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:54.254 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.255 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.255 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.255 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.255 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:54.255 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.256 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.256 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.256 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:54.256 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:54.257 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.257 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.257 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.258 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.258 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:54.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:54.258 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.258 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.259 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.259 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.259 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:54.259 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.260 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.260 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.260 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:54.260 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:54.261 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.261 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.261 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.261 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.262 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:54.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:54.262 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.262 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.263 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.263 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.263 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:54.263 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.263 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.264 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.264 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:54.264 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:54.265 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.265 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.265 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.265 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.266 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:54.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:54.266 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.266 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.267 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.267 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.267 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:54.267 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.267 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.268 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.268 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:54.268 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:54.268 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.269 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.269 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.269 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.270 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:54.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:54.270 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.270 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.270 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.271 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.271 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:54.271 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.271 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.271 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.272 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:54.272 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:54.272 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.273 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.273 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.273 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.273 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:54.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:54.274 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.274 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.274 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.274 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.275 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:54.275 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.275 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.276 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.276 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:54.276 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:54.277 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.277 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.277 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.277 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.277 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.278 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:54.278 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:54.278 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.279 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:54.279 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:54.279 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:54.279 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.279 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.280 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:54.280 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.280 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:54.280 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:54.281 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:54.281 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.281 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.281 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:54.282 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.137:6812/30003 conn(0x7fc7f8033340 legacy=0x7fc7f8035800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 10 monclient: shutdown 2021-05-26T16:43:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 >> v1:172.21.15.3:6792/0 conn(0x7fc818099eb0 legacy=0x7fc8181175c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81ec14700 1 -- 172.21.15.3:0/1560365941 reap_dead start 2021-05-26T16:43:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81ec14700 1 -- 172.21.15.3:0/1560365941 reap_dead start 2021-05-26T16:43:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 shutdown_connections 2021-05-26T16:43:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 >> 172.21.15.3:0/1560365941 conn(0x7fc8180a00c0 msgr2=0x7fc818097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:54.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 shutdown_connections 2021-05-26T16:43:54.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.126+0000 7fc81f415700 1 -- 172.21.15.3:0/1560365941 wait complete. 2021-05-26T16:43:54.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-05-26T16:43:54.403 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.400+0000 7fbc5a0e6700 10 monclient: get_monmap_and_config 2021-05-26T16:43:54.404 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.400+0000 7fbc5a0e6700 10 monclient: build_initial_monmap 2021-05-26T16:43:54.404 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.400+0000 7fbc5a0e6700 10 monclient: monmap: 2021-05-26T16:43:54.404 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:54.404 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.405 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:54.402270+0000 2021-05-26T16:43:54.405 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:54.402270+0000 2021-05-26T16:43:54.405 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:54.405 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.405 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:54.406 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:54.406 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:54.406 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:54.406 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:54.408 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 1 Processor -- start 2021-05-26T16:43:54.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 1 -- start start 2021-05-26T16:43:54.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient: init 2021-05-26T16:43:54.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:54.420 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient: _add_conns ranks=[0,6,4,7,2,5,1,3,8] 2021-05-26T16:43:54.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient(hunting): picked mon.noname-a con 0x7fbc5412cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:54.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient(hunting): picked mon.noname-d con 0x7fbc54099a30 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:54.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient(hunting): picked mon.noname-c con 0x7fbc54099eb0 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:54.421 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc54046600 con 0x7fbc5412cbd0 2021-05-26T16:43:54.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5409b5e0 con 0x7fbc54099eb0 2021-05-26T16:43:54.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5412d8f0 con 0x7fbc54099a30 2021-05-26T16:43:54.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:54.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc5a0e6700 10 monclient(hunting): authenticate will time out at 992.033895s 2021-05-26T16:43:54.422 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.401+0000 7fbc598e5700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7fbc54099eb0 legacy=0x7fbc54135650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:54.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.402+0000 7fbc590e4700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbc5412cbd0 0x7fbc5412d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52652/0 (socket says 172.21.15.3:52652) 2021-05-26T16:43:54.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.402+0000 7fbc588e3700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fbc54099a30 0x7fbc54131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58052/0 (socket says 172.21.15.3:58052) 2021-05-26T16:43:54.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.402+0000 7fbc590e4700 1 -- 172.21.15.3:0/2413335027 learned_addr learned my addr 172.21.15.3:0/2413335027 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:54.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc590e4700 1 -- 172.21.15.3:0/2413335027 >> v1:172.21.15.3:6789/0 conn(0x7fbc5412cbd0 legacy=0x7fbc5412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc588e3700 1 -- 172.21.15.3:0/2413335027 >> v1:172.21.15.3:6792/0 conn(0x7fbc54099a30 legacy=0x7fbc54131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416725356 0 0) 0x7fbc5412d8f0 con 0x7fbc54099a30 2021-05-26T16:43:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient(hunting): my global_id is 5064 2021-05-26T16:43:54.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc3c003270 con 0x7fbc54099a30 2021-05-26T16:43:54.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739085040 0 0) 0x7fbc54046600 con 0x7fbc5412cbd0 2021-05-26T16:43:54.425 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient(hunting): my global_id is 104310 2021-05-26T16:43:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc5412d8f0 con 0x7fbc5412cbd0 2021-05-26T16:43:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 848434346 0 0) 0x7fbc3c003270 con 0x7fbc54099a30 2021-05-26T16:43:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 >> v1:172.21.15.3:6791/0 conn(0x7fbc54099eb0 legacy=0x7fbc54135650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 >> v1:172.21.15.3:6789/0 conn(0x7fbc5412cbd0 legacy=0x7fbc5412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 monclient: found mon.noname-d 2021-05-26T16:43:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:43:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5409c2b0 con 0x7fbc54099a30 2021-05-26T16:43:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: _finish_auth 0 2021-05-26T16:43:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:54.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbc44001a60 con 0x7fbc54099a30 2021-05-26T16:43:54.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc5a0e6700 5 monclient: authenticate success, global_id 5064 2021-05-26T16:43:54.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc5a0e6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:54.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:54.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: dump: 2021-05-26T16:43:54.430 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.430 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.430 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.433 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.433 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.433 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.433 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc5a0e6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:54.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbc44001d70 con 0x7fbc54099a30 2021-05-26T16:43:54.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:54.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 1 -- 172.21.15.3:0/2413335027 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbc44004870 con 0x7fbc54099a30 2021-05-26T16:43:54.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc5a0e6700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:54.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc5a0e6700 4 set_mon_vals no callback set 2021-05-26T16:43:54.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:54.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.404+0000 7fbc43fff700 10 monclient: dump: 2021-05-26T16:43:54.436 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.436 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.436 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.436 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.436 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.437 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.437 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.437 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.437 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.437 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.438 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.438 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.438 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.438 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.439 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.439 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 10 monclient: shutdown 2021-05-26T16:43:54.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:54.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/2413335027 >> v1:172.21.15.3:6792/0 conn(0x7fbc54099a30 legacy=0x7fbc54131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/2413335027 shutdown_connections 2021-05-26T16:43:54.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/2413335027 >> 172.21.15.3:0/2413335027 conn(0x7fbc540a00c0 msgr2=0x7fbc540a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:54.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/2413335027 shutdown_connections 2021-05-26T16:43:54.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/2413335027 wait complete. 2021-05-26T16:43:54.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 10 monclient: build_initial_monmap 2021-05-26T16:43:54.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.405+0000 7fbc5a0e6700 10 monclient: monmap: 2021-05-26T16:43:54.441 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:54.441 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:54.441 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:54.442 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:54.442 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:54.442 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.442 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:54.443 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:54.443 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:54.443 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:54.443 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:54.443 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:54.444 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:54.444 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:54.444 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:54.444 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.444 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 1 Processor -- start 2021-05-26T16:43:54.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 1 -- start start 2021-05-26T16:43:54.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient: init 2021-05-26T16:43:54.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:54.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient: _add_conns ranks=[6,1,0,3,8,4,7,5,2] 2021-05-26T16:43:54.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient(hunting): picked mon.noname-d con 0x7fbc54099a30 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:54.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient(hunting): picked mon.noname-f con 0x7fbc54099eb0 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:54.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient(hunting): picked mon.noname-a con 0x7fbc5412cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:54.446 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5409b850 con 0x7fbc5412cbd0 2021-05-26T16:43:54.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5413c9e0 con 0x7fbc54099eb0 2021-05-26T16:43:54.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc54119e60 con 0x7fbc54099a30 2021-05-26T16:43:54.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:54.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc5a0e6700 10 monclient(hunting): authenticate will time out at 992.038877s 2021-05-26T16:43:54.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc590e4700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fbc54099a30 0x7fbc54129650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58058/0 (socket says 172.21.15.3:58058) 2021-05-26T16:43:54.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.406+0000 7fbc590e4700 1 -- 172.21.15.3:0/3475644152 learned_addr learned my addr 172.21.15.3:0/3475644152 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:54.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc590e4700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6792/0 conn(0x7fbc54099a30 legacy=0x7fbc54129650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc598e5700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6789/0 conn(0x7fbc5412cbd0 legacy=0x7fbc54144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631369366 0 0) 0x7fbc54119e60 con 0x7fbc54099a30 2021-05-26T16:43:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): my global_id is 5073 2021-05-26T16:43:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc34003270 con 0x7fbc54099a30 2021-05-26T16:43:54.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864107510 0 0) 0x7fbc5409b850 con 0x7fbc5412cbd0 2021-05-26T16:43:54.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): my global_id is 104319 2021-05-26T16:43:54.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc54119e60 con 0x7fbc5412cbd0 2021-05-26T16:43:54.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc588e3700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.137:6789/0 conn(0x7fbc54099eb0 legacy=0x7fbc54140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc590e4700 1 --1- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6792/0 conn(0x7fbc54099a30 0x7fbc54129650 :-1 s=OPENED pgs=259 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7fbc34003270 auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:43:54.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3439200679 0 0) 0x7fbc34003270 con 0x7fbc54099a30 2021-05-26T16:43:54.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc5409b850 con 0x7fbc54099a30 2021-05-26T16:43:54.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2714100071 0 0) 0x7fbc54119e60 con 0x7fbc5412cbd0 2021-05-26T16:43:54.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc34003270 con 0x7fbc5412cbd0 2021-05-26T16:43:54.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbc50004450 con 0x7fbc5412cbd0 2021-05-26T16:43:54.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.452 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:54.453 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): dump: 2021-05-26T16:43:54.453 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.453 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.453 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.454 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.454 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.454 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.454 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.454 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.455 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.455 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.455 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.455 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.455 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.456 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbc48001cd0 con 0x7fbc54099a30 2021-05-26T16:43:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): dump: 2021-05-26T16:43:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.458 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.458 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.458 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.458 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.459 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.459 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.459 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.459 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.459 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.460 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.460 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.460 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.460 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.460 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.461 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481700799 0 0) 0x7fbc5413c9e0 con 0x7fbc54099eb0 2021-05-26T16:43:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient(hunting): my global_id is 5095 2021-05-26T16:43:54.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc54119e60 con 0x7fbc54099eb0 2021-05-26T16:43:54.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 945171121 0 0) 0x7fbc34003270 con 0x7fbc5412cbd0 2021-05-26T16:43:54.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6792/0 conn(0x7fbc54099a30 legacy=0x7fbc54129650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.137:6789/0 conn(0x7fbc54099eb0 legacy=0x7fbc54140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient: _finish_hunting 0 2021-05-26T16:43:54.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 monclient: found mon.a 2021-05-26T16:43:54.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:54.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:54.463 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5411a100 con 0x7fbc5412cbd0 2021-05-26T16:43:54.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient: _finish_auth 0 2021-05-26T16:43:54.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:54.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc5a0e6700 5 monclient: authenticate success, global_id 104319 2021-05-26T16:43:54.464 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc5a0e6700 10 monclient: _renew_subs 2021-05-26T16:43:54.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4194916248 0 0) 0x7fbc5409b850 con 0x7fbc54099a30 2021-05-26T16:43:54.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc5a0e6700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:54.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc54117ee0 con 0x7fbc5412cbd0 2021-05-26T16:43:54.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2021-05-26T16:43:54.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc5a0e6700 10 monclient: _renew_subs 2021-05-26T16:43:54.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc5a0e6700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:43:54.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5412e110 con 0x7fbc5412cbd0 2021-05-26T16:43:54.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbc500046e0 con 0x7fbc5412cbd0 2021-05-26T16:43:54.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:54.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbc50004b90 con 0x7fbc5412cbd0 2021-05-26T16:43:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc417fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.409+0000 7fbc437fe700 4 set_mon_vals no callback set 2021-05-26T16:43:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.410+0000 7fbc417fa700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.410+0000 7fbc417fa700 10 monclient: dump: 2021-05-26T16:43:54.468 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.468 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.468 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.468 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.468 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.471 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.410+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fbc50004d70 con 0x7fbc5412cbd0 2021-05-26T16:43:54.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.410+0000 7fbc5a0e6700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:54.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.410+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbc2c0065a0 con 0x7fbc2c002840 2021-05-26T16:43:54.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.410+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(116..116 src has 1..116) v4 ==== 3941+0+0 (unknown 1641460001 0 0) 0x7fbc5003db20 con 0x7fbc5412cbd0 2021-05-26T16:43:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.411+0000 7fbc588e3700 10 monclient: get_auth_request con 0x7fbc34032ea0 auth_method 0 2021-05-26T16:43:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.412+0000 7fbc590e4700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6790/0 conn(0x7fbc2c002840 legacy=0x7fbc2c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730417364 0 0) 0x7fbc2c0065a0 con 0x7fbc2c002840 2021-05-26T16:43:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient(hunting): my global_id is 5123 2021-05-26T16:43:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc5409b850 con 0x7fbc2c002840 2021-05-26T16:43:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1182071350 0 0) 0x7fbc5409b850 con 0x7fbc2c002840 2021-05-26T16:43:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc2c0065a0 con 0x7fbc2c002840 2021-05-26T16:43:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbc48005050 con 0x7fbc2c002840 2021-05-26T16:43:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient: dump: 2021-05-26T16:43:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.477 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.477 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.477 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.477 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.477 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.478 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1529561933 0 0) 0x7fbc2c0065a0 con 0x7fbc2c002840 2021-05-26T16:43:54.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc2c009e40 con 0x7fbc2c002840 2021-05-26T16:43:54.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fbc48007390 con 0x7fbc2c002840 2021-05-26T16:43:54.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:54.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:54.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6790/0 conn(0x7fbc2c002840 legacy=0x7fbc2c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.413+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6790/0 conn(0x7fbc2c002840 legacy=0x7fbc2c004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.420+0000 7fbc5a0e6700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.420+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbc2c007510 con 0x7fbc2c0068b0 2021-05-26T16:43:54.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.422+0000 7fbc590e4700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6790/0 conn(0x7fbc2c0068b0 legacy=0x7fbc2c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639491443 0 0) 0x7fbc2c007510 con 0x7fbc2c0068b0 2021-05-26T16:43:54.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient(hunting): my global_id is 5132 2021-05-26T16:43:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc2c0065a0 con 0x7fbc2c0068b0 2021-05-26T16:43:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1067239664 0 0) 0x7fbc2c0065a0 con 0x7fbc2c0068b0 2021-05-26T16:43:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc2c007510 con 0x7fbc2c0068b0 2021-05-26T16:43:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbc48005b10 con 0x7fbc2c0068b0 2021-05-26T16:43:54.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:54.484 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient: dump: 2021-05-26T16:43:54.484 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.485 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.485 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.485 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.485 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.485 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.486 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.486 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.486 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.486 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.486 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.487 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.487 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.487 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.487 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.488 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3109278 0 0) 0x7fbc2c007510 con 0x7fbc2c0068b0 2021-05-26T16:43:54.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 --> v1:172.21.15.3:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbc2c008770 con 0x7fbc2c0068b0 2021-05-26T16:43:54.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7311 (unknown 0 0 3805326178) 0x7fbc48007130 con 0x7fbc2c0068b0 2021-05-26T16:43:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6790/0 conn(0x7fbc2c0068b0 legacy=0x7fbc2c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.423+0000 7fbc417fa700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6790/0 conn(0x7fbc2c0068b0 legacy=0x7fbc2c006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:54.490 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:54.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:54.490 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:54.490 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:54.491 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:54.491 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:54.491 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:54.491 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:54.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:54.492 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:54.492 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:54.492 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:54.492 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:54.493 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:54.493 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.493 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 0, 2021-05-26T16:43:54.493 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:54.494 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:54.494 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:54.494 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.494 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.494 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.495 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.495 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.495 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.495 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.495 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.496 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.496 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.496 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:54.496 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:54.497 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.497 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.497 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.497 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.497 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.498 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.498 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.498 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.498 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.503 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.503 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.503 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.503 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.504 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.504 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.504 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.504 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.504 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.505 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:54.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.505 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:54.505 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.505 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:54.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:54.506 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.506 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.506 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.507 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.507 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:54.507 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.507 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.507 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.508 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:54.508 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:54.508 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.508 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.509 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.509 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.509 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:54.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:54.510 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.510 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.510 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.510 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.511 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:54.511 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.511 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.511 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.515 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:54.515 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:54.516 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.516 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.516 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.517 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.517 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:54.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:54.517 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.517 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.518 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.518 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.518 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:54.518 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.519 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.519 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.519 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:54.519 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:54.520 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.520 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.520 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.521 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.521 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:54.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:54.521 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.521 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.522 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.522 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.522 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:54.522 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.523 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.523 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.523 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:54.523 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:54.524 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.524 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.524 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.524 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.525 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:54.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:54.525 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.525 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.526 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.526 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.526 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:54.526 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.526 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.527 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.527 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:54.527 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:54.528 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.528 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.528 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.528 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.529 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:54.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:54.529 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.529 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.529 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.530 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.530 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:54.530 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.530 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.531 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.531 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:54.531 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:54.531 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.532 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.532 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.532 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.532 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:54.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:54.533 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.533 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.533 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.534 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.534 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:54.534 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.534 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.535 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.535 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:54.535 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:54.535 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.536 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.536 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.536 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.536 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:54.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:54.537 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.537 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.537 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.538 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.538 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:54.538 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.538 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.539 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.539 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:54.539 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:54.539 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.540 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.540 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.540 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.541 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:54.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:54.541 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.541 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.541 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.542 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.542 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:54.542 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.542 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.542 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.543 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:54.543 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:54.543 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.543 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.544 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.544 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.544 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.545 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:54.545 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:54.545 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.545 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:54.545 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:54.546 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:54.546 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.546 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.546 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:54.547 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.547 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:54.547 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:54.547 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:54.547 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.548 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.548 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:54.548 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:54.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.137:6812/30003 conn(0x7fbc34032ea0 legacy=0x7fbc34035360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 10 monclient: shutdown 2021-05-26T16:43:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 >> v1:172.21.15.3:6789/0 conn(0x7fbc5412cbd0 legacy=0x7fbc54144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc598e5700 1 -- 172.21.15.3:0/3475644152 reap_dead start 2021-05-26T16:43:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc598e5700 1 -- 172.21.15.3:0/3475644152 reap_dead start 2021-05-26T16:43:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 shutdown_connections 2021-05-26T16:43:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 >> 172.21.15.3:0/3475644152 conn(0x7fbc540a00c0 msgr2=0x7fbc5412a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 shutdown_connections 2021-05-26T16:43:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.424+0000 7fbc5a0e6700 1 -- 172.21.15.3:0/3475644152 wait complete. 2021-05-26T16:43:54.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2021-05-26T16:43:54.670 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.667+0000 7f3ef7628700 10 monclient: get_monmap_and_config 2021-05-26T16:43:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.667+0000 7f3ef7628700 10 monclient: build_initial_monmap 2021-05-26T16:43:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.667+0000 7f3ef7628700 10 monclient: monmap: 2021-05-26T16:43:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:54.668720+0000 2021-05-26T16:43:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:54.668720+0000 2021-05-26T16:43:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:54.674 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.667+0000 7f3ef7628700 1 Processor -- start 2021-05-26T16:43:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.667+0000 7f3ef7628700 1 -- start start 2021-05-26T16:43:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.667+0000 7f3ef7628700 10 monclient: init 2021-05-26T16:43:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 10 monclient: _add_conns ranks=[4,2,1,8,7,0,3,5,6] 2021-05-26T16:43:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 10 monclient(hunting): picked mon.noname-c con 0x7f3ef0097860 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 10 monclient(hunting): picked mon.noname-b con 0x7f3ef0093b60 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 10 monclient(hunting): picked mon.noname-f con 0x7f3ef0130550 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:54.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef0059750 con 0x7f3ef0130550 2021-05-26T16:43:54.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef0092e50 con 0x7f3ef0093b60 2021-05-26T16:43:54.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef0095d80 con 0x7f3ef0097860 2021-05-26T16:43:54.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:54.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef7628700 10 monclient(hunting): authenticate will time out at 992.300469s 2021-05-26T16:43:54.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef53c4700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7f3ef0097860 legacy=0x7f3ef0092030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:54.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef4bc3700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f3ef0093b60 0x7f3ef0092740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54712/0 (socket says 172.21.15.3:54712) 2021-05-26T16:43:54.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.668+0000 7f3ef4bc3700 1 -- 172.21.15.3:0/674954677 learned_addr learned my addr 172.21.15.3:0/674954677 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:54.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.670+0000 7f3ef4bc3700 1 -- 172.21.15.3:0/674954677 >> v1:172.21.15.3:6790/0 conn(0x7f3ef0093b60 legacy=0x7f3ef0092740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.670+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840376909 0 0) 0x7f3ef0092e50 con 0x7f3ef0093b60 2021-05-26T16:43:54.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.670+0000 7f3edffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.670+0000 7f3edffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.670+0000 7f3edffff700 10 monclient(hunting): my global_id is 5141 2021-05-26T16:43:54.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003270 con 0x7f3ef0093b60 2021-05-26T16:43:54.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef5bc5700 1 -- 172.21.15.3:0/674954677 >> v1:172.21.15.137:6789/0 conn(0x7f3ef0130550 legacy=0x7f3ef0132940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407835538 0 0) 0x7f3ed8003270 con 0x7f3ef0093b60 2021-05-26T16:43:54.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 >> v1:172.21.15.3:6791/0 conn(0x7f3ef0097860 legacy=0x7f3ef0092030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:54.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 >> v1:172.21.15.137:6789/0 conn(0x7f3ef0130550 legacy=0x7f3ef0132940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:54.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 monclient: found mon.noname-b 2021-05-26T16:43:54.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:54.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:54.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0094540 con 0x7f3ef0093b60 2021-05-26T16:43:54.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: _finish_auth 0 2021-05-26T16:43:54.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:54.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3ee0001a60 con 0x7f3ef0093b60 2021-05-26T16:43:54.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:54.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: dump: 2021-05-26T16:43:54.695 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.695 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.696 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.696 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.696 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.696 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.697 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.697 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.697 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.697 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.698 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.698 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.698 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.698 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.699 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.699 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 5 monclient: authenticate success, global_id 5141 2021-05-26T16:43:54.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:54.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3ee0001d70 con 0x7f3ef0093b60 2021-05-26T16:43:54.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:54.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:54.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 1 -- 172.21.15.3:0/674954677 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3ee0004970 con 0x7f3ef0093b60 2021-05-26T16:43:54.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 4 set_mon_vals no callback set 2021-05-26T16:43:54.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:54.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3edffff700 10 monclient: dump: 2021-05-26T16:43:54.701 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.701 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.702 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.702 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.702 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.702 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.703 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.703 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.703 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.703 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.703 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.704 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.704 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.704 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.704 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.704 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 10 monclient: shutdown 2021-05-26T16:43:54.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:54.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 1 -- 172.21.15.3:0/674954677 >> v1:172.21.15.3:6790/0 conn(0x7f3ef0093b60 legacy=0x7f3ef0092740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 1 -- 172.21.15.3:0/674954677 shutdown_connections 2021-05-26T16:43:54.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 1 -- 172.21.15.3:0/674954677 >> 172.21.15.3:0/674954677 conn(0x7f3ef005d960 msgr2=0x7f3ef005dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:54.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 1 -- 172.21.15.3:0/674954677 shutdown_connections 2021-05-26T16:43:54.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.671+0000 7f3ef7628700 1 -- 172.21.15.3:0/674954677 wait complete. 2021-05-26T16:43:54.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.672+0000 7f3ef7628700 10 monclient: build_initial_monmap 2021-05-26T16:43:54.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.672+0000 7f3ef7628700 10 monclient: monmap: 2021-05-26T16:43:54.707 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:54.707 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:54.708 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:54.708 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:54.708 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:54.708 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.708 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:54.709 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:54.709 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:54.709 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:54.709 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:54.710 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:54.710 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:54.710 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:54.710 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:54.711 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.672+0000 7f3ef7628700 1 Processor -- start 2021-05-26T16:43:54.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.672+0000 7f3ef7628700 1 -- start start 2021-05-26T16:43:54.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.672+0000 7f3ef7628700 10 monclient: init 2021-05-26T16:43:54.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:54.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 10 monclient: _add_conns ranks=[1,7,3,5,0,2,4,6,8] 2021-05-26T16:43:54.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 10 monclient(hunting): picked mon.noname-f con 0x7f3ef0093b60 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:54.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 10 monclient(hunting): picked mon.noname-i con 0x7f3ef0097860 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:54.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 10 monclient(hunting): picked mon.noname-g con 0x7f3ef0130550 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:54.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef0095a80 con 0x7f3ef0093b60 2021-05-26T16:43:54.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef0095f80 con 0x7f3ef0130550 2021-05-26T16:43:54.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef0118850 con 0x7f3ef0097860 2021-05-26T16:43:54.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:54.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef7628700 10 monclient(hunting): authenticate will time out at 992.305509s 2021-05-26T16:43:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef4bc3700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7f3ef0097860 0x7f3ef0141150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.3:56814/0 (socket says 172.21.15.3:56814) 2021-05-26T16:43:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef5bc5700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f3ef0130550 0x7f3ef0144880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.3:35058/0 (socket says 172.21.15.3:35058) 2021-05-26T16:43:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef53c4700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3ef0093b60 0x7f3ef012b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.3:47708/0 (socket says 172.21.15.3:47708) 2021-05-26T16:43:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.673+0000 7f3ef4bc3700 1 -- 172.21.15.3:0/3442749305 learned_addr learned my addr 172.21.15.3:0/3442749305 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:54.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.675+0000 7f3ef5bc5700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.137:6790/0 conn(0x7f3ef0130550 legacy=0x7f3ef0144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.675+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 DispatchQueue::entry inject delay of 0.002000 2021-05-26T16:43:54.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.676+0000 7f3ef4bc3700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.137:6792/0 conn(0x7f3ef0097860 legacy=0x7f3ef0141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.676+0000 7f3ef53c4700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.137:6789/0 conn(0x7f3ef0093b60 legacy=0x7f3ef012b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130025157 0 0) 0x7f3ef0095f80 con 0x7f3ef0130550 2021-05-26T16:43:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): my global_id is 5079 2021-05-26T16:43:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed0003270 con 0x7f3ef0130550 2021-05-26T16:43:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894636202 0 0) 0x7f3ef0095a80 con 0x7f3ef0093b60 2021-05-26T16:43:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): my global_id is 5113 2021-05-26T16:43:54.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef0095f80 con 0x7f3ef0093b60 2021-05-26T16:43:54.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158822212 0 0) 0x7f3ef0118850 con 0x7f3ef0097860 2021-05-26T16:43:54.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.719 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): my global_id is 104290 2021-05-26T16:43:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef0095a80 con 0x7f3ef0097860 2021-05-26T16:43:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1126415717 0 0) 0x7f3ef0095a80 con 0x7f3ef0097860 2021-05-26T16:43:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ef0118850 con 0x7f3ef0097860 2021-05-26T16:43:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3ee0004870 con 0x7f3ef0097860 2021-05-26T16:43:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2021-05-26T16:43:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): dump: 2021-05-26T16:43:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.725 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:54.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 785829304 0 0) 0x7f3ed0003270 con 0x7f3ef0130550 2021-05-26T16:43:54.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ef0095a80 con 0x7f3ef0130550 2021-05-26T16:43:54.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1182876566 0 0) 0x7f3ef0095f80 con 0x7f3ef0093b60 2021-05-26T16:43:54.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ed0003270 con 0x7f3ef0093b60 2021-05-26T16:43:54.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3eec001ee0 con 0x7f3ef0130550 2021-05-26T16:43:54.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:54.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): dump: 2021-05-26T16:43:54.727 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.727 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.728 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.728 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.728 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.728 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.729 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.729 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.729 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.729 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.731 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3ee40041f0 con 0x7f3ef0093b60 2021-05-26T16:43:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:54.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient(hunting): dump: 2021-05-26T16:43:54.732 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.732 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.732 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.732 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.733 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.733 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.733 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.733 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.733 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.734 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.734 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.734 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.734 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.735 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.735 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.735 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1209124153 0 0) 0x7f3ef0118850 con 0x7f3ef0097860 2021-05-26T16:43:54.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.137:6790/0 conn(0x7f3ef0130550 legacy=0x7f3ef0144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.137:6789/0 conn(0x7f3ef0093b60 legacy=0x7f3ef012b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient: _finish_hunting 0 2021-05-26T16:43:54.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 monclient: found mon.i 2021-05-26T16:43:54.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:54.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:43:54.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0117cd0 con 0x7f3ef0097860 2021-05-26T16:43:54.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 10 monclient: _finish_auth 0 2021-05-26T16:43:54.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3edd7fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:54.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3ef7628700 5 monclient: authenticate success, global_id 104290 2021-05-26T16:43:54.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3ef7628700 10 monclient: _renew_subs 2021-05-26T16:43:54.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3ef7628700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:43:54.738 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.678+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef012c030 con 0x7f3ef0097860 2021-05-26T16:43:54.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3ef7628700 10 monclient: _renew_subs 2021-05-26T16:43:54.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3ef7628700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:43:54.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.137:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef0067950 con 0x7f3ef0097860 2021-05-26T16:43:54.739 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3ee0001320 con 0x7f3ef0097860 2021-05-26T16:43:54.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edd7fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:54.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3ee0001580 con 0x7f3ef0097860 2021-05-26T16:43:54.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edf7fe700 4 set_mon_vals no callback set 2021-05-26T16:43:54.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edd7fa700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edd7fa700 10 monclient: dump: 2021-05-26T16:43:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.744 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3ef7628700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f3ee000e6f0 con 0x7f3ef0097860 2021-05-26T16:43:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.679+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3ec80065a0 con 0x7f3ec8002840 2021-05-26T16:43:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.680+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.7 v1:172.21.15.137:6792/0 8 ==== osd_map(116..116 src has 1..116) v4 ==== 3941+0+0 (unknown 1641460001 0 0) 0x7f3ee003dc10 con 0x7f3ef0097860 2021-05-26T16:43:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.680+0000 7f3ef5bc5700 10 monclient: get_auth_request con 0x7f3ed0033600 auth_method 0 2021-05-26T16:43:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3ef53c4700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.3:6792/0 conn(0x7f3ec8002840 legacy=0x7f3ec8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862929671 0 0) 0x7f3ec80065a0 con 0x7f3ec8002840 2021-05-26T16:43:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient(hunting): my global_id is 5082 2021-05-26T16:43:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef0118850 con 0x7f3ec8002840 2021-05-26T16:43:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 375947654 0 0) 0x7f3ef0118850 con 0x7f3ec8002840 2021-05-26T16:43:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ec80065a0 con 0x7f3ec8002840 2021-05-26T16:43:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3ee4004970 con 0x7f3ec8002840 2021-05-26T16:43:54.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:54.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient: dump: 2021-05-26T16:43:54.748 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.748 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.749 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.749 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.749 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.752 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.752 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3826942012 0 0) 0x7f3ec80065a0 con 0x7f3ec8002840 2021-05-26T16:43:54.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ec8009e40 con 0x7f3ec8002840 2021-05-26T16:43:54.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f3ee4004f20 con 0x7f3ec8002840 2021-05-26T16:43:54.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:54.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:54.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.3:6792/0 conn(0x7f3ec8002840 legacy=0x7f3ec8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.682+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.3:6792/0 conn(0x7f3ec8002840 legacy=0x7f3ec8004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:54.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.689+0000 7f3ef7628700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:54.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.689+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3ec8007510 con 0x7f3ec80068b0 2021-05-26T16:43:54.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3ef53c4700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.3:6792/0 conn(0x7f3ec80068b0 legacy=0x7f3ec8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105939734 0 0) 0x7f3ec8007510 con 0x7f3ec80068b0 2021-05-26T16:43:54.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient(hunting): my global_id is 5091 2021-05-26T16:43:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec80065a0 con 0x7f3ec80068b0 2021-05-26T16:43:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3640258620 0 0) 0x7f3ec80065a0 con 0x7f3ec80068b0 2021-05-26T16:43:54.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ec8007510 con 0x7f3ec80068b0 2021-05-26T16:43:54.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3ee4005680 con 0x7f3ec80068b0 2021-05-26T16:43:54.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:54.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient: dump: 2021-05-26T16:43:54.759 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.759 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.759 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.759 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.760 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.760 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.761 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.761 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.761 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.761 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.761 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.762 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.762 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.762 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.762 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.763 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2521348827 0 0) 0x7f3ec8007510 con 0x7f3ec80068b0 2021-05-26T16:43:54.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 --> v1:172.21.15.3:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3ec8008770 con 0x7f3ec80068b0 2021-05-26T16:43:54.763 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7481 (unknown 0 0 2979597063) 0x7f3ee4005860 con 0x7f3ec80068b0 2021-05-26T16:43:54.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:54.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:54.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.3:6792/0 conn(0x7f3ec80068b0 legacy=0x7f3ec8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.692+0000 7f3edd7fa700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.3:6792/0 conn(0x7f3ec80068b0 legacy=0x7f3ec8006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:54.765 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:54.765 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:54.765 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:54.765 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:54.766 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:54.766 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:54.766 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:54.766 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:54.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:54.767 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:54.767 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:54.767 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:54.768 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:54.768 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:54.768 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.768 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 0, 2021-05-26T16:43:54.768 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:54.769 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:54.769 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:54.769 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.769 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.769 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.770 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.770 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.770 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.770 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.771 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.771 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.771 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.772 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:54.772 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:54.772 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.772 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.772 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.773 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.773 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.773 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.773 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.774 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.774 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.774 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.774 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:54.775 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:54.775 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:54.775 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:54.775 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:54.776 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:54.776 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:54.776 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:54.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:54.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:54.777 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:54.777 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:54.777 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:54.777 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:54.778 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:54.778 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:54.778 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:54.778 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:54.778 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:54.779 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:54.779 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:54.779 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:54.779 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:54.780 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:54.780 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.780 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:54.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.780 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:54.781 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.781 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:54.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:54.782 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.782 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.782 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.782 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.783 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:54.783 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.783 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.783 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.787 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.787 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:54.787 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.787 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.787 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.788 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:54.788 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:54.788 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.789 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.789 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.789 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.789 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.789 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:54.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:54.790 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.790 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.790 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.791 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.791 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:54.791 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.791 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.792 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.792 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:54.792 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:54.793 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.793 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.793 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.794 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.794 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:54.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:54.794 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.795 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.795 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.795 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.795 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:54.795 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.796 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.796 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.796 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:54.797 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:54.797 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.797 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.797 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.798 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.798 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:54.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:54.798 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.798 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.799 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.799 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.799 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:54.799 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.800 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.800 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.800 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:54.800 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:54.801 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.801 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.801 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.801 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.802 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:54.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:54.802 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.803 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.803 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.803 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.803 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:54.804 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.804 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.804 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.804 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:54.805 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:54.805 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.805 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.805 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.806 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.806 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:54.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:54.806 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.807 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.807 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.807 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.808 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:54.808 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.808 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.808 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.809 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:54.809 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:54.809 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.809 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.810 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.810 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.810 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:54.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:54.811 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.811 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.811 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.811 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.812 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:54.812 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.812 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.812 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.813 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:54.813 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:54.813 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.814 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.814 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.814 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.815 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:54.815 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:54.815 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:54.815 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:54.815 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.816 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:54.816 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:54.816 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:54.817 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.817 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.817 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:54.817 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:54.818 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:54.818 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:54.818 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:54.818 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.819 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.819 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:54.819 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:54.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.820 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:54.820 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:54.820 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:54.820 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.821 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.821 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:54.821 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.821 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:54.822 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:54.822 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:54.822 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.822 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:54.823 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:54.823 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:54.823 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:54.823 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:54.824 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:54.824 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:54.824 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:54.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:54.825 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:54.825 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:54.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.137:6812/30003 conn(0x7f3ed0033600 legacy=0x7f3ed0035ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 10 monclient: shutdown 2021-05-26T16:43:54.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 >> v1:172.21.15.137:6792/0 conn(0x7f3ef0097860 legacy=0x7f3ef0141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef5bc5700 1 -- 172.21.15.3:0/3442749305 reap_dead start 2021-05-26T16:43:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef5bc5700 1 -- 172.21.15.3:0/3442749305 reap_dead start 2021-05-26T16:43:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 shutdown_connections 2021-05-26T16:43:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 >> 172.21.15.3:0/3442749305 conn(0x7f3ef005d960 msgr2=0x7f3ef0098810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 shutdown_connections 2021-05-26T16:43:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.693+0000 7f3ef7628700 1 -- 172.21.15.3:0/3442749305 wait complete. 2021-05-26T16:43:54.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2021-05-26T16:43:54.849 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:54.849 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34863]: starting. 2021-05-26T16:43:54.850 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34863]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34828 2021-05-26T16:43:54.850 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34863]: created object 0... 2021-05-26T16:43:54.850 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34863]: created object 25... 2021-05-26T16:43:54.850 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34863]: created object 49... 2021-05-26T16:43:54.850 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34863]: finishing. 2021-05-26T16:43:54.851 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34863]: shutting down. 2021-05-26T16:43:54.887 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:54.887 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34865]: starting. 2021-05-26T16:43:54.888 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34865]: listing objects. 2021-05-26T16:43:54.888 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34865]: listed object 0... 2021-05-26T16:43:54.888 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34865]: listed object 25... 2021-05-26T16:43:54.888 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34865]: saw 50 objects 2021-05-26T16:43:54.889 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34865]: shutting down. 2021-05-26T16:43:54.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.944+0000 7fcd92434700 10 monclient: get_monmap_and_config 2021-05-26T16:43:54.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.944+0000 7fcd92434700 10 monclient: build_initial_monmap 2021-05-26T16:43:54.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.944+0000 7fcd92434700 10 monclient: monmap: 2021-05-26T16:43:54.951 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:54.952 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.952 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:54.945617+0000 2021-05-26T16:43:54.953 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:54.945617+0000 2021-05-26T16:43:54.953 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:54.954 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.954 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:54.954 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:54.955 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:54.955 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:54.956 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:54.956 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:54.957 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:54.957 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:54.957 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:54.958 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.944+0000 7fcd92434700 1 Processor -- start 2021-05-26T16:43:54.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.944+0000 7fcd92434700 1 -- start start 2021-05-26T16:43:54.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.944+0000 7fcd92434700 10 monclient: init 2021-05-26T16:43:54.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:54.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 10 monclient: _add_conns ranks=[8,4,5,1,3,7,6,2,0] 2021-05-26T16:43:54.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 10 monclient(hunting): picked mon.noname-e con 0x7fcd8c064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 10 monclient(hunting): picked mon.noname-c con 0x7fcd8c063e30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 10 monclient(hunting): picked mon.noname-h con 0x7fcd8c0642e0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:54.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c059750 con 0x7fcd8c063e30 2021-05-26T16:43:54.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c064e00 con 0x7fcd8c0642e0 2021-05-26T16:43:54.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c09c770 con 0x7fcd8c064a20 2021-05-26T16:43:54.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:54.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd92434700 10 monclient(hunting): authenticate will time out at 992.577344s 2021-05-26T16:43:54.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd8b7fe700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7fcd8c063e30 legacy=0x7fcd8c132080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:54.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd8bfff700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fcd8c064a20 0x7fcd8c099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53778/0 (socket says 172.21.15.3:53778) 2021-05-26T16:43:54.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.945+0000 7fcd8bfff700 1 -- 172.21.15.3:0/2079439648 learned_addr learned my addr 172.21.15.3:0/2079439648 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.947+0000 7fcd8bfff700 1 -- 172.21.15.3:0/2079439648 >> v1:172.21.15.3:6793/0 conn(0x7fcd8c064a20 legacy=0x7fcd8c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.947+0000 7fcd909d1700 1 -- 172.21.15.3:0/2079439648 >> v1:172.21.15.137:6791/0 conn(0x7fcd8c0642e0 legacy=0x7fcd8c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.947+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353168742 0 0) 0x7fcd8c09c770 con 0x7fcd8c064a20 2021-05-26T16:43:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.947+0000 7fcd8affd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.947+0000 7fcd8affd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.947+0000 7fcd8affd700 10 monclient(hunting): my global_id is 104345 2021-05-26T16:43:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.947+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd70003270 con 0x7fcd8c064a20 2021-05-26T16:43:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242573863 0 0) 0x7fcd8c064e00 con 0x7fcd8c0642e0 2021-05-26T16:43:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient(hunting): my global_id is 5225 2021-05-26T16:43:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8c09c770 con 0x7fcd8c0642e0 2021-05-26T16:43:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661587447 0 0) 0x7fcd70003270 con 0x7fcd8c064a20 2021-05-26T16:43:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 >> v1:172.21.15.137:6791/0 conn(0x7fcd8c0642e0 legacy=0x7fcd8c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 >> v1:172.21.15.3:6791/0 conn(0x7fcd8c063e30 legacy=0x7fcd8c132080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 monclient: found mon.noname-e 2021-05-26T16:43:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:43:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0977a0 con 0x7fcd8c064a20 2021-05-26T16:43:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: _finish_auth 0 2021-05-26T16:43:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd7c001aa0 con 0x7fcd8c064a20 2021-05-26T16:43:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 5 monclient: authenticate success, global_id 104345 2021-05-26T16:43:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: dump: 2021-05-26T16:43:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:54.995 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:54.995 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:54.995 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:54.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcd7c0045f0 con 0x7fcd8c064a20 2021-05-26T16:43:54.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:54.996 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 1 -- 172.21.15.3:0/2079439648 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd7c004aa0 con 0x7fcd8c064a20 2021-05-26T16:43:54.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:54.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 4 set_mon_vals no callback set 2021-05-26T16:43:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd8affd700 10 monclient: dump: 2021-05-26T16:43:54.999 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:54.999 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:54.999 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.000 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.000 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.000 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.000 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.001 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.001 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.001 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.001 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.001 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.002 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.002 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.002 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.003 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 10 monclient: shutdown 2021-05-26T16:43:55.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 1 -- 172.21.15.3:0/2079439648 >> v1:172.21.15.3:6793/0 conn(0x7fcd8c064a20 legacy=0x7fcd8c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 1 -- 172.21.15.3:0/2079439648 shutdown_connections 2021-05-26T16:43:55.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 1 -- 172.21.15.3:0/2079439648 >> 172.21.15.3:0/2079439648 conn(0x7fcd8c0a0db0 msgr2=0x7fcd8c09cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 1 -- 172.21.15.3:0/2079439648 shutdown_connections 2021-05-26T16:43:55.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.948+0000 7fcd92434700 1 -- 172.21.15.3:0/2079439648 wait complete. 2021-05-26T16:43:55.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.949+0000 7fcd92434700 10 monclient: build_initial_monmap 2021-05-26T16:43:55.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.949+0000 7fcd92434700 10 monclient: monmap: 2021-05-26T16:43:55.005 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:55.005 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:55.005 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:55.006 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:55.006 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:55.006 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.006 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:55.007 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:55.007 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:55.007 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:55.007 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:55.008 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:55.008 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:55.008 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:55.008 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:55.009 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.949+0000 7fcd92434700 1 Processor -- start 2021-05-26T16:43:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.949+0000 7fcd92434700 1 -- start start 2021-05-26T16:43:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.949+0000 7fcd92434700 10 monclient: init 2021-05-26T16:43:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 10 monclient: _add_conns ranks=[6,3,8,1,0,7,4,5,2] 2021-05-26T16:43:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 10 monclient(hunting): picked mon.noname-d con 0x7fcd8c063e30 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 10 monclient(hunting): picked mon.noname-g con 0x7fcd8c0642e0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 10 monclient(hunting): picked mon.noname-e con 0x7fcd8c064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c1168c0 con 0x7fcd8c0642e0 2021-05-26T16:43:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c116af0 con 0x7fcd8c063e30 2021-05-26T16:43:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c116d90 con 0x7fcd8c064a20 2021-05-26T16:43:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd92434700 10 monclient(hunting): authenticate will time out at 992.582278s 2021-05-26T16:43:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd8bfff700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fcd8c063e30 0x7fcd8c13c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58104/0 (socket says 172.21.15.3:58104) 2021-05-26T16:43:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd8bfff700 1 -- 172.21.15.3:0/2515889352 learned_addr learned my addr 172.21.15.3:0/2515889352 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.950+0000 7fcd909d1700 1 --1- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd8c064a20 0x7fcd8c144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53788/0 (socket says 172.21.15.3:53788) 2021-05-26T16:43:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd8bfff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6792/0 conn(0x7fcd8c063e30 legacy=0x7fcd8c13c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd909d1700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd8c064a20 legacy=0x7fcd8c144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd8b7fe700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.137:6790/0 conn(0x7fcd8c0642e0 legacy=0x7fcd8c141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644118656 0 0) 0x7fcd8c116d90 con 0x7fcd8c064a20 2021-05-26T16:43:55.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): my global_id is 104354 2021-05-26T16:43:55.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd6c003270 con 0x7fcd8c064a20 2021-05-26T16:43:55.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514985986 0 0) 0x7fcd8c116af0 con 0x7fcd8c063e30 2021-05-26T16:43:55.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): my global_id is 5100 2021-05-26T16:43:55.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8c116d90 con 0x7fcd8c063e30 2021-05-26T16:43:55.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898558551 0 0) 0x7fcd8c1168c0 con 0x7fcd8c0642e0 2021-05-26T16:43:55.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 10 monclient(hunting): my global_id is 5088 2021-05-26T16:43:55.016 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.952+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8c116af0 con 0x7fcd8c0642e0 2021-05-26T16:43:55.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 792380352 0 0) 0x7fcd6c003270 con 0x7fcd8c064a20 2021-05-26T16:43:55.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd8c1168c0 con 0x7fcd8c064a20 2021-05-26T16:43:55.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd80002100 con 0x7fcd8c064a20 2021-05-26T16:43:55.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.017 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:55.018 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): dump: 2021-05-26T16:43:55.018 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.018 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.018 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.019 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.019 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.019 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.019 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.021 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 707173815 0 0) 0x7fcd8c116d90 con 0x7fcd8c063e30 2021-05-26T16:43:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd6c003270 con 0x7fcd8c063e30 2021-05-26T16:43:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd7c001ad0 con 0x7fcd8c063e30 2021-05-26T16:43:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:55.023 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): dump: 2021-05-26T16:43:55.023 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.023 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.023 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.024 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.024 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.024 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.024 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.024 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.025 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.025 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.025 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.025 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.025 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.026 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.026 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.026 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2475916482 0 0) 0x7fcd8c116af0 con 0x7fcd8c0642e0 2021-05-26T16:43:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd8c116d90 con 0x7fcd8c0642e0 2021-05-26T16:43:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd78004270 con 0x7fcd8c0642e0 2021-05-26T16:43:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient(hunting): dump: 2021-05-26T16:43:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.032 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3022889641 0 0) 0x7fcd8c1168c0 con 0x7fcd8c064a20 2021-05-26T16:43:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6792/0 conn(0x7fcd8c063e30 legacy=0x7fcd8c13c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.137:6790/0 conn(0x7fcd8c0642e0 legacy=0x7fcd8c141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 monclient: found mon.e 2021-05-26T16:43:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c117030 con 0x7fcd8c064a20 2021-05-26T16:43:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient: _finish_auth 0 2021-05-26T16:43:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd92434700 5 monclient: authenticate success, global_id 104354 2021-05-26T16:43:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd92434700 10 monclient: _renew_subs 2021-05-26T16:43:55.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd92434700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:55.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c12f350 con 0x7fcd8c064a20 2021-05-26T16:43:55.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd92434700 10 monclient: _renew_subs 2021-05-26T16:43:55.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd92434700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:55.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c13cb40 con 0x7fcd8c064a20 2021-05-26T16:43:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcd80002700 con 0x7fcd8c064a20 2021-05-26T16:43:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd80002bb0 con 0x7fcd8c064a20 2021-05-26T16:43:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd8a7fc700 4 set_mon_vals no callback set 2021-05-26T16:43:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.953+0000 7fcd77fff700 10 monclient: dump: 2021-05-26T16:43:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.040 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.954+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fcd80002d90 con 0x7fcd8c064a20 2021-05-26T16:43:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.954+0000 7fcd92434700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.954+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fcd640065a0 con 0x7fcd64002840 2021-05-26T16:43:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.954+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(117..117 src has 1..117) v4 ==== 3941+0+0 (unknown 916088812 0 0) 0x7fcd8003dd40 con 0x7fcd8c064a20 2021-05-26T16:43:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.954+0000 7fcd8b7fe700 10 monclient: get_auth_request con 0x7fcd6c033280 auth_method 0 2021-05-26T16:43:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd8bfff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd64002840 legacy=0x7fcd64004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213532933 0 0) 0x7fcd640065a0 con 0x7fcd64002840 2021-05-26T16:43:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 10 monclient(hunting): my global_id is 104363 2021-05-26T16:43:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8c1168c0 con 0x7fcd64002840 2021-05-26T16:43:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3998833135 0 0) 0x7fcd8c1168c0 con 0x7fcd64002840 2021-05-26T16:43:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd640065a0 con 0x7fcd64002840 2021-05-26T16:43:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd7c001580 con 0x7fcd64002840 2021-05-26T16:43:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 10 monclient: dump: 2021-05-26T16:43:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.048 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4034989404 0 0) 0x7fcd640065a0 con 0x7fcd64002840 2021-05-26T16:43:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.956+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd64009e40 con 0x7fcd64002840 2021-05-26T16:43:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.957+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fcd7c007340 con 0x7fcd64002840 2021-05-26T16:43:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.957+0000 7fcd77fff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.957+0000 7fcd77fff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.957+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd64002840 legacy=0x7fcd64004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.957+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd64002840 legacy=0x7fcd64004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.963+0000 7fcd92434700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.963+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fcd64009ad0 con 0x7fcd64008d90 2021-05-26T16:43:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd8bfff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd64008d90 legacy=0x7fcd64009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100987640 0 0) 0x7fcd64009ad0 con 0x7fcd64008d90 2021-05-26T16:43:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient(hunting): my global_id is 104372 2021-05-26T16:43:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd640065a0 con 0x7fcd64008d90 2021-05-26T16:43:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 624445681 0 0) 0x7fcd640065a0 con 0x7fcd64008d90 2021-05-26T16:43:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd64009ad0 con 0x7fcd64008d90 2021-05-26T16:43:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fcd7c001cb0 con 0x7fcd64008d90 2021-05-26T16:43:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient: dump: 2021-05-26T16:43:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.057 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3291290197 0 0) 0x7fcd64009ad0 con 0x7fcd64008d90 2021-05-26T16:43:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 --> v1:172.21.15.3:6793/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcd64008740 con 0x7fcd64008d90 2021-05-26T16:43:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7311 (unknown 0 0 4255852637) 0x7fcd7c007010 con 0x7fcd64008d90 2021-05-26T16:43:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:55.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:55.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd64008d90 legacy=0x7fcd64009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.966+0000 7fcd77fff700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd64008d90 legacy=0x7fcd64009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.059 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:55.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:55.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:55.060 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:55.060 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:55.060 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:55.060 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:55.060 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:55.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:55.061 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:55.061 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:55.061 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:55.062 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:55.062 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:55.062 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.062 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:43:55.063 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.063 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:55.063 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:55.063 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.064 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.064 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.064 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.064 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.065 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.065 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.065 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.066 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.066 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:55.066 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:55.066 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.067 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.067 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.067 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.067 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.068 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.068 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.068 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.068 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.069 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.069 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:55.069 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:55.070 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:55.070 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:55.070 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:55.070 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:55.071 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.071 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.071 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:55.071 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:55.071 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:55.072 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:55.072 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:55.072 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.072 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:55.073 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.073 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.073 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.073 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.074 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.074 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.074 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.074 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.075 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.075 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.075 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:55.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.076 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:55.076 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.076 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:55.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:55.077 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.077 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.077 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.077 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.078 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:55.078 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.078 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.078 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.079 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.079 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.079 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.079 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.080 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.080 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.081 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:55.081 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:55.081 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.081 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.081 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.084 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.084 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.084 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.085 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:55.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:55.085 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.085 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.086 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.086 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.086 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:55.086 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.087 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.087 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.087 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.088 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.088 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.088 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.088 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.089 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.089 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:55.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:55.090 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.090 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.090 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.090 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.091 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:55.091 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.091 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.091 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.092 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.092 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.092 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.092 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.093 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.093 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:55.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:55.094 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.094 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.094 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.094 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.095 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:55.095 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.095 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.095 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.096 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.096 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.096 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.096 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.097 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.097 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.097 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:55.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:55.098 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.098 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.098 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.099 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:55.099 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.099 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.099 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.100 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.100 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.100 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.101 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.101 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.102 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:55.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:55.102 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.102 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.103 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.103 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:55.103 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.103 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.104 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.104 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.104 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.104 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.105 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.105 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.106 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:55.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:55.106 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.106 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.106 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.107 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.107 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:55.107 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.107 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.108 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.108 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.108 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.109 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.109 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.109 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.109 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.110 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:55.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:55.110 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.110 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.110 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.111 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.111 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:55.111 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.111 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.112 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.112 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.112 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.113 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.113 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.113 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.113 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.113 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.114 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:55.114 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:55.114 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.115 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.115 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.115 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:55.115 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.115 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.116 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:55.116 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.116 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.116 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.117 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:55.117 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.117 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.117 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:55.118 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:55.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.137:6812/30003 conn(0x7fcd6c033280 legacy=0x7fcd6c035740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 10 monclient: shutdown 2021-05-26T16:43:55.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 >> v1:172.21.15.3:6793/0 conn(0x7fcd8c064a20 legacy=0x7fcd8c144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd909d1700 1 -- 172.21.15.3:0/2515889352 reap_dead start 2021-05-26T16:43:55.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd909d1700 1 -- 172.21.15.3:0/2515889352 reap_dead start 2021-05-26T16:43:55.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 shutdown_connections 2021-05-26T16:43:55.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 >> 172.21.15.3:0/2515889352 conn(0x7fcd8c0a0db0 msgr2=0x7fcd8c09ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 shutdown_connections 2021-05-26T16:43:55.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:54.967+0000 7fcd92434700 1 -- 172.21.15.3:0/2515889352 wait complete. 2021-05-26T16:43:55.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2021-05-26T16:43:55.238 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.235+0000 7f6311e15700 10 monclient: get_monmap_and_config 2021-05-26T16:43:55.239 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.235+0000 7f6311e15700 10 monclient: build_initial_monmap 2021-05-26T16:43:55.239 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.235+0000 7f6311e15700 10 monclient: monmap: 2021-05-26T16:43:55.239 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:55.240 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.240 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:55.237206+0000 2021-05-26T16:43:55.240 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:55.237206+0000 2021-05-26T16:43:55.240 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:55.240 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.241 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:55.241 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:55.241 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:55.241 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:55.242 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:55.242 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:55.242 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:55.242 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:55.242 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:55.243 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 1 Processor -- start 2021-05-26T16:43:55.254 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 1 -- start start 2021-05-26T16:43:55.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient: init 2021-05-26T16:43:55.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:55.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient: _add_conns ranks=[0,1,7,4,8,2,3,6,5] 2021-05-26T16:43:55.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient(hunting): picked mon.noname-a con 0x7f630c12cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:55.255 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient(hunting): picked mon.noname-f con 0x7f630c099a30 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:55.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient(hunting): picked mon.noname-i con 0x7f630c099eb0 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:55.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c046600 con 0x7f630c12cbd0 2021-05-26T16:43:55.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c09b5e0 con 0x7f630c099a30 2021-05-26T16:43:55.256 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c12d8f0 con 0x7f630c099eb0 2021-05-26T16:43:55.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:55.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6311e15700 10 monclient(hunting): authenticate will time out at 992.868856s 2021-05-26T16:43:55.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6310e13700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f630c12cbd0 0x7f630c12d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52718/0 (socket says 172.21.15.3:52718) 2021-05-26T16:43:55.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.236+0000 7f6310e13700 1 -- 172.21.15.3:0/2788393764 learned_addr learned my addr 172.21.15.3:0/2788393764 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:55.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6310e13700 1 -- 172.21.15.3:0/2788393764 >> v1:172.21.15.3:6789/0 conn(0x7f630c12cbd0 legacy=0x7f630c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194803857 0 0) 0x7f630c046600 con 0x7f630c12cbd0 2021-05-26T16:43:55.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient(hunting): my global_id is 104328 2021-05-26T16:43:55.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f8003270 con 0x7f630c12cbd0 2021-05-26T16:43:55.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6303fff700 1 -- 172.21.15.3:0/2788393764 >> v1:172.21.15.137:6789/0 conn(0x7f630c099a30 legacy=0x7f630c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6311614700 1 -- 172.21.15.3:0/2788393764 >> v1:172.21.15.137:6792/0 conn(0x7f630c099eb0 legacy=0x7f630c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4150488138 0 0) 0x7f62f8003270 con 0x7f630c12cbd0 2021-05-26T16:43:55.259 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 >> v1:172.21.15.137:6792/0 conn(0x7f630c099eb0 legacy=0x7f630c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 >> v1:172.21.15.137:6789/0 conn(0x7f630c099a30 legacy=0x7f630c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: _finish_hunting 0 2021-05-26T16:43:55.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 monclient: found mon.noname-a 2021-05-26T16:43:55.260 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:55.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:43:55.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c09c2b0 con 0x7f630c12cbd0 2021-05-26T16:43:55.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: _finish_auth 0 2021-05-26T16:43:55.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:55.261 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f62fc001a60 con 0x7f630c12cbd0 2021-05-26T16:43:55.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6311e15700 5 monclient: authenticate success, global_id 104328 2021-05-26T16:43:55.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6311e15700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:55.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.262 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:55.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: dump: 2021-05-26T16:43:55.263 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.263 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.263 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.263 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.264 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.264 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.264 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.264 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.264 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.265 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.265 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.265 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.265 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.266 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.266 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.266 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6311e15700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:55.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f62fc001d70 con 0x7f630c12cbd0 2021-05-26T16:43:55.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:55.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 1 -- 172.21.15.3:0/2788393764 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f62fc004930 con 0x7f630c12cbd0 2021-05-26T16:43:55.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6311e15700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:55.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f6311e15700 4 set_mon_vals no callback set 2021-05-26T16:43:55.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:55.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.239+0000 7f63037fe700 10 monclient: dump: 2021-05-26T16:43:55.268 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.268 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.269 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.269 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.269 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.269 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.269 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.270 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.270 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.270 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.270 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.271 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.271 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.271 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.271 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.271 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 10 monclient: shutdown 2021-05-26T16:43:55.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 1 -- 172.21.15.3:0/2788393764 >> v1:172.21.15.3:6789/0 conn(0x7f630c12cbd0 legacy=0x7f630c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 1 -- 172.21.15.3:0/2788393764 shutdown_connections 2021-05-26T16:43:55.272 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 1 -- 172.21.15.3:0/2788393764 >> 172.21.15.3:0/2788393764 conn(0x7f630c0a00c0 msgr2=0x7f630c0a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 1 -- 172.21.15.3:0/2788393764 shutdown_connections 2021-05-26T16:43:55.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 1 -- 172.21.15.3:0/2788393764 wait complete. 2021-05-26T16:43:55.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 10 monclient: build_initial_monmap 2021-05-26T16:43:55.273 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.240+0000 7f6311e15700 10 monclient: monmap: 2021-05-26T16:43:55.274 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:55.274 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:55.274 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:55.274 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:55.274 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:55.275 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.275 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:55.275 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:55.275 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:55.276 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:55.276 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:55.276 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:55.276 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:55.276 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:55.277 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:55.277 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 1 Processor -- start 2021-05-26T16:43:55.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 1 -- start start 2021-05-26T16:43:55.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient: init 2021-05-26T16:43:55.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:55.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient: _add_conns ranks=[1,6,2,7,5,3,4,0,8] 2021-05-26T16:43:55.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient(hunting): picked mon.noname-f con 0x7f630c099a30 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:55.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient(hunting): picked mon.noname-d con 0x7f630c099eb0 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:55.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient(hunting): picked mon.noname-b con 0x7f630c12cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:55.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c116da0 con 0x7f630c099a30 2021-05-26T16:43:55.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c117040 con 0x7f630c12cbd0 2021-05-26T16:43:55.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c1165c0 con 0x7f630c099eb0 2021-05-26T16:43:55.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311e15700 10 monclient(hunting): authenticate will time out at 992.873786s 2021-05-26T16:43:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311614700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f630c12cbd0 0x7f630c144950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:54770/0 (socket says 172.21.15.3:54770) 2021-05-26T16:43:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6303fff700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f630c099eb0 0x7f630c141220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58126/0 (socket says 172.21.15.3:58126) 2021-05-26T16:43:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.241+0000 7f6311614700 1 -- 172.21.15.3:0/257186105 learned_addr learned my addr 172.21.15.3:0/257186105 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6303fff700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.3:6792/0 conn(0x7f630c099eb0 legacy=0x7f630c141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311614700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.3:6790/0 conn(0x7f630c12cbd0 legacy=0x7f630c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6310e13700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f630c099a30 legacy=0x7f630c129600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116833265 0 0) 0x7f630c1165c0 con 0x7f630c099eb0 2021-05-26T16:43:55.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): my global_id is 5109 2021-05-26T16:43:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62ec003270 con 0x7f630c099eb0 2021-05-26T16:43:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331725835 0 0) 0x7f630c117040 con 0x7f630c12cbd0 2021-05-26T16:43:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): my global_id is 5150 2021-05-26T16:43:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f630c1165c0 con 0x7f630c12cbd0 2021-05-26T16:43:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806308191 0 0) 0x7f630c116da0 con 0x7f630c099a30 2021-05-26T16:43:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): my global_id is 5131 2021-05-26T16:43:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f630c117040 con 0x7f630c099a30 2021-05-26T16:43:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 761840765 0 0) 0x7f62ec003270 con 0x7f630c099eb0 2021-05-26T16:43:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f630c116da0 con 0x7f630c099eb0 2021-05-26T16:43:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3650510711 0 0) 0x7f630c1165c0 con 0x7f630c12cbd0 2021-05-26T16:43:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f62ec003270 con 0x7f630c12cbd0 2021-05-26T16:43:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1661950224 0 0) 0x7f630c117040 con 0x7f630c099a30 2021-05-26T16:43:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f630c1165c0 con 0x7f630c099a30 2021-05-26T16:43:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f62f4001cb0 con 0x7f630c099eb0 2021-05-26T16:43:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): dump: 2021-05-26T16:43:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.290 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:55.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f6308002100 con 0x7f630c12cbd0 2021-05-26T16:43:55.290 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): dump: 2021-05-26T16:43:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.294 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f62fc001320 con 0x7f630c099a30 2021-05-26T16:43:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient(hunting): dump: 2021-05-26T16:43:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.296 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.296 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.296 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.296 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.296 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.299 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1369491660 0 0) 0x7f630c1165c0 con 0x7f630c099a30 2021-05-26T16:43:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.3:6792/0 conn(0x7f630c099eb0 legacy=0x7f630c141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.3:6790/0 conn(0x7f630c12cbd0 legacy=0x7f630c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:43:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 monclient: found mon.f 2021-05-26T16:43:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:43:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c096050 con 0x7f630c099a30 2021-05-26T16:43:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 10 monclient: _finish_auth 0 2021-05-26T16:43:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6300ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311e15700 5 monclient: authenticate success, global_id 5131 2021-05-26T16:43:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311e15700 10 monclient: _renew_subs 2021-05-26T16:43:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311e15700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:43:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c095570 con 0x7f630c099a30 2021-05-26T16:43:55.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311e15700 10 monclient: _renew_subs 2021-05-26T16:43:55.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311e15700 10 monclient: _send_mon_message to mon.f at v1:172.21.15.137:6789/0 2021-05-26T16:43:55.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.244+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c131580 con 0x7f630c099a30 2021-05-26T16:43:55.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f62fc001540 con 0x7f630c099a30 2021-05-26T16:43:55.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:55.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f62fc004ee0 con 0x7f630c099a30 2021-05-26T16:43:55.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:55.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6302ffd700 4 set_mon_vals no callback set 2021-05-26T16:43:55.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 10 monclient: dump: 2021-05-26T16:43:55.304 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.304 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.304 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.306 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.306 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.306 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.306 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.306 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.307 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.307 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.307 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6311e15700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f62fc005100 con 0x7f630c099a30 2021-05-26T16:43:55.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f62e40065a0 con 0x7f62e4002840 2021-05-26T16:43:55.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 8 ==== osd_map(117..117 src has 1..117) v4 ==== 3941+0+0 (unknown 916088812 0 0) 0x7f62fc03d910 con 0x7f630c099a30 2021-05-26T16:43:55.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.245+0000 7f6311614700 10 monclient: get_auth_request con 0x7f62ec0333c0 auth_method 0 2021-05-26T16:43:55.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6303fff700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f62e4002840 legacy=0x7f62e4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846443961 0 0) 0x7f62e40065a0 con 0x7f62e4002840 2021-05-26T16:43:55.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 10 monclient(hunting): my global_id is 5140 2021-05-26T16:43:55.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f630c1165c0 con 0x7f62e4002840 2021-05-26T16:43:55.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 519791264 0 0) 0x7f630c1165c0 con 0x7f62e4002840 2021-05-26T16:43:55.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f62e40065a0 con 0x7f62e4002840 2021-05-26T16:43:55.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f62f4001f80 con 0x7f62e4002840 2021-05-26T16:43:55.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:55.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 10 monclient: dump: 2021-05-26T16:43:55.311 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.311 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.311 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.312 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.312 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.312 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.312 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.313 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.313 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.313 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.313 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.313 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.314 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.314 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.314 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.314 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.314 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4188647883 0 0) 0x7f62e40065a0 con 0x7f62e4002840 2021-05-26T16:43:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.248+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62e4009e40 con 0x7f62e4002840 2021-05-26T16:43:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.249+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f62f4005510 con 0x7f62e4002840 2021-05-26T16:43:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.249+0000 7f6300ff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.249+0000 7f6300ff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.249+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f62e4002840 legacy=0x7f62e4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.249+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f62e4002840 legacy=0x7f62e4004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.255+0000 7f6311e15700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.255+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f62e4009ab0 con 0x7f62e4008d70 2021-05-26T16:43:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6303fff700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f62e4008d70 legacy=0x7f62e4009200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175204107 0 0) 0x7f62e4009ab0 con 0x7f62e4008d70 2021-05-26T16:43:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 10 monclient(hunting): my global_id is 5149 2021-05-26T16:43:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e40065a0 con 0x7f62e4008d70 2021-05-26T16:43:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1963100835 0 0) 0x7f62e40065a0 con 0x7f62e4008d70 2021-05-26T16:43:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f62e4009ab0 con 0x7f62e4008d70 2021-05-26T16:43:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f62f4002d90 con 0x7f62e4008d70 2021-05-26T16:43:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 10 monclient: dump: 2021-05-26T16:43:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.324 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1290165 0 0) 0x7f62e4009ab0 con 0x7f62e4008d70 2021-05-26T16:43:55.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.258+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 --> v1:172.21.15.137:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f62e4008740 con 0x7f62e4008d70 2021-05-26T16:43:55.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7481 (unknown 0 0 323810428) 0x7f62f4005f70 con 0x7f62e4008d70 2021-05-26T16:43:55.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6300ff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:55.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6300ff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:55.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f62e4008d70 legacy=0x7f62e4009200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6300ff9700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f62e4008d70 legacy=0x7f62e4009200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.326 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:55.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:55.328 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:55.328 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:55.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:55.328 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:55.328 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:55.329 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:55.329 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:55.329 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:55.329 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.330 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:43:55.330 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.330 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:55.330 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:55.330 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.331 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.331 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.331 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.331 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.331 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.332 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.332 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.332 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.332 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.333 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:55.333 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:55.333 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.333 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.333 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.334 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.334 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.334 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.334 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.334 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.335 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.335 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.335 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:55.336 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:55.336 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:55.336 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:55.336 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:55.336 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:55.337 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.337 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.337 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:55.337 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:55.338 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:55.338 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:55.338 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:55.338 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.338 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:55.339 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.339 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.339 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.339 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.340 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.340 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.340 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.340 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.340 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.341 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.341 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:55.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.341 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:55.341 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.342 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:55.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:55.342 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.342 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.343 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.343 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.343 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:55.343 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.343 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.344 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.344 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.344 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.344 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.345 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.345 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.345 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.346 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:55.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:55.346 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.346 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.346 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.347 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.347 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:55.347 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.347 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.348 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.348 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.348 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.348 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.349 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.349 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.349 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.349 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:55.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:55.350 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.350 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.350 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.351 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.351 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:55.351 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.351 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.352 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.352 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.352 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.352 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.353 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.353 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.353 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.354 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:55.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:55.354 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.354 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.354 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.355 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.355 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:55.355 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.355 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.356 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.356 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.356 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.356 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.357 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.357 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.357 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.357 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:55.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:55.358 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.358 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.358 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.359 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.359 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:55.359 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.359 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.360 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.360 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.360 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.360 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.361 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.361 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.361 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.362 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:55.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:55.362 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.362 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.362 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.363 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.363 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:55.363 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.363 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.364 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.364 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.364 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.364 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.365 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.365 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.365 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.365 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:55.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:55.366 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.366 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.366 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.366 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.367 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:55.367 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.367 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.367 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.368 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.368 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.368 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.368 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.369 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.369 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.369 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:55.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:55.370 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.370 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.370 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.370 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.371 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:55.371 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.371 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.371 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.372 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.372 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.372 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.372 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.372 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.373 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.373 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:55.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:55.373 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.374 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.374 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.374 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.374 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:55.374 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.375 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.375 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.375 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.375 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.376 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.376 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.376 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.376 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.377 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.377 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:55.377 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:55.377 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.377 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.378 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.378 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:55.378 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.378 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.379 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:55.379 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.379 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.379 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.379 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:55.380 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.380 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.380 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:55.380 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.380 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.381 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.381 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:43:55.381 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.381 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.382 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:55.382 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:55.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6812/30003 conn(0x7f62ec0333c0 legacy=0x7f62ec035880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 10 monclient: shutdown 2021-05-26T16:43:55.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 >> v1:172.21.15.137:6789/0 conn(0x7f630c099a30 legacy=0x7f630c129600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311614700 1 -- 172.21.15.3:0/257186105 reap_dead start 2021-05-26T16:43:55.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311614700 1 -- 172.21.15.3:0/257186105 reap_dead start 2021-05-26T16:43:55.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 shutdown_connections 2021-05-26T16:43:55.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 >> 172.21.15.3:0/257186105 conn(0x7f630c0a00c0 msgr2=0x7f630c12b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 shutdown_connections 2021-05-26T16:43:55.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.259+0000 7f6311e15700 1 -- 172.21.15.3:0/257186105 wait complete. 2021-05-26T16:43:55.386 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2021-05-26T16:43:55.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.500+0000 7f9a4c5b6700 10 monclient: get_monmap_and_config 2021-05-26T16:43:55.503 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.500+0000 7f9a4c5b6700 10 monclient: build_initial_monmap 2021-05-26T16:43:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.500+0000 7f9a4c5b6700 10 monclient: monmap: 2021-05-26T16:43:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:55.501817+0000 2021-05-26T16:43:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:55.501817+0000 2021-05-26T16:43:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:55.506 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:55.506 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:55.506 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:55.506 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:55.507 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:55.507 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:55.507 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:55.507 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.500+0000 7f9a4c5b6700 1 Processor -- start 2021-05-26T16:43:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.500+0000 7f9a4c5b6700 1 -- start start 2021-05-26T16:43:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.500+0000 7f9a4c5b6700 10 monclient: init 2021-05-26T16:43:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 10 monclient: _add_conns ranks=[0,4,5,6,2,8,1,3,7] 2021-05-26T16:43:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 10 monclient(hunting): picked mon.noname-a con 0x7f9a44097860 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 10 monclient(hunting): picked mon.noname-c con 0x7f9a44093b60 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 10 monclient(hunting): picked mon.noname-h con 0x7f9a44130550 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44059750 con 0x7f9a44097860 2021-05-26T16:43:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44092e50 con 0x7f9a44093b60 2021-05-26T16:43:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44095d80 con 0x7f9a44130550 2021-05-26T16:43:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4c5b6700 10 monclient(hunting): authenticate will time out at 993.133451s 2021-05-26T16:43:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a49b51700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7f9a44093b60 legacy=0x7f9a44092740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4a352700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9a44097860 0x7f9a44092030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:52740/0 (socket says 172.21.15.3:52740) 2021-05-26T16:43:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.501+0000 7f9a4a352700 1 -- 172.21.15.3:0/3304847052 learned_addr learned my addr 172.21.15.3:0/3304847052 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.503+0000 7f9a4a352700 1 -- 172.21.15.3:0/3304847052 >> v1:172.21.15.3:6789/0 conn(0x7f9a44097860 legacy=0x7f9a44092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.503+0000 7f9a4ab53700 1 -- 172.21.15.3:0/3304847052 >> v1:172.21.15.137:6791/0 conn(0x7f9a44130550 legacy=0x7f9a44132940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.503+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546353149 0 0) 0x7f9a44059750 con 0x7f9a44097860 2021-05-26T16:43:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.503+0000 7f9a49350700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.503+0000 7f9a49350700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.503+0000 7f9a49350700 10 monclient(hunting): my global_id is 104337 2021-05-26T16:43:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.503+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a2c003270 con 0x7f9a44097860 2021-05-26T16:43:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774310895 0 0) 0x7f9a44095d80 con 0x7f9a44130550 2021-05-26T16:43:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient(hunting): my global_id is 5234 2021-05-26T16:43:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a44059750 con 0x7f9a44130550 2021-05-26T16:43:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3344402069 0 0) 0x7f9a2c003270 con 0x7f9a44097860 2021-05-26T16:43:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 >> v1:172.21.15.137:6791/0 conn(0x7f9a44130550 legacy=0x7f9a44132940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 >> v1:172.21.15.3:6791/0 conn(0x7f9a44093b60 legacy=0x7f9a44092740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: _finish_hunting 0 2021-05-26T16:43:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 monclient: found mon.noname-a 2021-05-26T16:43:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:43:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a44094540 con 0x7f9a44097860 2021-05-26T16:43:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: _finish_auth 0 2021-05-26T16:43:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a38001a60 con 0x7f9a44097860 2021-05-26T16:43:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 5 monclient: authenticate success, global_id 104337 2021-05-26T16:43:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:43:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: dump: 2021-05-26T16:43:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.532 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.532 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.532 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.532 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.532 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.533 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9a38001d70 con 0x7f9a44097860 2021-05-26T16:43:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 1 -- 172.21.15.3:0/3304847052 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a38004930 con 0x7f9a44097860 2021-05-26T16:43:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 4 set_mon_vals no callback set 2021-05-26T16:43:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a49350700 10 monclient: dump: 2021-05-26T16:43:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.538 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.538 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.538 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.538 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.538 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 10 monclient: shutdown 2021-05-26T16:43:55.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3304847052 >> v1:172.21.15.3:6789/0 conn(0x7f9a44097860 legacy=0x7f9a44092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3304847052 shutdown_connections 2021-05-26T16:43:55.539 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3304847052 >> 172.21.15.3:0/3304847052 conn(0x7f9a4405d960 msgr2=0x7f9a4405dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.504+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3304847052 shutdown_connections 2021-05-26T16:43:55.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.505+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3304847052 wait complete. 2021-05-26T16:43:55.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.505+0000 7f9a4c5b6700 10 monclient: build_initial_monmap 2021-05-26T16:43:55.540 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.505+0000 7f9a4c5b6700 10 monclient: monmap: 2021-05-26T16:43:55.540 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:55.541 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:55.541 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:55.541 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:55.541 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:55.541 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.542 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:55.542 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:55.542 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:55.542 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:55.543 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:55.543 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:55.543 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:55.543 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:55.543 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:55.544 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.505+0000 7f9a4c5b6700 1 Processor -- start 2021-05-26T16:43:55.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.505+0000 7f9a4c5b6700 1 -- start start 2021-05-26T16:43:55.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.505+0000 7f9a4c5b6700 10 monclient: init 2021-05-26T16:43:55.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:55.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 10 monclient: _add_conns ranks=[6,8,1,4,3,7,2,5,0] 2021-05-26T16:43:55.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 10 monclient(hunting): picked mon.noname-d con 0x7f9a44093b60 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:55.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 10 monclient(hunting): picked mon.noname-e con 0x7f9a44097860 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:55.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 10 monclient(hunting): picked mon.noname-f con 0x7f9a44130550 addr v1:172.21.15.137:6789/0 2021-05-26T16:43:55.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44095a80 con 0x7f9a44130550 2021-05-26T16:43:55.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44129c10 con 0x7f9a44093b60 2021-05-26T16:43:55.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4412b7d0 con 0x7f9a44097860 2021-05-26T16:43:55.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:55.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4c5b6700 10 monclient(hunting): authenticate will time out at 993.138330s 2021-05-26T16:43:55.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4a352700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f9a44093b60 0x7f9a44128df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58146/0 (socket says 172.21.15.3:58146) 2021-05-26T16:43:55.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.506+0000 7f9a4a352700 1 -- 172.21.15.3:0/3096844455 learned_addr learned my addr 172.21.15.3:0/3096844455 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:55.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a4a352700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.3:6792/0 conn(0x7f9a44093b60 legacy=0x7f9a44128df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a49b51700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.3:6793/0 conn(0x7f9a44097860 legacy=0x7f9a44129500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957461040 0 0) 0x7f9a44129c10 con 0x7f9a44093b60 2021-05-26T16:43:55.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): my global_id is 5118 2021-05-26T16:43:55.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a24003270 con 0x7f9a44093b60 2021-05-26T16:43:55.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a4ab53700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6789/0 conn(0x7f9a44130550 legacy=0x7f9a44144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819880661 0 0) 0x7f9a4412b7d0 con 0x7f9a44097860 2021-05-26T16:43:55.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): my global_id is 104381 2021-05-26T16:43:55.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a44129c10 con 0x7f9a44097860 2021-05-26T16:43:55.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897276146 0 0) 0x7f9a44095a80 con 0x7f9a44130550 2021-05-26T16:43:55.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 10 monclient(hunting): my global_id is 5158 2021-05-26T16:43:55.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.508+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a4412b7d0 con 0x7f9a44130550 2021-05-26T16:43:55.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 609437405 0 0) 0x7f9a24003270 con 0x7f9a44093b60 2021-05-26T16:43:55.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a44095a80 con 0x7f9a44093b60 2021-05-26T16:43:55.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a38004870 con 0x7f9a44093b60 2021-05-26T16:43:55.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:43:55.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): dump: 2021-05-26T16:43:55.553 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.553 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.553 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.553 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.553 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.554 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.554 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.554 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.554 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.556 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.556 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:55.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2295353797 0 0) 0x7f9a44129c10 con 0x7f9a44097860 2021-05-26T16:43:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a24003270 con 0x7f9a44097860 2021-05-26T16:43:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a34004270 con 0x7f9a44097860 2021-05-26T16:43:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): dump: 2021-05-26T16:43:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.560 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.560 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.560 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.560 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.560 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.561 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1567281579 0 0) 0x7f9a4412b7d0 con 0x7f9a44130550 2021-05-26T16:43:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a44129c10 con 0x7f9a44130550 2021-05-26T16:43:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a40002040 con 0x7f9a44130550 2021-05-26T16:43:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:43:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient(hunting): dump: 2021-05-26T16:43:55.563 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.563 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.563 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.563 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.563 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.566 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1518709728 0 0) 0x7f9a44095a80 con 0x7f9a44093b60 2021-05-26T16:43:55.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.3:6793/0 conn(0x7f9a44097860 legacy=0x7f9a44129500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6789/0 conn(0x7f9a44130550 legacy=0x7f9a44144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient: _finish_hunting 0 2021-05-26T16:43:55.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 monclient: found mon.d 2021-05-26T16:43:55.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:55.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:55.567 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4412ba70 con 0x7f9a44093b60 2021-05-26T16:43:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient: _finish_auth 0 2021-05-26T16:43:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a4c5b6700 5 monclient: authenticate success, global_id 5118 2021-05-26T16:43:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a4c5b6700 10 monclient: _renew_subs 2021-05-26T16:43:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a4c5b6700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a44130240 con 0x7f9a44093b60 2021-05-26T16:43:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a4c5b6700 10 monclient: _renew_subs 2021-05-26T16:43:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a4c5b6700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:43:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4412be30 con 0x7f9a44093b60 2021-05-26T16:43:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9a38004f60 con 0x7f9a44093b60 2021-05-26T16:43:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a38001580 con 0x7f9a44093b60 2021-05-26T16:43:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a48b4f700 4 set_mon_vals no callback set 2021-05-26T16:43:55.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:55.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.509+0000 7f9a327fc700 10 monclient: dump: 2021-05-26T16:43:55.571 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.573 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.573 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.573 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.574 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.574 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.574 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.574 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.575 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.575 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.575 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.510+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f9a3800e820 con 0x7f9a44093b60 2021-05-26T16:43:55.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.510+0000 7f9a4c5b6700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.510+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9a280065a0 con 0x7f9a28002840 2021-05-26T16:43:55.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.510+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(117..117 src has 1..117) v4 ==== 3941+0+0 (unknown 916088812 0 0) 0x7f9a3803dc50 con 0x7f9a44093b60 2021-05-26T16:43:55.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.510+0000 7f9a4ab53700 10 monclient: get_auth_request con 0x7f9a240333c0 auth_method 0 2021-05-26T16:43:55.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a49b51700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6790/0 conn(0x7f9a28002840 legacy=0x7f9a28004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641085115 0 0) 0x7f9a280065a0 con 0x7f9a28002840 2021-05-26T16:43:55.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 10 monclient(hunting): my global_id is 5097 2021-05-26T16:43:55.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a44095a80 con 0x7f9a28002840 2021-05-26T16:43:55.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 368446982 0 0) 0x7f9a44095a80 con 0x7f9a28002840 2021-05-26T16:43:55.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a280065a0 con 0x7f9a28002840 2021-05-26T16:43:55.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a34004ac0 con 0x7f9a28002840 2021-05-26T16:43:55.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:55.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.512+0000 7f9a327fc700 10 monclient: dump: 2021-05-26T16:43:55.579 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.580 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.580 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.580 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.580 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.581 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.581 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.581 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.581 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.581 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.582 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.582 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.582 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.582 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.583 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.583 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.513+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1061303372 0 0) 0x7f9a280065a0 con 0x7f9a28002840 2021-05-26T16:43:55.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.513+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a28009e40 con 0x7f9a28002840 2021-05-26T16:43:55.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.513+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f9a34005080 con 0x7f9a28002840 2021-05-26T16:43:55.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.513+0000 7f9a327fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.513+0000 7f9a327fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:55.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.513+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6790/0 conn(0x7f9a28002840 legacy=0x7f9a28004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.513+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6790/0 conn(0x7f9a28002840 legacy=0x7f9a28004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.520+0000 7f9a4c5b6700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.520+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9a28007510 con 0x7f9a280068b0 2021-05-26T16:43:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.522+0000 7f9a49b51700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6790/0 conn(0x7f9a280068b0 legacy=0x7f9a28006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950010376 0 0) 0x7f9a28007510 con 0x7f9a280068b0 2021-05-26T16:43:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient(hunting): my global_id is 5106 2021-05-26T16:43:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a280065a0 con 0x7f9a280068b0 2021-05-26T16:43:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3177654536 0 0) 0x7f9a280065a0 con 0x7f9a280068b0 2021-05-26T16:43:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a28007510 con 0x7f9a280068b0 2021-05-26T16:43:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9a340058b0 con 0x7f9a280068b0 2021-05-26T16:43:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:55.591 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient: dump: 2021-05-26T16:43:55.591 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.591 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.591 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.592 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.592 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.592 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.595 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2549758337 0 0) 0x7f9a28007510 con 0x7f9a280068b0 2021-05-26T16:43:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 --> v1:172.21.15.137:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9a28008770 con 0x7f9a280068b0 2021-05-26T16:43:55.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7651 (unknown 0 0 3222700660) 0x7f9a34005a60 con 0x7f9a280068b0 2021-05-26T16:43:55.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:55.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:55.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6790/0 conn(0x7f9a280068b0 legacy=0x7f9a28006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.523+0000 7f9a327fc700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6790/0 conn(0x7f9a280068b0 legacy=0x7f9a28006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.597 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:55.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:55.598 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:55.598 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:55.598 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:55.598 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:55.598 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:55.599 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:55.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:55.599 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:55.599 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:55.600 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:55.600 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:55.600 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:55.600 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.600 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:43:55.601 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.601 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:55.601 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:55.601 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.602 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.602 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.602 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.602 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.602 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.603 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.603 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.603 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.603 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.604 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:55.604 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:55.604 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.604 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.604 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.605 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.605 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.605 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.606 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.606 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.606 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.607 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.607 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:55.607 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:55.607 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:55.608 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:55.608 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:55.608 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:55.608 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.609 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.609 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:55.609 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:55.609 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:55.609 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:55.610 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:55.610 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.610 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:55.610 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.611 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.611 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.611 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.611 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.611 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.612 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.612 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.612 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.612 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.612 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:55.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.613 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:55.613 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.613 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:55.614 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:55.614 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.614 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.614 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.614 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.615 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:55.615 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.615 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.616 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.616 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.616 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.616 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.617 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.617 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.617 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.617 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.617 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:55.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:55.618 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.618 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.618 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.619 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.619 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:55.619 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.619 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.619 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.620 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.620 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.620 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.621 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.621 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.621 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.621 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:55.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:55.622 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.622 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.622 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.623 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.623 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:55.623 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.623 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.623 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.624 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.624 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.624 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.624 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.625 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.625 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.625 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.626 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:55.626 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:55.626 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.626 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.627 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.627 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.627 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:55.627 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.628 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.628 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.628 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.629 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.629 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.629 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.629 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.630 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.630 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:55.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:55.630 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.631 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.631 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.631 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.631 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:55.632 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.632 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.632 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.632 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.632 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.633 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.633 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.633 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.633 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.633 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.634 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.634 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:55.634 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:55.634 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.645 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.645 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.645 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.645 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.646 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.646 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.646 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.646 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:55.647 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:55.647 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.647 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.648 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.648 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.648 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:55.648 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:43:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4 2021-05-26T16:43:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": [ 2021-05-26T16:43:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:55.658 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:55.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.137:6812/30003 conn(0x7f9a240333c0 legacy=0x7f9a24035880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.660 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 10 monclient: shutdown 2021-05-26T16:43:55.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 >> v1:172.21.15.3:6792/0 conn(0x7f9a44093b60 legacy=0x7f9a44128df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4ab53700 1 -- 172.21.15.3:0/3096844455 reap_dead start 2021-05-26T16:43:55.661 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4ab53700 1 -- 172.21.15.3:0/3096844455 reap_dead start 2021-05-26T16:43:55.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 shutdown_connections 2021-05-26T16:43:55.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 >> 172.21.15.3:0/3096844455 conn(0x7f9a4405d960 msgr2=0x7f9a44099070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 shutdown_connections 2021-05-26T16:43:55.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.524+0000 7f9a4c5b6700 1 -- 172.21.15.3:0/3096844455 wait complete. 2021-05-26T16:43:55.663 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2021-05-26T16:43:55.759 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:55.759 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34864]: starting. 2021-05-26T16:43:55.759 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34864]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34828 2021-05-26T16:43:55.760 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34864]: shutting down. 2021-05-26T16:43:55.760 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:55.761 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:43:55.761 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:43:55.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:43:55.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.787+0000 7fd87fc4f700 10 monclient: get_monmap_and_config 2021-05-26T16:43:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.787+0000 7fd87fc4f700 10 monclient: build_initial_monmap 2021-05-26T16:43:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.787+0000 7fd87fc4f700 10 monclient: monmap: 2021-05-26T16:43:55.792 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:55.792 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.792 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:55.788634+0000 2021-05-26T16:43:55.792 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:55.788634+0000 2021-05-26T16:43:55.792 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:55.795 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:55.796 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:55.796 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:55.796 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:55.797 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.787+0000 7fd87fc4f700 1 Processor -- start 2021-05-26T16:43:55.797 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.787+0000 7fd87fc4f700 1 -- start start 2021-05-26T16:43:55.798 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.787+0000 7fd87fc4f700 10 monclient: init 2021-05-26T16:43:55.809 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:55.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 10 monclient: _add_conns ranks=[8,4,5,7,3,6,1,2,0] 2021-05-26T16:43:55.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 10 monclient(hunting): picked mon.noname-e con 0x7fd878064a20 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:55.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 10 monclient(hunting): picked mon.noname-c con 0x7fd878063e30 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:55.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 10 monclient(hunting): picked mon.noname-h con 0x7fd8780642e0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:55.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878059750 con 0x7fd878063e30 2021-05-26T16:43:55.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878064e00 con 0x7fd8780642e0 2021-05-26T16:43:55.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87809c770 con 0x7fd878064a20 2021-05-26T16:43:55.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:55.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87fc4f700 10 monclient(hunting): authenticate will time out at 993.420330s 2021-05-26T16:43:55.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87d1ea700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7fd878063e30 legacy=0x7fd878132080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:55.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87d9eb700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fd878064a20 0x7fd878099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53838/0 (socket says 172.21.15.3:53838) 2021-05-26T16:43:55.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.788+0000 7fd87d9eb700 1 -- 172.21.15.3:0/3659619761 learned_addr learned my addr 172.21.15.3:0/3659619761 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:55.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.790+0000 7fd87d9eb700 1 -- 172.21.15.3:0/3659619761 >> v1:172.21.15.3:6793/0 conn(0x7fd878064a20 legacy=0x7fd878099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.790+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235092894 0 0) 0x7fd87809c770 con 0x7fd878064a20 2021-05-26T16:43:55.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.790+0000 7fd87c9e9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.790+0000 7fd87c9e9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.790+0000 7fd87c9e9700 10 monclient(hunting): my global_id is 104390 2021-05-26T16:43:55.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.790+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd860003270 con 0x7fd878064a20 2021-05-26T16:43:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.790+0000 7fd87e1ec700 1 -- 172.21.15.3:0/3659619761 >> v1:172.21.15.137:6791/0 conn(0x7fd8780642e0 legacy=0x7fd8781357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816239707 0 0) 0x7fd860003270 con 0x7fd878064a20 2021-05-26T16:43:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 >> v1:172.21.15.137:6791/0 conn(0x7fd8780642e0 legacy=0x7fd8781357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 >> v1:172.21.15.3:6791/0 conn(0x7fd878063e30 legacy=0x7fd878132080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: _finish_hunting 0 2021-05-26T16:43:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 monclient: found mon.noname-e 2021-05-26T16:43:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:43:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780977a0 con 0x7fd878064a20 2021-05-26T16:43:55.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: _finish_auth 0 2021-05-26T16:43:55.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:55.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd86c001aa0 con 0x7fd878064a20 2021-05-26T16:43:55.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 5 monclient: authenticate success, global_id 104390 2021-05-26T16:43:55.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:55.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:55.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: dump: 2021-05-26T16:43:55.817 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.817 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.818 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.818 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.818 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.818 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.819 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.819 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.819 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.819 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.819 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.820 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.820 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.820 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.820 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.820 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:55.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd86c0045f0 con 0x7fd878064a20 2021-05-26T16:43:55.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:55.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 1 -- 172.21.15.3:0/3659619761 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd86c004ae0 con 0x7fd878064a20 2021-05-26T16:43:55.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:55.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 4 set_mon_vals no callback set 2021-05-26T16:43:55.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:55.822 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87c9e9700 10 monclient: dump: 2021-05-26T16:43:55.822 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.823 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.823 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.823 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.823 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.823 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.824 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.824 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.824 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.824 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.825 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.825 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.825 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.825 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.825 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.826 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 10 monclient: shutdown 2021-05-26T16:43:55.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 1 -- 172.21.15.3:0/3659619761 >> v1:172.21.15.3:6793/0 conn(0x7fd878064a20 legacy=0x7fd878099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 1 -- 172.21.15.3:0/3659619761 shutdown_connections 2021-05-26T16:43:55.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 1 -- 172.21.15.3:0/3659619761 >> 172.21.15.3:0/3659619761 conn(0x7fd8780a0db0 msgr2=0x7fd87809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 1 -- 172.21.15.3:0/3659619761 shutdown_connections 2021-05-26T16:43:55.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.791+0000 7fd87fc4f700 1 -- 172.21.15.3:0/3659619761 wait complete. 2021-05-26T16:43:55.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.792+0000 7fd87fc4f700 10 monclient: build_initial_monmap 2021-05-26T16:43:55.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.792+0000 7fd87fc4f700 10 monclient: monmap: 2021-05-26T16:43:55.828 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:55.828 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:55.828 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:55.828 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:55.829 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:55.829 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.829 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:55.829 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:55.829 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:55.830 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:55.830 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:55.830 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:55.830 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:55.830 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:55.831 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:55.831 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.792+0000 7fd87fc4f700 1 Processor -- start 2021-05-26T16:43:55.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.792+0000 7fd87fc4f700 1 -- start start 2021-05-26T16:43:55.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.792+0000 7fd87fc4f700 10 monclient: init 2021-05-26T16:43:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 10 monclient: _add_conns ranks=[8,0,6,2,3,4,1,5,7] 2021-05-26T16:43:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 10 monclient(hunting): picked mon.noname-e con 0x7fd878063e30 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 10 monclient(hunting): picked mon.noname-a con 0x7fd8780642e0 addr v1:172.21.15.3:6789/0 2021-05-26T16:43:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 10 monclient(hunting): picked mon.noname-d con 0x7fd878064a20 addr v1:172.21.15.3:6792/0 2021-05-26T16:43:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878116b60 con 0x7fd8780642e0 2021-05-26T16:43:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878116e00 con 0x7fd878064a20 2021-05-26T16:43:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8781170a0 con 0x7fd878063e30 2021-05-26T16:43:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87fc4f700 10 monclient(hunting): authenticate will time out at 993.425153s 2021-05-26T16:43:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87d9eb700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fd878063e30 0x7fd87813c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53844/0 (socket says 172.21.15.3:53844) 2021-05-26T16:43:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.793+0000 7fd87d9eb700 1 -- 172.21.15.3:0/237307368 learned_addr learned my addr 172.21.15.3:0/237307368 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd87d9eb700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.3:6793/0 conn(0x7fd878063e30 legacy=0x7fd87813c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd87d1ea700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.3:6789/0 conn(0x7fd8780642e0 legacy=0x7fd8781410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd87e1ec700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.3:6792/0 conn(0x7fd878064a20 legacy=0x7fd878144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210100538 0 0) 0x7fd8781170a0 con 0x7fd878063e30 2021-05-26T16:43:55.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): my global_id is 104399 2021-05-26T16:43:55.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd858003270 con 0x7fd878063e30 2021-05-26T16:43:55.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101514815 0 0) 0x7fd878116e00 con 0x7fd878064a20 2021-05-26T16:43:55.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): my global_id is 5127 2021-05-26T16:43:55.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8781170a0 con 0x7fd878064a20 2021-05-26T16:43:55.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263764379 0 0) 0x7fd878116b60 con 0x7fd8780642e0 2021-05-26T16:43:55.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): my global_id is 104346 2021-05-26T16:43:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd878116e00 con 0x7fd8780642e0 2021-05-26T16:43:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3589449932 0 0) 0x7fd858003270 con 0x7fd878063e30 2021-05-26T16:43:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd878116b60 con 0x7fd878063e30 2021-05-26T16:43:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd86c001ad0 con 0x7fd878063e30 2021-05-26T16:43:55.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:43:55.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:55.839 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.839 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.842 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.842 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.842 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.842 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4220395361 0 0) 0x7fd878116e00 con 0x7fd8780642e0 2021-05-26T16:43:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd858003270 con 0x7fd8780642e0 2021-05-26T16:43:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2053750782 0 0) 0x7fd8781170a0 con 0x7fd878064a20 2021-05-26T16:43:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.795+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd878116e00 con 0x7fd878064a20 2021-05-26T16:43:55.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd868004300 con 0x7fd8780642e0 2021-05-26T16:43:55.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:43:55.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:55.844 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.845 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.845 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.845 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.845 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.845 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.846 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.846 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.846 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.846 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.847 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.847 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.847 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.847 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.847 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.848 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd874002020 con 0x7fd878064a20 2021-05-26T16:43:55.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:43:55.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient(hunting): dump: 2021-05-26T16:43:55.849 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.849 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.849 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.849 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.850 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.850 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.850 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.850 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.850 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.851 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.851 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.851 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.851 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.851 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.852 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.852 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3562168666 0 0) 0x7fd878116b60 con 0x7fd878063e30 2021-05-26T16:43:55.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.3:6792/0 conn(0x7fd878064a20 legacy=0x7fd878144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.3:6789/0 conn(0x7fd8780642e0 legacy=0x7fd8781410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:43:55.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 monclient: found mon.e 2021-05-26T16:43:55.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:55.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:55.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87813cc30 con 0x7fd878063e30 2021-05-26T16:43:55.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient: _finish_auth 0 2021-05-26T16:43:55.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:55.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd87fc4f700 5 monclient: authenticate success, global_id 104399 2021-05-26T16:43:55.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd87fc4f700 10 monclient: _renew_subs 2021-05-26T16:43:55.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd87fc4f700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:55.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87812f310 con 0x7fd878063e30 2021-05-26T16:43:55.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd86c004d50 con 0x7fd878063e30 2021-05-26T16:43:55.855 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:55.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd86c005200 con 0x7fd878063e30 2021-05-26T16:43:55.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:43:55.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 10 monclient: dump: 2021-05-26T16:43:55.856 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.857 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.857 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.857 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.857 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.857 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.858 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.858 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.858 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.858 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.858 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.859 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.859 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.859 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.859 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.860 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd87fc4f700 10 monclient: _renew_subs 2021-05-26T16:43:55.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd867fff700 4 set_mon_vals no callback set 2021-05-26T16:43:55.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd87fc4f700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:43:55.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd878129d30 con 0x7fd878063e30 2021-05-26T16:43:55.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.796+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fd86c00e770 con 0x7fd878063e30 2021-05-26T16:43:55.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.797+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(118..118 src has 1..118) v4 ==== 3549+0+0 (unknown 3807207552 0 0) 0x7fd86c03d9c0 con 0x7fd878063e30 2021-05-26T16:43:55.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.797+0000 7fd87fc4f700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.797+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd87809bcd0 con 0x7fd87812fdf0 2021-05-26T16:43:55.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.797+0000 7fd87d1ea700 10 monclient: get_auth_request con 0x7fd858033590 auth_method 0 2021-05-26T16:43:55.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.799+0000 7fd87e1ec700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.137:6791/0 conn(0x7fd87812fdf0 legacy=0x7fd878058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.799+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367404738 0 0) 0x7fd87809bcd0 con 0x7fd87812fdf0 2021-05-26T16:43:55.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.799+0000 7fd865ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.799+0000 7fd865ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.799+0000 7fd865ffb700 10 monclient(hunting): my global_id is 5252 2021-05-26T16:43:55.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.799+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd878116b60 con 0x7fd87812fdf0 2021-05-26T16:43:55.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2580985688 0 0) 0x7fd878116b60 con 0x7fd87812fdf0 2021-05-26T16:43:55.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd87809bcd0 con 0x7fd87812fdf0 2021-05-26T16:43:55.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd874002280 con 0x7fd87812fdf0 2021-05-26T16:43:55.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:55.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 10 monclient: dump: 2021-05-26T16:43:55.864 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.865 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.865 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.865 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.865 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.865 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.866 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.866 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.866 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.866 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.866 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.867 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1452708099 0 0) 0x7fd87809bcd0 con 0x7fd87812fdf0 2021-05-26T16:43:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd87806c030 con 0x7fd87812fdf0 2021-05-26T16:43:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fd874002cb0 con 0x7fd87812fdf0 2021-05-26T16:43:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.137:6791/0 conn(0x7fd87812fdf0 legacy=0x7fd878058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.800+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.137:6791/0 conn(0x7fd87812fdf0 legacy=0x7fd878058d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.807+0000 7fd87fc4f700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:55.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.807+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd87809c180 con 0x7fd87812e750 2021-05-26T16:43:55.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.809+0000 7fd87e1ec700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.137:6791/0 conn(0x7fd87812e750 legacy=0x7fd878094a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:55.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.809+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636973458 0 0) 0x7fd87809c180 con 0x7fd87812e750 2021-05-26T16:43:55.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:55.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:55.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient(hunting): my global_id is 5261 2021-05-26T16:43:55.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87809bcd0 con 0x7fd87812e750 2021-05-26T16:43:55.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 429993611 0 0) 0x7fd87809bcd0 con 0x7fd87812e750 2021-05-26T16:43:55.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd87809c180 con 0x7fd87812e750 2021-05-26T16:43:55.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd874005bd0 con 0x7fd87812e750 2021-05-26T16:43:55.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:55.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:55.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient: dump: 2021-05-26T16:43:55.875 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:55.875 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:55.875 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.875 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:55.876 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:55.876 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:55.876 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:55.876 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:55.876 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:55.877 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:55.877 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:55.877 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:55.877 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:55.877 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:55.878 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:55.878 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:55.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4217249190 0 0) 0x7fd87809c180 con 0x7fd87812e750 2021-05-26T16:43:55.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 --> v1:172.21.15.137:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd878095170 con 0x7fd87812e750 2021-05-26T16:43:55.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7311 (unknown 0 0 683242095) 0x7fd874005f90 con 0x7fd87812e750 2021-05-26T16:43:55.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:55.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:55.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.137:6791/0 conn(0x7fd87812e750 legacy=0x7fd878094a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.810+0000 7fd865ffb700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.137:6791/0 conn(0x7fd87812e750 legacy=0x7fd878094a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:55.880 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:55.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:55.880 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:55.880 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:55.881 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:55.881 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:55.881 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:55.881 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:55.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:55.882 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:55.882 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:55.882 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:55.882 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:55.883 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:55.883 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.883 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:43:55.883 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.883 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:55.884 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:55.884 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.884 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.884 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.884 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.885 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.885 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.885 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.885 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.885 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.886 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.886 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:55.886 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:55.886 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.886 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.887 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.887 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.887 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.887 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.888 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.888 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.888 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.889 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:55.889 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:55.889 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:55.889 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:55.890 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:55.890 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:55.890 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.890 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:55.890 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:55.891 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:55.891 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:55.891 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:55.891 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:55.891 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:55.892 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:55.892 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:55.892 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:55.892 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:55.893 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:55.893 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:55.893 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:55.893 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:55.893 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:55.894 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:55.894 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.894 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:55.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.894 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:55.895 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.895 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:55.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:55.895 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.895 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.896 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.896 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.896 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:55.896 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.897 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.897 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.897 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.897 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:55.897 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.898 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.898 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.898 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.899 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:55.899 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:55.899 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.899 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.899 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.902 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.902 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.902 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:55.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:55.903 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.903 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.903 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.903 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.904 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:55.904 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.904 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.904 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.905 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.905 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:55.905 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.905 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.905 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.906 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.906 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:55.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:55.907 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.907 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.907 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.907 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.908 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:55.908 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.908 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.908 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.909 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.909 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:55.909 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.909 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.909 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.910 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.910 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:55.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:55.911 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.911 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.911 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.911 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.911 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:55.912 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.912 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.912 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.912 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.913 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:55.913 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.913 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.913 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.914 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.914 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:55.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:55.914 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.914 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.915 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.915 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.915 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:55.915 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.915 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.916 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.916 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.916 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:55.916 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.917 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.917 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.917 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.917 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:55.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:55.918 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.918 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.918 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.918 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.919 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:55.919 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.919 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.919 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.920 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.920 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:55.920 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.920 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.920 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.921 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.921 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:55.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:55.921 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.922 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.922 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.922 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.922 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:55.922 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.923 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.923 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.923 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.924 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:55.924 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.924 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.924 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.925 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.925 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:55.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:55.925 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:55.925 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.927 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.927 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.927 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:55.927 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:55.928 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:55.928 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:55.928 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.928 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.929 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:55.929 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:55.929 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.929 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.930 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.930 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:55.930 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.930 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:55.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:55.931 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:55.931 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:55.931 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:55.931 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:43:55.931 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:55.932 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:55.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:55.932 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:55.932 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:55.934 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.137:6812/30003 conn(0x7fd858033590 legacy=0x7fd858035a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.934 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 10 monclient: shutdown 2021-05-26T16:43:55.934 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:55.935 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 >> v1:172.21.15.3:6793/0 conn(0x7fd878063e30 legacy=0x7fd87813c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:55.935 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87e1ec700 1 -- 172.21.15.3:0/237307368 reap_dead start 2021-05-26T16:43:55.935 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87e1ec700 1 -- 172.21.15.3:0/237307368 reap_dead start 2021-05-26T16:43:55.935 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 shutdown_connections 2021-05-26T16:43:55.935 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 >> 172.21.15.3:0/237307368 conn(0x7fd8780a0db0 msgr2=0x7fd8780991e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:55.936 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 shutdown_connections 2021-05-26T16:43:55.936 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:55.811+0000 7fd87fc4f700 1 -- 172.21.15.3:0/237307368 wait complete. 2021-05-26T16:43:55.936 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2021-05-26T16:43:56.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.049+0000 7f9966974700 10 monclient: get_monmap_and_config 2021-05-26T16:43:56.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.049+0000 7f9966974700 10 monclient: build_initial_monmap 2021-05-26T16:43:56.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.049+0000 7f9966974700 10 monclient: monmap: 2021-05-26T16:43:56.054 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:56.054 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.054 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:43:56.051425+0000 2021-05-26T16:43:56.054 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:43:56.051425+0000 2021-05-26T16:43:56.054 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:56.055 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.055 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:56.055 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:56.055 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:56.056 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:56.056 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:56.056 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:56.056 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:56.056 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:56.057 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:56.057 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.050+0000 7f9966974700 1 Processor -- start 2021-05-26T16:43:56.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.050+0000 7f9966974700 1 -- start start 2021-05-26T16:43:56.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.050+0000 7f9966974700 10 monclient: init 2021-05-26T16:43:56.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:56.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 10 monclient: _add_conns ranks=[2,8,4,6,5,3,1,7,0] 2021-05-26T16:43:56.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 10 monclient(hunting): picked mon.noname-b con 0x7f9960096ca0 addr v1:172.21.15.3:6790/0 2021-05-26T16:43:56.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 10 monclient(hunting): picked mon.noname-e con 0x7f9960099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:43:56.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 10 monclient(hunting): picked mon.noname-c con 0x7f996009a260 addr v1:172.21.15.3:6791/0 2021-05-26T16:43:56.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960059750 con 0x7f9960096ca0 2021-05-26T16:43:56.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960064620 con 0x7f996009a260 2021-05-26T16:43:56.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960064e50 con 0x7f9960099db0 2021-05-26T16:43:56.071 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:56.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9966974700 10 monclient(hunting): authenticate will time out at 993.683140s 2021-05-26T16:43:56.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f9964f11700 1 -- >> v1:172.21.15.3:6791/0 conn(0x7f996009a260 legacy=0x7f99601357b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.3:6791/0 2021-05-26T16:43:56.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f995f7fe700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f9960099db0 0x7f9960132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:53856/0 (socket says 172.21.15.3:53856) 2021-05-26T16:43:56.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.051+0000 7f995f7fe700 1 -- 172.21.15.3:0/3270160326 learned_addr learned my addr 172.21.15.3:0/3270160326 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:56.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995f7fe700 1 -- 172.21.15.3:0/3270160326 >> v1:172.21.15.3:6793/0 conn(0x7f9960099db0 legacy=0x7f9960132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:56.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995ffff700 1 -- 172.21.15.3:0/3270160326 >> v1:172.21.15.3:6790/0 conn(0x7f9960096ca0 legacy=0x7f9960063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:56.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357140122 0 0) 0x7f9960064e50 con 0x7f9960099db0 2021-05-26T16:43:56.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:56.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:56.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient(hunting): my global_id is 104426 2021-05-26T16:43:56.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9944003270 con 0x7f9960099db0 2021-05-26T16:43:56.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984105724 0 0) 0x7f9960059750 con 0x7f9960096ca0 2021-05-26T16:43:56.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:56.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:56.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient(hunting): my global_id is 5168 2021-05-26T16:43:56.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9960064e50 con 0x7f9960096ca0 2021-05-26T16:43:56.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2601052967 0 0) 0x7f9960064e50 con 0x7f9960096ca0 2021-05-26T16:43:56.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 >> v1:172.21.15.3:6793/0 conn(0x7f9960099db0 legacy=0x7f9960132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 >> v1:172.21.15.3:6791/0 conn(0x7f996009a260 legacy=0x7f99601357b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:43:56.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient: _finish_hunting 0 2021-05-26T16:43:56.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 monclient: found mon.noname-b 2021-05-26T16:43:56.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:56.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:43:56.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996009c390 con 0x7f9960096ca0 2021-05-26T16:43:56.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient: _finish_auth 0 2021-05-26T16:43:56.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:56.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9950001aa0 con 0x7f9960096ca0 2021-05-26T16:43:56.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f9966974700 5 monclient: authenticate success, global_id 5168 2021-05-26T16:43:56.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f9966974700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:56.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:43:56.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient: dump: 2021-05-26T16:43:56.079 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.080 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.080 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.080 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.080 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.080 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.081 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.081 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.081 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.081 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.082 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.082 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.082 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.082 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.082 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.083 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f9966974700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:43:56.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9950001f00 con 0x7f9960096ca0 2021-05-26T16:43:56.083 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:56.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.053+0000 7f995effd700 1 -- 172.21.15.3:0/3270160326 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f99500023b0 con 0x7f9960096ca0 2021-05-26T16:43:56.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 10 monclient: get_monmap_and_config success 2021-05-26T16:43:56.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 4 set_mon_vals no callback set 2021-05-26T16:43:56.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f995effd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.084 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f995effd700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:43:56.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f995effd700 10 monclient: dump: 2021-05-26T16:43:56.085 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.085 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.085 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.085 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.086 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.086 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.086 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.086 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.087 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.087 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.087 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.087 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.087 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.088 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.088 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.088 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.088 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 10 monclient: shutdown 2021-05-26T16:43:56.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:56.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 1 -- 172.21.15.3:0/3270160326 >> v1:172.21.15.3:6790/0 conn(0x7f9960096ca0 legacy=0x7f9960063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 1 -- 172.21.15.3:0/3270160326 shutdown_connections 2021-05-26T16:43:56.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 1 -- 172.21.15.3:0/3270160326 >> 172.21.15.3:0/3270160326 conn(0x7f996009cc00 msgr2=0x7f996009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:56.089 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 1 -- 172.21.15.3:0/3270160326 shutdown_connections 2021-05-26T16:43:56.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 1 -- 172.21.15.3:0/3270160326 wait complete. 2021-05-26T16:43:56.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 10 monclient: build_initial_monmap 2021-05-26T16:43:56.090 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.054+0000 7f9966974700 10 monclient: monmap: 2021-05-26T16:43:56.090 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:43:56.091 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:43:56.091 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:43:56.091 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:43:56.091 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:43:56.091 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.092 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:43:56.092 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:43:56.092 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:43:56.092 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:43:56.092 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:43:56.093 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:43:56.093 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:43:56.093 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:43:56.093 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:43:56.094 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 1 Processor -- start 2021-05-26T16:43:56.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 1 -- start start 2021-05-26T16:43:56.094 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient: init 2021-05-26T16:43:56.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient: _reopen_session rank -1 2021-05-26T16:43:56.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient: _add_conns ranks=[5,3,7,8,4,0,6,1,2] 2021-05-26T16:43:56.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient(hunting): picked mon.noname-h con 0x7f9960096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:43:56.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient(hunting): picked mon.noname-g con 0x7f9960099db0 addr v1:172.21.15.137:6790/0 2021-05-26T16:43:56.095 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient(hunting): picked mon.noname-i con 0x7f996009a260 addr v1:172.21.15.137:6792/0 2021-05-26T16:43:56.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960116af0 con 0x7f9960099db0 2021-05-26T16:43:56.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960116d90 con 0x7f9960096ca0 2021-05-26T16:43:56.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960117030 con 0x7f996009a260 2021-05-26T16:43:56.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient(hunting): _renew_subs 2021-05-26T16:43:56.096 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.055+0000 7f9966974700 10 monclient(hunting): authenticate will time out at 993.687956s 2021-05-26T16:43:56.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.056+0000 7f995f7fe700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f9960099db0 0x7f99601410e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.3:35164/0 (socket says 172.21.15.3:35164) 2021-05-26T16:43:56.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.056+0000 7f995f7fe700 1 -- 172.21.15.3:0/3199383272 learned_addr learned my addr 172.21.15.3:0/3199383272 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:43:56.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.056+0000 7f9964f11700 1 --1- >> v1:172.21.15.137:6792/0 conn(0x7f996009a260 0x7f9960144810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6792/0 says I am v1:172.21.15.3:56924/0 (socket says 172.21.15.3:56924) 2021-05-26T16:43:56.097 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f995f7fe700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6790/0 conn(0x7f9960099db0 legacy=0x7f99601410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:56.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f9964f11700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f996009a260 legacy=0x7f9960144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:56.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f995ffff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6791/0 conn(0x7f9960096ca0 legacy=0x7f996013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:56.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038756261 0 0) 0x7f9960116af0 con 0x7f9960099db0 2021-05-26T16:43:56.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:56.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:56.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): my global_id is 5115 2021-05-26T16:43:56.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9940003270 con 0x7f9960099db0 2021-05-26T16:43:56.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824969301 0 0) 0x7f9960116d90 con 0x7f9960096ca0 2021-05-26T16:43:56.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:56.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:56.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): my global_id is 5279 2021-05-26T16:43:56.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9960116af0 con 0x7f9960096ca0 2021-05-26T16:43:56.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744041431 0 0) 0x7f9960117030 con 0x7f996009a260 2021-05-26T16:43:56.100 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:56.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:56.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): my global_id is 104317 2021-05-26T16:43:56.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9960116d90 con 0x7f996009a260 2021-05-26T16:43:56.101 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1156261917 0 0) 0x7f9940003270 con 0x7f9960099db0 2021-05-26T16:43:56.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9960117030 con 0x7f9960099db0 2021-05-26T16:43:56.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4247405780 0 0) 0x7f9960116af0 con 0x7f9960096ca0 2021-05-26T16:43:56.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9940003270 con 0x7f9960096ca0 2021-05-26T16:43:56.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f994c001d90 con 0x7f9960099db0 2021-05-26T16:43:56.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.058+0000 7f994bfff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:43:56.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): dump: 2021-05-26T16:43:56.103 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.103 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.104 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.104 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.104 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.104 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.105 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.105 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.105 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.105 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.105 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.106 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.106 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.106 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.106 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.107 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:43:56.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2547844213 0 0) 0x7f9960116d90 con 0x7f996009a260 2021-05-26T16:43:56.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9960116af0 con 0x7f996009a260 2021-05-26T16:43:56.107 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f99500023b0 con 0x7f9960096ca0 2021-05-26T16:43:56.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:43:56.108 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): dump: 2021-05-26T16:43:56.108 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.109 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.109 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.109 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.109 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.109 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.110 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.110 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.110 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.110 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.111 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.111 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.111 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.111 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.111 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.112 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f99540044e0 con 0x7f996009a260 2021-05-26T16:43:56.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:56.112 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient(hunting): dump: 2021-05-26T16:43:56.113 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.113 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.113 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.113 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.114 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.114 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.114 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.114 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.114 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.115 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.115 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.115 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.115 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.116 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.116 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.116 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3562812422 0 0) 0x7f9960117030 con 0x7f9960099db0 2021-05-26T16:43:56.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f996009a260 legacy=0x7f9960144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6791/0 conn(0x7f9960096ca0 legacy=0x7f996013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient: _finish_hunting 0 2021-05-26T16:43:56.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 monclient: found mon.g 2021-05-26T16:43:56.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:43:56.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:43:56.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996012f340 con 0x7f9960099db0 2021-05-26T16:43:56.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient: _finish_auth 0 2021-05-26T16:43:56.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:43:56.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 5 monclient: authenticate success, global_id 5115 2021-05-26T16:43:56.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 10 monclient: _renew_subs 2021-05-26T16:43:56.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:43:56.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9960130040 con 0x7f9960099db0 2021-05-26T16:43:56.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 10 monclient: _renew_subs 2021-05-26T16:43:56.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:43:56.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f996013cd00 con 0x7f9960099db0 2021-05-26T16:43:56.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f994c004b20 con 0x7f9960099db0 2021-05-26T16:43:56.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:43:56.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f994c004fd0 con 0x7f9960099db0 2021-05-26T16:43:56.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f995e7fc700 4 set_mon_vals no callback set 2021-05-26T16:43:56.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:43:56.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 10 monclient: dump: 2021-05-26T16:43:56.121 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.122 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.122 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.122 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.122 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.122 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.123 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.123 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.123 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.123 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.124 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.124 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.124 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.124 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.124 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.125 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:56.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f994c00e540 con 0x7f9960099db0 2021-05-26T16:43:56.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.059+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f99380065a0 con 0x7f9938002840 2021-05-26T16:43:56.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.060+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.3 v1:172.21.15.137:6790/0 8 ==== osd_map(118..118 src has 1..118) v4 ==== 3549+0+0 (unknown 3807207552 0 0) 0x7f994c03d9c0 con 0x7f9960099db0 2021-05-26T16:43:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.060+0000 7f9964f11700 10 monclient: get_auth_request con 0x7f9940033450 auth_method 0 2021-05-26T16:43:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f995ffff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f9938002840 legacy=0x7f9938004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503248311 0 0) 0x7f99380065a0 con 0x7f9938002840 2021-05-26T16:43:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 10 monclient(hunting): my global_id is 104326 2021-05-26T16:43:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9960117030 con 0x7f9938002840 2021-05-26T16:43:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1463067955 0 0) 0x7f9960117030 con 0x7f9938002840 2021-05-26T16:43:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99380065a0 con 0x7f9938002840 2021-05-26T16:43:56.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9950002be0 con 0x7f9938002840 2021-05-26T16:43:56.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.062+0000 7f994bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:56.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 10 monclient: dump: 2021-05-26T16:43:56.129 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.129 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.129 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.129 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.129 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.130 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.130 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.130 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.130 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.130 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.131 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.131 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.131 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.131 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.132 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.132 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2407454503 0 0) 0x7f99380065a0 con 0x7f9938002840 2021-05-26T16:43:56.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9938009e40 con 0x7f9938002840 2021-05-26T16:43:56.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f9950001560 con 0x7f9938002840 2021-05-26T16:43:56.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:43:56.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:43:56.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f9938002840 legacy=0x7f9938004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.063+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f9938002840 legacy=0x7f9938004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:56.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.070+0000 7f9966974700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:43:56.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.070+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9938009ad0 con 0x7f9938008d90 2021-05-26T16:43:56.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f995ffff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f9938008d90 legacy=0x7f9938009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:43:56.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625404415 0 0) 0x7f9938009ad0 con 0x7f9938008d90 2021-05-26T16:43:56.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:43:56.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:43:56.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 10 monclient(hunting): my global_id is 104335 2021-05-26T16:43:56.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99380065a0 con 0x7f9938008d90 2021-05-26T16:43:56.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3735674949 0 0) 0x7f99380065a0 con 0x7f9938008d90 2021-05-26T16:43:56.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9938009ad0 con 0x7f9938008d90 2021-05-26T16:43:56.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9950005a80 con 0x7f9938008d90 2021-05-26T16:43:56.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:43:56.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:43:56.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 10 monclient: dump: 2021-05-26T16:43:56.139 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:43:56.139 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:43:56.139 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.139 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:43:56.140 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:43:56.140 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:43:56.140 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:43:56.141 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:43:56.141 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:43:56.141 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:43:56.141 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:43:56.141 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:43:56.142 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:43:56.142 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:43:56.142 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:43:56.142 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:43:56.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3634637140 0 0) 0x7f9938009ad0 con 0x7f9938008d90 2021-05-26T16:43:56.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.073+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 --> v1:172.21.15.137:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9938008740 con 0x7f9938008d90 2021-05-26T16:43:56.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7311 (unknown 0 0 301369070) 0x7f9950005e90 con 0x7f9938008d90 2021-05-26T16:43:56.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f994bfff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:43:56.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f994bfff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:43:56.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f9938008d90 legacy=0x7f9938009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f994bfff700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6792/0 conn(0x7f9938008d90 legacy=0x7f9938009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:43:56.144 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:43:56.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:56.145 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:56.145 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:43:56.145 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 22, 2021-05-26T16:43:56.145 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:43:56.146 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:43:56.146 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:43:56.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:43:56.146 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:43:56.147 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:43:56.147 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:43:56.147 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:43:56.147 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:43:56.148 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:56.148 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:43:56.148 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:56.148 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:43:56.148 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:43:56.149 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:56.149 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:56.149 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:56.149 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:56.149 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:56.150 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:56.150 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:56.150 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:56.150 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:56.151 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:56.151 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:43:56.151 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:43:56.151 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:56.151 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:56.152 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:56.152 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:56.152 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:56.152 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:56.153 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:56.153 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:56.153 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:56.153 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.154 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:43:56.154 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:43:56.154 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:43:56.154 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:43:56.155 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:43:56.155 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:43:56.155 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:56.155 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:43:56.155 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:43:56.156 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:43:56.156 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:43:56.156 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:43:56.156 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:43:56.156 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:43:56.157 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:43:56.157 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:43:56.157 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:43:56.157 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:43:56.158 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:43:56.158 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:43:56.158 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:43:56.158 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:43:56.158 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:43:56.159 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:43:56.159 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:56.159 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:43:56.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.160 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:43:56.160 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.160 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:43:56.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:43:56.160 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.161 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.161 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.161 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.161 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:43:56.162 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.162 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.162 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.162 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:43:56.163 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:43:56.163 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.163 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.163 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.164 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.164 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:43:56.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:43:56.164 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.165 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.165 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.165 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.165 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:43:56.166 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.166 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.166 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.166 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:43:56.167 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:43:56.167 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.167 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.167 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.168 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.168 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:43:56.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:43:56.169 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.169 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.169 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.169 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.169 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:43:56.170 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.170 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.170 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.171 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:43:56.171 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:43:56.171 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.171 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.171 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.172 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.172 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:43:56.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:43:56.173 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.173 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.173 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.173 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.174 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:43:56.174 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.174 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.174 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.175 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:43:56.175 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:43:56.175 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.175 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.176 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.176 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.176 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:43:56.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:43:56.177 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.177 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.177 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.177 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.178 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:43:56.178 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.178 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.178 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:43:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:43:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.180 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.180 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.180 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:43:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:43:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.182 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:43:56.182 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.182 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.182 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:43:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:43:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:43:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:43:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:43:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.187 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:43:56.187 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:43:56.187 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.187 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:43:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:43:56.189 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.189 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.189 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.189 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.190 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:43:56.190 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.190 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.190 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.191 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:43:56.191 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:43:56.191 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.191 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.192 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.192 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.192 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:43:56.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:43:56.193 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:43:56.193 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:43:56.193 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.193 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:43:56.194 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:43:56.194 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:43:56.194 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.194 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.195 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:43:56.195 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:43:56.195 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:43:56.195 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:43:56.196 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:43:56.196 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.196 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.196 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:43:56.197 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:43:56.197 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.197 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:56.197 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:56.197 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:56.198 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.198 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:43:56.198 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:43:56.198 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:43:56.199 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:43:56.199 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:43:56.199 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:43:56.199 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:43:56.199 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:43:56.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:43:56.200 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:43:56.200 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:43:56.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6812/30003 conn(0x7f9940033450 legacy=0x7f9940035910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 10 monclient: shutdown 2021-05-26T16:43:56.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:43:56.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 >> v1:172.21.15.137:6790/0 conn(0x7f9960099db0 legacy=0x7f99601410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:43:56.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9964f11700 1 -- 172.21.15.3:0/3199383272 reap_dead start 2021-05-26T16:43:56.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9964f11700 1 -- 172.21.15.3:0/3199383272 reap_dead start 2021-05-26T16:43:56.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 shutdown_connections 2021-05-26T16:43:56.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 >> 172.21.15.3:0/3199383272 conn(0x7f996009cc00 msgr2=0x7f996009f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:43:56.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 shutdown_connections 2021-05-26T16:43:56.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:43:56.074+0000 7f9966974700 1 -- 172.21.15.3:0/3199383272 wait complete. 2021-05-26T16:43:56.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-05-26T16:43:57.941 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34939]: starting. 2021-05-26T16:43:57.942 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34939]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34938 2021-05-26T16:43:57.942 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34939]: created object 0... 2021-05-26T16:43:57.942 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34939]: created object 25... 2021-05-26T16:43:57.942 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34939]: created object 49... 2021-05-26T16:43:57.942 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34939]: finishing. 2021-05-26T16:43:57.943 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[34939]: shutting down. 2021-05-26T16:43:58.721 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34940]: starting. 2021-05-26T16:43:58.721 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34940]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34938 2021-05-26T16:43:58.721 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[34940]: shutting down. 2021-05-26T16:44:00.861 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:00.861 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34973]: starting. 2021-05-26T16:44:00.861 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34973]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-34938 2021-05-26T16:44:00.861 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34973]: created object 0... 2021-05-26T16:44:00.862 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34973]: created object 25... 2021-05-26T16:44:00.862 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34973]: created object 49... 2021-05-26T16:44:00.862 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34973]: finishing. 2021-05-26T16:44:00.862 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[34973]: shutting down. 2021-05-26T16:44:00.900 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:00.900 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34975]: starting. 2021-05-26T16:44:00.900 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34975]: listing objects. 2021-05-26T16:44:00.900 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34975]: listed object 0... 2021-05-26T16:44:00.901 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34975]: listed object 25... 2021-05-26T16:44:00.901 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34975]: saw 50 objects 2021-05-26T16:44:00.901 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[34975]: shutting down. 2021-05-26T16:44:01.739 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:01.739 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34974]: starting. 2021-05-26T16:44:01.739 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34974]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-34938 2021-05-26T16:44:01.740 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[34974]: shutting down. 2021-05-26T16:44:01.740 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:01.741 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:01.741 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:01.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:04.201 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35041]: starting. 2021-05-26T16:44:04.202 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35041]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35040 2021-05-26T16:44:04.202 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35041]: created object 0... 2021-05-26T16:44:04.202 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35041]: created object 25... 2021-05-26T16:44:04.202 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35041]: created object 49... 2021-05-26T16:44:04.203 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35041]: finishing. 2021-05-26T16:44:04.203 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35041]: shutting down. 2021-05-26T16:44:05.100 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35042]: starting. 2021-05-26T16:44:05.101 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35042]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35040 2021-05-26T16:44:05.101 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35042]: shutting down. 2021-05-26T16:44:08.627 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:08.627 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35075]: starting. 2021-05-26T16:44:08.627 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35075]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35040 2021-05-26T16:44:08.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35075]: created object 0... 2021-05-26T16:44:08.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35075]: created object 25... 2021-05-26T16:44:08.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35075]: created object 49... 2021-05-26T16:44:08.628 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35075]: finishing. 2021-05-26T16:44:08.629 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35075]: shutting down. 2021-05-26T16:44:08.665 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:08.665 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35077]: starting. 2021-05-26T16:44:08.666 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35077]: listing objects. 2021-05-26T16:44:08.666 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35077]: listed object 0... 2021-05-26T16:44:08.666 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35077]: listed object 25... 2021-05-26T16:44:08.666 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35077]: saw 50 objects 2021-05-26T16:44:08.667 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35077]: shutting down. 2021-05-26T16:44:09.735 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:09.735 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35076]: starting. 2021-05-26T16:44:09.735 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35076]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35040 2021-05-26T16:44:09.736 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35076]: shutting down. 2021-05-26T16:44:09.736 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:09.737 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:09.737 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:09.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:13.555 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35143]: starting. 2021-05-26T16:44:13.556 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35143]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35142 2021-05-26T16:44:13.556 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35143]: created object 0... 2021-05-26T16:44:13.556 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35143]: created object 25... 2021-05-26T16:44:13.556 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35143]: created object 49... 2021-05-26T16:44:13.556 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35143]: finishing. 2021-05-26T16:44:13.557 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35143]: shutting down. 2021-05-26T16:44:13.590 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35144]: starting. 2021-05-26T16:44:13.590 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35144]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35142 2021-05-26T16:44:13.591 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35144]: shutting down. 2021-05-26T16:44:15.747 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:15.748 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35177]: starting. 2021-05-26T16:44:15.748 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35177]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35142 2021-05-26T16:44:15.748 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35177]: created object 0... 2021-05-26T16:44:15.749 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35177]: created object 25... 2021-05-26T16:44:15.749 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35177]: created object 49... 2021-05-26T16:44:15.749 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35177]: finishing. 2021-05-26T16:44:15.749 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35177]: shutting down. 2021-05-26T16:44:15.787 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:15.787 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35179]: starting. 2021-05-26T16:44:15.787 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35179]: listing objects. 2021-05-26T16:44:15.787 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35179]: listed object 0... 2021-05-26T16:44:15.788 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35179]: listed object 25... 2021-05-26T16:44:15.788 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35179]: saw 50 objects 2021-05-26T16:44:15.788 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35179]: shutting down. 2021-05-26T16:44:16.622 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:16.622 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35178]: starting. 2021-05-26T16:44:16.623 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35178]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35142 2021-05-26T16:44:16.623 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35178]: shutting down. 2021-05-26T16:44:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:16.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:18.794 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35245]: starting. 2021-05-26T16:44:18.795 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35245]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35244 2021-05-26T16:44:18.795 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35245]: created object 0... 2021-05-26T16:44:18.795 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35245]: created object 25... 2021-05-26T16:44:18.796 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35245]: created object 49... 2021-05-26T16:44:18.796 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35245]: finishing. 2021-05-26T16:44:18.796 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35245]: shutting down. 2021-05-26T16:44:19.988 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35246]: starting. 2021-05-26T16:44:19.988 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35246]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35244 2021-05-26T16:44:19.989 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35246]: shutting down. 2021-05-26T16:44:22.122 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:22.122 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35279]: starting. 2021-05-26T16:44:22.123 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35279]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35244 2021-05-26T16:44:22.123 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35279]: created object 0... 2021-05-26T16:44:22.123 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35279]: created object 25... 2021-05-26T16:44:22.123 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35279]: created object 49... 2021-05-26T16:44:22.124 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35279]: finishing. 2021-05-26T16:44:22.124 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35279]: shutting down. 2021-05-26T16:44:22.162 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:22.162 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35281]: starting. 2021-05-26T16:44:22.162 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35281]: listing objects. 2021-05-26T16:44:22.162 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35281]: listed object 0... 2021-05-26T16:44:22.163 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35281]: listed object 25... 2021-05-26T16:44:22.163 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35281]: saw 50 objects 2021-05-26T16:44:22.163 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35281]: shutting down. 2021-05-26T16:44:23.027 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:23.028 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35280]: starting. 2021-05-26T16:44:23.029 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35280]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35244 2021-05-26T16:44:23.029 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35280]: shutting down. 2021-05-26T16:44:23.029 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:23.030 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:23.030 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:23.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:25.164 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35347]: starting. 2021-05-26T16:44:25.180 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35347]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35346 2021-05-26T16:44:25.181 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35347]: created object 0... 2021-05-26T16:44:25.182 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35347]: created object 25... 2021-05-26T16:44:25.185 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35347]: created object 49... 2021-05-26T16:44:25.185 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35347]: finishing. 2021-05-26T16:44:25.185 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35347]: shutting down. 2021-05-26T16:44:26.434 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35348]: starting. 2021-05-26T16:44:26.434 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35348]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35346 2021-05-26T16:44:26.435 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35348]: shutting down. 2021-05-26T16:44:29.138 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:29.138 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35381]: starting. 2021-05-26T16:44:29.139 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35381]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35346 2021-05-26T16:44:29.139 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35381]: created object 0... 2021-05-26T16:44:29.139 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35381]: created object 25... 2021-05-26T16:44:29.139 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35381]: created object 49... 2021-05-26T16:44:29.139 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35381]: finishing. 2021-05-26T16:44:29.140 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35381]: shutting down. 2021-05-26T16:44:29.178 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:29.178 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35383]: starting. 2021-05-26T16:44:29.178 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35383]: listing objects. 2021-05-26T16:44:29.179 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35383]: listed object 0... 2021-05-26T16:44:29.179 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35383]: listed object 25... 2021-05-26T16:44:29.179 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35383]: saw 50 objects 2021-05-26T16:44:29.179 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35383]: shutting down. 2021-05-26T16:44:30.034 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:30.035 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35382]: starting. 2021-05-26T16:44:30.035 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35382]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35346 2021-05-26T16:44:30.035 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35382]: shutting down. 2021-05-26T16:44:30.036 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:30.036 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:30.037 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:30.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:32.160 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35449]: starting. 2021-05-26T16:44:32.161 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35449]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35448 2021-05-26T16:44:32.161 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35449]: created object 0... 2021-05-26T16:44:32.161 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35449]: created object 25... 2021-05-26T16:44:32.161 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35449]: created object 49... 2021-05-26T16:44:32.162 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35449]: finishing. 2021-05-26T16:44:32.162 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35449]: shutting down. 2021-05-26T16:44:33.299 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35450]: starting. 2021-05-26T16:44:33.299 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35450]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35448 2021-05-26T16:44:33.300 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35450]: shutting down. 2021-05-26T16:44:34.937 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:34.937 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35483]: starting. 2021-05-26T16:44:34.938 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35483]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35448 2021-05-26T16:44:34.938 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35483]: created object 0... 2021-05-26T16:44:34.938 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35483]: created object 25... 2021-05-26T16:44:34.938 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35483]: created object 49... 2021-05-26T16:44:34.939 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35483]: finishing. 2021-05-26T16:44:34.939 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35483]: shutting down. 2021-05-26T16:44:34.977 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:34.977 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35485]: starting. 2021-05-26T16:44:34.977 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35485]: listing objects. 2021-05-26T16:44:34.977 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35485]: listed object 0... 2021-05-26T16:44:34.978 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35485]: listed object 25... 2021-05-26T16:44:34.978 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35485]: saw 50 objects 2021-05-26T16:44:34.978 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35485]: shutting down. 2021-05-26T16:44:35.827 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:35.827 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35484]: starting. 2021-05-26T16:44:35.828 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35484]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35448 2021-05-26T16:44:35.828 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35484]: shutting down. 2021-05-26T16:44:35.828 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:35.829 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:35.829 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:35.830 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:37.967 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35551]: starting. 2021-05-26T16:44:37.968 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35551]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35550 2021-05-26T16:44:37.968 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35551]: created object 0... 2021-05-26T16:44:37.968 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35551]: created object 25... 2021-05-26T16:44:37.968 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35551]: created object 49... 2021-05-26T16:44:37.969 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35551]: finishing. 2021-05-26T16:44:37.969 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35551]: shutting down. 2021-05-26T16:44:38.857 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35552]: starting. 2021-05-26T16:44:38.858 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35552]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35550 2021-05-26T16:44:38.858 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35552]: shutting down. 2021-05-26T16:44:41.582 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:41.582 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35585]: starting. 2021-05-26T16:44:41.582 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35585]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35550 2021-05-26T16:44:41.582 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35585]: created object 0... 2021-05-26T16:44:41.583 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35585]: created object 25... 2021-05-26T16:44:41.583 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35585]: created object 49... 2021-05-26T16:44:41.583 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35585]: finishing. 2021-05-26T16:44:41.583 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35585]: shutting down. 2021-05-26T16:44:41.621 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:41.622 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35587]: starting. 2021-05-26T16:44:41.622 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35587]: listing objects. 2021-05-26T16:44:41.622 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35587]: listed object 0... 2021-05-26T16:44:41.622 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35587]: listed object 25... 2021-05-26T16:44:41.622 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35587]: saw 50 objects 2021-05-26T16:44:41.623 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35587]: shutting down. 2021-05-26T16:44:42.470 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:42.470 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35586]: starting. 2021-05-26T16:44:42.471 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35586]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35550 2021-05-26T16:44:42.471 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35586]: shutting down. 2021-05-26T16:44:42.471 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:42.472 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:42.472 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:42.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:43.866 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35661]: starting. 2021-05-26T16:44:43.867 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35661]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35660 2021-05-26T16:44:43.867 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35661]: created object 0... 2021-05-26T16:44:43.867 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35661]: created object 25... 2021-05-26T16:44:43.868 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35661]: created object 49... 2021-05-26T16:44:43.868 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35661]: finishing. 2021-05-26T16:44:43.868 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35661]: shutting down. 2021-05-26T16:44:44.751 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35662]: starting. 2021-05-26T16:44:44.751 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35662]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35660 2021-05-26T16:44:44.751 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35662]: shutting down. 2021-05-26T16:44:47.143 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:47.143 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35695]: starting. 2021-05-26T16:44:47.143 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35695]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35660 2021-05-26T16:44:47.144 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35695]: created object 0... 2021-05-26T16:44:47.144 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35695]: created object 25... 2021-05-26T16:44:47.144 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35695]: created object 49... 2021-05-26T16:44:47.144 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35695]: finishing. 2021-05-26T16:44:47.145 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35695]: shutting down. 2021-05-26T16:44:47.188 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:47.189 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35697]: starting. 2021-05-26T16:44:47.189 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35697]: listing objects. 2021-05-26T16:44:47.189 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35697]: listed object 0... 2021-05-26T16:44:47.189 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35697]: listed object 25... 2021-05-26T16:44:47.190 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35697]: saw 50 objects 2021-05-26T16:44:47.190 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35697]: shutting down. 2021-05-26T16:44:48.010 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:48.011 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35696]: starting. 2021-05-26T16:44:48.011 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35696]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35660 2021-05-26T16:44:48.011 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35696]: shutting down. 2021-05-26T16:44:48.012 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:48.012 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:48.012 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:48.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35763]: starting. 2021-05-26T16:44:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35763]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35762 2021-05-26T16:44:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35763]: created object 0... 2021-05-26T16:44:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35763]: created object 25... 2021-05-26T16:44:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35763]: created object 49... 2021-05-26T16:44:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35763]: finishing. 2021-05-26T16:44:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35763]: shutting down. 2021-05-26T16:44:51.759 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35764]: starting. 2021-05-26T16:44:51.759 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35764]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35762 2021-05-26T16:44:51.760 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35764]: shutting down. 2021-05-26T16:44:53.909 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:53.910 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35799]: starting. 2021-05-26T16:44:53.910 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35799]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35762 2021-05-26T16:44:53.910 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35799]: created object 0... 2021-05-26T16:44:53.910 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35799]: created object 25... 2021-05-26T16:44:53.911 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35799]: created object 49... 2021-05-26T16:44:53.911 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35799]: finishing. 2021-05-26T16:44:53.911 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35799]: shutting down. 2021-05-26T16:44:53.947 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:53.948 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35801]: starting. 2021-05-26T16:44:53.948 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35801]: listing objects. 2021-05-26T16:44:53.948 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35801]: listed object 0... 2021-05-26T16:44:53.949 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35801]: listed object 25... 2021-05-26T16:44:53.949 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35801]: saw 50 objects 2021-05-26T16:44:53.949 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35801]: shutting down. 2021-05-26T16:44:54.802 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:54.803 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35800]: starting. 2021-05-26T16:44:54.803 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35800]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35762 2021-05-26T16:44:54.803 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35800]: shutting down. 2021-05-26T16:44:54.804 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:54.804 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:54.804 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:44:54.806 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:44:57.397 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35867]: starting. 2021-05-26T16:44:57.398 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35867]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35866 2021-05-26T16:44:57.398 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35867]: created object 0... 2021-05-26T16:44:57.398 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35867]: created object 25... 2021-05-26T16:44:57.398 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35867]: created object 49... 2021-05-26T16:44:57.399 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35867]: finishing. 2021-05-26T16:44:57.399 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35867]: shutting down. 2021-05-26T16:44:58.260 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35868]: starting. 2021-05-26T16:44:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35868]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35866 2021-05-26T16:44:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35868]: shutting down. 2021-05-26T16:44:59.881 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:59.881 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35901]: starting. 2021-05-26T16:44:59.881 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35901]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35866 2021-05-26T16:44:59.882 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35901]: created object 0... 2021-05-26T16:44:59.882 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35901]: created object 25... 2021-05-26T16:44:59.882 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35901]: created object 49... 2021-05-26T16:44:59.882 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35901]: finishing. 2021-05-26T16:44:59.883 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[35901]: shutting down. 2021-05-26T16:44:59.920 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:44:59.921 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35903]: starting. 2021-05-26T16:44:59.921 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35903]: listing objects. 2021-05-26T16:44:59.921 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35903]: listed object 0... 2021-05-26T16:44:59.921 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35903]: listed object 25... 2021-05-26T16:44:59.922 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35903]: saw 50 objects 2021-05-26T16:44:59.922 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[35903]: shutting down. 2021-05-26T16:45:00.767 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:00.767 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35902]: starting. 2021-05-26T16:45:00.767 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35902]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35866 2021-05-26T16:45:00.767 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[35902]: shutting down. 2021-05-26T16:45:00.768 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:00.768 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:00.768 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:45:00.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:45:03.882 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35969]: starting. 2021-05-26T16:45:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35969]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35968 2021-05-26T16:45:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35969]: created object 0... 2021-05-26T16:45:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35969]: created object 25... 2021-05-26T16:45:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35969]: created object 49... 2021-05-26T16:45:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35969]: finishing. 2021-05-26T16:45:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[35969]: shutting down. 2021-05-26T16:45:05.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35970]: starting. 2021-05-26T16:45:05.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35970]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35968 2021-05-26T16:45:05.350 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[35970]: shutting down. 2021-05-26T16:45:07.502 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:07.503 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36003]: starting. 2021-05-26T16:45:07.503 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36003]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-35968 2021-05-26T16:45:07.503 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36003]: created object 0... 2021-05-26T16:45:07.504 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36003]: created object 25... 2021-05-26T16:45:07.504 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36003]: created object 49... 2021-05-26T16:45:07.504 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36003]: finishing. 2021-05-26T16:45:07.504 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36003]: shutting down. 2021-05-26T16:45:07.541 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:07.542 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36005]: starting. 2021-05-26T16:45:07.542 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36005]: listing objects. 2021-05-26T16:45:07.542 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36005]: listed object 0... 2021-05-26T16:45:07.543 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36005]: listed object 25... 2021-05-26T16:45:07.543 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36005]: saw 50 objects 2021-05-26T16:45:07.543 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36005]: shutting down. 2021-05-26T16:45:08.379 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:08.380 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36004]: starting. 2021-05-26T16:45:08.380 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36004]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-35968 2021-05-26T16:45:08.380 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36004]: shutting down. 2021-05-26T16:45:08.381 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:08.381 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:08.381 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:45:08.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:45:10.856 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36071]: starting. 2021-05-26T16:45:10.857 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36071]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36070 2021-05-26T16:45:10.857 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36071]: created object 0... 2021-05-26T16:45:10.857 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36071]: created object 25... 2021-05-26T16:45:10.858 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36071]: created object 49... 2021-05-26T16:45:10.858 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36071]: finishing. 2021-05-26T16:45:10.858 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36071]: shutting down. 2021-05-26T16:45:11.743 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36072]: starting. 2021-05-26T16:45:11.744 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36072]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36070 2021-05-26T16:45:11.744 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36072]: shutting down. 2021-05-26T16:45:13.888 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:13.889 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36105]: starting. 2021-05-26T16:45:13.889 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36105]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36070 2021-05-26T16:45:13.889 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36105]: created object 0... 2021-05-26T16:45:13.889 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36105]: created object 25... 2021-05-26T16:45:13.890 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36105]: created object 49... 2021-05-26T16:45:13.890 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36105]: finishing. 2021-05-26T16:45:13.890 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36105]: shutting down. 2021-05-26T16:45:13.928 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:13.929 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36107]: starting. 2021-05-26T16:45:13.929 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36107]: listing objects. 2021-05-26T16:45:13.929 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36107]: listed object 0... 2021-05-26T16:45:13.929 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36107]: listed object 25... 2021-05-26T16:45:13.930 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36107]: saw 50 objects 2021-05-26T16:45:13.930 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36107]: shutting down. 2021-05-26T16:45:14.785 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:14.785 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36106]: starting. 2021-05-26T16:45:14.786 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36106]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36070 2021-05-26T16:45:14.786 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36106]: shutting down. 2021-05-26T16:45:14.786 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:14.787 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:14.787 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:45:14.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:45:18.227 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36174]: starting. 2021-05-26T16:45:18.228 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36174]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36173 2021-05-26T16:45:18.228 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36174]: created object 0... 2021-05-26T16:45:18.228 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36174]: created object 25... 2021-05-26T16:45:18.228 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36174]: created object 49... 2021-05-26T16:45:18.229 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36174]: finishing. 2021-05-26T16:45:18.229 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36174]: shutting down. 2021-05-26T16:45:19.388 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36175]: starting. 2021-05-26T16:45:19.389 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36175]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36173 2021-05-26T16:45:19.389 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36175]: shutting down. 2021-05-26T16:45:21.564 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:21.564 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36208]: starting. 2021-05-26T16:45:21.564 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36208]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36173 2021-05-26T16:45:21.565 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36208]: created object 0... 2021-05-26T16:45:21.565 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36208]: created object 25... 2021-05-26T16:45:21.565 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36208]: created object 49... 2021-05-26T16:45:21.565 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36208]: finishing. 2021-05-26T16:45:21.566 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36208]: shutting down. 2021-05-26T16:45:21.603 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:21.604 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36210]: starting. 2021-05-26T16:45:21.604 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36210]: listing objects. 2021-05-26T16:45:21.605 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36210]: listed object 0... 2021-05-26T16:45:21.605 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36210]: listed object 25... 2021-05-26T16:45:21.605 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36210]: saw 50 objects 2021-05-26T16:45:21.605 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36210]: shutting down. 2021-05-26T16:45:22.447 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:22.448 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36209]: starting. 2021-05-26T16:45:22.448 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36209]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36173 2021-05-26T16:45:22.448 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36209]: shutting down. 2021-05-26T16:45:22.448 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:22.449 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:22.449 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:45:22.450 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:45:23.859 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36276]: starting. 2021-05-26T16:45:23.859 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36276]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36275 2021-05-26T16:45:23.860 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36276]: created object 0... 2021-05-26T16:45:23.860 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36276]: created object 25... 2021-05-26T16:45:23.860 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36276]: created object 49... 2021-05-26T16:45:23.860 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36276]: finishing. 2021-05-26T16:45:23.861 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36276]: shutting down. 2021-05-26T16:45:24.758 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36277]: starting. 2021-05-26T16:45:24.758 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36277]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36275 2021-05-26T16:45:24.758 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36277]: shutting down. 2021-05-26T16:45:26.206 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-05-26T16:45:26.206 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2021-05-26T16:45:26.206 INFO:tasks.ceph.mon.c:Restarting daemon 2021-05-26T16:45:26.207 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-05-26T16:45:26.210 INFO:tasks.ceph.mon.c:Started 2021-05-26T16:45:26.210 INFO:tasks.mon_thrash:Sending STOP to mon a 2021-05-26T16:45:26.211 INFO:tasks.ceph.mon.a:Sent signal 19 2021-05-26T16:45:26.211 INFO:tasks.mon_thrash:Sending STOP to mon i 2021-05-26T16:45:26.211 INFO:tasks.ceph.mon.i:Sent signal 19 2021-05-26T16:45:26.212 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2021-05-26T16:45:26.359 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:45:26.359 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.360 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.360 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.360 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.360 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:45:26.361 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.361 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:26.361 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:26.361 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:26.362 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:45:26.362 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.362 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.362 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.363 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.363 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:45:26.364 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.364 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:26.364 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:26.364 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:26.365 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:45:26.365 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.365 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.366 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.366 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.366 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:45:26.367 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.367 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:26.367 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:26.367 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:26.368 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:45:26.368 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.369 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.369 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.369 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.370 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:45:26.370 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.370 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:26.370 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:26.371 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:26.371 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:45:26.371 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.371 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.372 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.372 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.372 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:45:26.372 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.373 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:26.374 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:26.374 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:26.374 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:45:26.374 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.375 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.375 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.375 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.375 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:45:26.376 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.376 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.376 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.376 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.377 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:45:26.378 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.378 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.378 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.379 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.379 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:45:26.379 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.379 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.379 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.380 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.380 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:45:26.380 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.380 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.380 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.381 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:26.381 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:45:26.381 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:26.381 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:26.381 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:26.382 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36310]: starting. 2021-05-26T16:45:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36310]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36275 2021-05-26T16:45:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36310]: created object 0... 2021-05-26T16:45:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36310]: created object 25... 2021-05-26T16:45:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36310]: created object 49... 2021-05-26T16:45:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36310]: finishing. 2021-05-26T16:45:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36310]: shutting down. 2021-05-26T16:45:32.076 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:32.077 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36312]: starting. 2021-05-26T16:45:32.077 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36312]: listing objects. 2021-05-26T16:45:32.078 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36312]: listed object 0... 2021-05-26T16:45:32.078 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36312]: listed object 25... 2021-05-26T16:45:32.079 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36312]: saw 50 objects 2021-05-26T16:45:32.079 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36312]: shutting down. 2021-05-26T16:45:41.214 INFO:tasks.mon_thrash:Sending CONT to mon a 2021-05-26T16:45:41.214 INFO:tasks.ceph.mon.a:Sent signal 18 2021-05-26T16:45:41.215 INFO:tasks.mon_thrash:Sending CONT to mon i 2021-05-26T16:45:41.215 INFO:tasks.ceph.mon.i:Sent signal 18 2021-05-26T16:45:41.215 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2021-05-26T16:45:41.216 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:45:41.219 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:45:41.219 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.219 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:41.220 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:41.220 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:41.221 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:45:41.221 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.221 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:41.221 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:41.222 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:41.222 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:45:41.223 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.223 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:41.223 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:41.223 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:41.224 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:45:41.224 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.224 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:41.224 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:41.225 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:41.225 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:45:41.225 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.226 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:41.226 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:41.226 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:41.227 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:45:41.227 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.227 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:41.227 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:41.228 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:41.228 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:45:41.228 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.228 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:41.229 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:41.229 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:41.229 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:45:41.230 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.230 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:41.230 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:41.230 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:41.231 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:45:41.231 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.231 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:41.231 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:41.232 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:41.232 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:45:41.232 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:41.233 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:41.233 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:41.233 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.343+0000 7f7c69277700 10 monclient: get_monmap_and_config 2021-05-26T16:45:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.343+0000 7f7c69277700 10 monclient: build_initial_monmap 2021-05-26T16:45:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.343+0000 7f7c69277700 10 monclient: monmap: 2021-05-26T16:45:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:41.343857+0000 2021-05-26T16:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:41.343857+0000 2021-05-26T16:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.343+0000 7f7c69277700 1 Processor -- start 2021-05-26T16:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.343+0000 7f7c69277700 1 -- start start 2021-05-26T16:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.343+0000 7f7c69277700 10 monclient: init 2021-05-26T16:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 10 monclient: _add_conns ranks=[5,8,4,3,0,2,7,6,1] 2021-05-26T16:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 10 monclient(hunting): picked mon.noname-h con 0x7f7c64063e20 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 10 monclient(hunting): picked mon.noname-e con 0x7f7c64094c80 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 10 monclient(hunting): picked mon.noname-c con 0x7f7c640996d0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64059750 con 0x7f7c640996d0 2021-05-26T16:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64064830 con 0x7f7c64063e20 2021-05-26T16:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64064ad0 con 0x7f7c64094c80 2021-05-26T16:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c69277700 10 monclient(hunting): authenticate will time out at 1098.975343s 2021-05-26T16:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c637fe700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f7c640996d0 0x7f7c64135b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38614/0 (socket says 172.21.15.3:38614) 2021-05-26T16:45:41.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c637fe700 1 -- 172.21.15.3:0/1516510099 learned_addr learned my addr 172.21.15.3:0/1516510099 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:41.355 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.344+0000 7f7c627fc700 1 --1- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6793/0 conn(0x7f7c64094c80 0x7f7c64098fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54180/0 (socket says 172.21.15.3:54180) 2021-05-26T16:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.346+0000 7f7c627fc700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6793/0 conn(0x7f7c64094c80 legacy=0x7f7c64098fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.346+0000 7f7c637fe700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6791/0 conn(0x7f7c640996d0 legacy=0x7f7c64135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:41.346+0000 7f7c62ffd700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.137:6791/0 conn(0x7f7c64063e20 legacy=0x7f7c640988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:44.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 10 monclient(hunting): tick 2021-05-26T16:45:44.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 1 monclient(hunting): continuing hunt 2021-05-26T16:45:44.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 10 monclient(hunting): _reopen_session rank -1 2021-05-26T16:45:44.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6793/0 conn(0x7f7c64094c80 legacy=0x7f7c64098fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:44.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.137:6791/0 conn(0x7f7c64063e20 legacy=0x7f7c640988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:44.348 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6791/0 conn(0x7f7c640996d0 legacy=0x7f7c64135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:44.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 10 monclient: _add_conns ranks=[2,0,3,7,6,1] 2021-05-26T16:45:44.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 10 monclient(hunting): picked mon.noname-b con 0x7f7c44003680 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:44.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 10 monclient(hunting): picked mon.noname-a con 0x7f7c440072f0 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:44.349 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 10 monclient(hunting): picked mon.noname-g con 0x7f7c4400b040 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:44.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 1 -- 172.21.15.3:0/1516510099 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64064d70 con 0x7f7c440072f0 2021-05-26T16:45:44.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 1 -- 172.21.15.3:0/1516510099 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4400fe70 con 0x7f7c44003680 2021-05-26T16:45:44.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 1 -- 172.21.15.3:0/1516510099 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c440110c0 con 0x7f7c4400b040 2021-05-26T16:45:44.350 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.344+0000 7f7c60ff9700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:44.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.347+0000 7f7c62ffd700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6790/0 conn(0x7f7c44003680 legacy=0x7f7c44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:44.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.347+0000 7f7c627fc700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6789/0 conn(0x7f7c440072f0 legacy=0x7f7c44009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:44.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:44.347+0000 7f7c637fe700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.137:6790/0 conn(0x7f7c4400b040 legacy=0x7f7c4400d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:46.234 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:45:46.235 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.235 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:46.235 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:46.235 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:46.236 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:45:46.236 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.236 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:46.236 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:46.237 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:46.237 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:45:46.237 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.238 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:46.238 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:46.238 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:46.238 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:45:46.239 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.239 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:46.239 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:46.239 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:46.240 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:45:46.240 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.240 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:46.240 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:46.241 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:46.241 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:45:46.241 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.242 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:46.242 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:46.242 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:46.243 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:45:46.243 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.243 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:46.243 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:46.243 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:46.244 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:45:46.244 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.244 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:46.245 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:46.245 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:46.245 INFO:tasks.ceph.mon.i.smithi137.stdout: vendor '' 2021-05-26T16:45:46.245 INFO:tasks.ceph.mon.i.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.245 INFO:tasks.ceph.mon.i.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:45:46.246 INFO:tasks.ceph.mon.i.smithi137.stdout: scsi_serial '' 2021-05-26T16:45:46.246 INFO:tasks.ceph.mon.i.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:45:46.246 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:45:46.247 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.247 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:46.247 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:46.247 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:46.248 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:45:46.248 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:45:46.248 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:45:46.248 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:45:46.248 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:45:47.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.151+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264130511 0 0) 0x7f7c4400fe70 con 0x7f7c44003680 2021-05-26T16:45:47.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.151+0000 7f7c61ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.151+0000 7f7c61ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.151+0000 7f7c61ffb700 10 monclient(hunting): my global_id is 5492 2021-05-26T16:45:47.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.151+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c50003270 con 0x7f7c44003680 2021-05-26T16:45:47.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210546149 0 0) 0x7f7c440110c0 con 0x7f7c4400b040 2021-05-26T16:45:47.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient(hunting): my global_id is 5457 2021-05-26T16:45:47.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c4400fe70 con 0x7f7c4400b040 2021-05-26T16:45:47.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921497688 0 0) 0x7f7c50003270 con 0x7f7c44003680 2021-05-26T16:45:47.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.137:6790/0 conn(0x7f7c4400b040 legacy=0x7f7c4400d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6789/0 conn(0x7f7c440072f0 legacy=0x7f7c44009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:47.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 monclient: found mon.noname-b 2021-05-26T16:45:47.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:47.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:45:47.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440123d0 con 0x7f7c44003680 2021-05-26T16:45:47.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c637fe700 1 -- 172.21.15.3:0/1516510099 reap_dead start 2021-05-26T16:45:47.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:47.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:47.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7c58001a70 con 0x7f7c44003680 2021-05-26T16:45:47.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c69277700 5 monclient: authenticate success, global_id 5492 2021-05-26T16:45:47.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c69277700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:47.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:45:47.162 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: dump: 2021-05-26T16:45:47.162 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.162 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.163 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.163 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.163 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.163 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.163 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.164 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.164 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.164 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.164 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.164 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.165 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c69277700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7c58001f00 con 0x7f7c44003680 2021-05-26T16:45:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 1 -- 172.21.15.3:0/1516510099 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7c58001d80 con 0x7f7c44003680 2021-05-26T16:45:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c69277700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c69277700 4 set_mon_vals no callback set 2021-05-26T16:45:47.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:47.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.152+0000 7f7c61ffb700 10 monclient: dump: 2021-05-26T16:45:47.167 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.168 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.168 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.168 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.168 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.169 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.169 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.169 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.169 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.169 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.170 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.170 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.170 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.170 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.171 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.171 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.153+0000 7f7c69277700 10 monclient: shutdown 2021-05-26T16:45:47.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.153+0000 7f7c69277700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:47.171 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.153+0000 7f7c69277700 1 -- 172.21.15.3:0/1516510099 >> v1:172.21.15.3:6790/0 conn(0x7f7c44003680 legacy=0x7f7c44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.154+0000 7f7c69277700 1 -- 172.21.15.3:0/1516510099 shutdown_connections 2021-05-26T16:45:47.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.154+0000 7f7c69277700 1 -- 172.21.15.3:0/1516510099 >> 172.21.15.3:0/1516510099 conn(0x7f7c6409a9b0 msgr2=0x7f7c6409ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:47.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.154+0000 7f7c69277700 1 -- 172.21.15.3:0/1516510099 shutdown_connections 2021-05-26T16:45:47.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.154+0000 7f7c69277700 1 -- 172.21.15.3:0/1516510099 wait complete. 2021-05-26T16:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.155+0000 7f7c69277700 10 monclient: build_initial_monmap 2021-05-26T16:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.155+0000 7f7c69277700 10 monclient: monmap: 2021-05-26T16:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:47.179 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:47.179 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:47.179 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:47.179 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:47.182 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.156+0000 7f7c69277700 1 Processor -- start 2021-05-26T16:45:47.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.156+0000 7f7c69277700 1 -- start start 2021-05-26T16:45:47.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.156+0000 7f7c69277700 10 monclient: init 2021-05-26T16:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.156+0000 7f7c69277700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.156+0000 7f7c69277700 10 monclient: _add_conns ranks=[0,6,1,7,5,3,4,2,8] 2021-05-26T16:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.156+0000 7f7c69277700 10 monclient(hunting): picked mon.noname-a con 0x7f7c44003680 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.156+0000 7f7c69277700 10 monclient(hunting): picked mon.noname-d con 0x7f7c6412cb40 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c69277700 10 monclient(hunting): picked mon.noname-f con 0x7f7c64142660 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c627fc700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f7c6412cb40 0x7f7c6412cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58518/0 (socket says 172.21.15.3:58518) 2021-05-26T16:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c627fc700 1 -- 172.21.15.3:0/978621382 learned_addr learned my addr 172.21.15.3:0/978621382 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6411a350 con 0x7f7c44003680 2021-05-26T16:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6411a580 con 0x7f7c64142660 2021-05-26T16:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64097a80 con 0x7f7c6412cb40 2021-05-26T16:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c69277700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.157+0000 7f7c69277700 10 monclient(hunting): authenticate will time out at 1104.788288s 2021-05-26T16:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c627fc700 1 -- 172.21.15.3:0/978621382 >> v1:172.21.15.3:6792/0 conn(0x7f7c6412cb40 legacy=0x7f7c6412cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c637fe700 1 -- 172.21.15.3:0/978621382 >> v1:172.21.15.137:6789/0 conn(0x7f7c64142660 legacy=0x7f7c64144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551948060 0 0) 0x7f7c64097a80 con 0x7f7c6412cb40 2021-05-26T16:45:47.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): my global_id is 5496 2021-05-26T16:45:47.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c4400f040 con 0x7f7c6412cb40 2021-05-26T16:45:47.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326645609 0 0) 0x7f7c6411a580 con 0x7f7c64142660 2021-05-26T16:45:47.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): my global_id is 5536 2021-05-26T16:45:47.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c64097a80 con 0x7f7c64142660 2021-05-26T16:45:47.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1753362876 0 0) 0x7f7c4400f040 con 0x7f7c6412cb40 2021-05-26T16:45:47.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c6411a580 con 0x7f7c6412cb40 2021-05-26T16:45:47.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 307525306 0 0) 0x7f7c64097a80 con 0x7f7c64142660 2021-05-26T16:45:47.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c4400f040 con 0x7f7c64142660 2021-05-26T16:45:47.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7c4c001b70 con 0x7f7c6412cb40 2021-05-26T16:45:47.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:47.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): dump: 2021-05-26T16:45:47.190 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.190 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.190 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.190 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.190 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.191 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.191 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.191 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.191 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.193 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7c54001f90 con 0x7f7c64142660 2021-05-26T16:45:47.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:47.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.159+0000 7f7c4affd700 10 monclient(hunting): dump: 2021-05-26T16:45:47.194 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.197 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.197 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.197 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.197 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.198 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3082355593 0 0) 0x7f7c6411a580 con 0x7f7c6412cb40 2021-05-26T16:45:47.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 >> v1:172.21.15.137:6789/0 conn(0x7f7c64142660 legacy=0x7f7c64144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 >> v1:172.21.15.3:6789/0 conn(0x7f7c44003680 legacy=0x7f7c6413c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.198 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:47.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 1 monclient: found mon.d 2021-05-26T16:45:47.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:47.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:47.199 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c64069870 con 0x7f7c6412cb40 2021-05-26T16:45:47.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 10 monclient: _finish_auth 0 2021-05-26T16:45:47.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:47.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c69277700 5 monclient: authenticate success, global_id 5496 2021-05-26T16:45:47.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c69277700 10 monclient: _renew_subs 2021-05-26T16:45:47.200 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c69277700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:47.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c64094750 con 0x7f7c6412cb40 2021-05-26T16:45:47.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c69277700 10 monclient: _renew_subs 2021-05-26T16:45:47.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c69277700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:47.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c64146170 con 0x7f7c6412cb40 2021-05-26T16:45:47.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7c4c004850 con 0x7f7c6412cb40 2021-05-26T16:45:47.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:47.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7c4c004d00 con 0x7f7c6412cb40 2021-05-26T16:45:47.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:47.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c617fa700 4 set_mon_vals no callback set 2021-05-26T16:45:47.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.160+0000 7f7c4affd700 10 monclient: dump: 2021-05-26T16:45:47.203 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.203 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.204 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.204 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.204 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.204 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.204 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.205 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.205 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.205 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.205 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.206 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.206 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.206 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.206 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.206 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.161+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f7c4c004f60 con 0x7f7c6412cb40 2021-05-26T16:45:47.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.161+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(203..203 src has 1..203) v4 ==== 3941+0+0 (unknown 3764480557 0 0) 0x7f7c4c03d860 con 0x7f7c6412cb40 2021-05-26T16:45:47.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.161+0000 7f7c62ffd700 10 monclient: get_auth_request con 0x7f7c44034670 auth_method 0 2021-05-26T16:45:47.207 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.161+0000 7f7c69277700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:47.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.161+0000 7f7c69277700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:47.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.161+0000 7f7c69277700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:47.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.161+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c40004db0 con 0x7f7c6412cb40 2021-05-26T16:45:47.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.166+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f7c4c001cd0 con 0x7f7c6412cb40 2021-05-26T16:45:47.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.166+0000 7f7c4affd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:47.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.166+0000 7f7c4affd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:47.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.391+0000 7f7c69277700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:45:47.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.391+0000 7f7c69277700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:45:47.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.391+0000 7f7c69277700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:47.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.391+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 --> v1:172.21.15.3:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7c400055e0 con 0x7f7c6412cb40 2021-05-26T16:45:47.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.391+0000 7f7c4affd700 1 -- 172.21.15.3:0/978621382 <== mon.6 v1:172.21.15.3:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2644 (unknown 254746657 0 1530683578) 0x7f7c4c012fa0 con 0x7f7c6412cb40 2021-05-26T16:45:47.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.391+0000 7f7c4affd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:45:47.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.391+0000 7f7c4affd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:47.396 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:45:47.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 >> v1:172.21.15.137:6812/30003 conn(0x7f7c44034670 legacy=0x7f7c44036b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 10 monclient: shutdown 2021-05-26T16:45:47.397 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:47.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 >> v1:172.21.15.3:6792/0 conn(0x7f7c6412cb40 legacy=0x7f7c6412cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 shutdown_connections 2021-05-26T16:45:47.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 >> 172.21.15.3:0/978621382 conn(0x7f7c6409a9b0 msgr2=0x7f7c6409d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:47.398 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 shutdown_connections 2021-05-26T16:45:47.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.393+0000 7f7c69277700 1 -- 172.21.15.3:0/978621382 wait complete. 2021-05-26T16:45:47.415 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2021-05-26T16:45:47.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-05-26T16:45:47.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.560+0000 7f986cfe2700 10 monclient: get_monmap_and_config 2021-05-26T16:45:47.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.560+0000 7f986cfe2700 10 monclient: build_initial_monmap 2021-05-26T16:45:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.560+0000 7f986cfe2700 10 monclient: monmap: 2021-05-26T16:45:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:47.561296+0000 2021-05-26T16:45:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:47.561296+0000 2021-05-26T16:45:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:47.566 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:47.566 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:47.566 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:47.566 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:47.567 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 1 Processor -- start 2021-05-26T16:45:47.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 1 -- start start 2021-05-26T16:45:47.568 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient: init 2021-05-26T16:45:47.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:47.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient: _add_conns ranks=[1,4,6,3,5,2,0,7,8] 2021-05-26T16:45:47.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient(hunting): picked mon.noname-f con 0x7f9868096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:47.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient(hunting): picked mon.noname-c con 0x7f9868099db0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:47.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient(hunting): picked mon.noname-d con 0x7f986809a260 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:47.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9868059750 con 0x7f9868096ca0 2021-05-26T16:45:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9868064620 con 0x7f9868099db0 2021-05-26T16:45:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9868064e50 con 0x7f986809a260 2021-05-26T16:45:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.561+0000 7f986cfe2700 10 monclient(hunting): authenticate will time out at 1105.192996s 2021-05-26T16:45:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.562+0000 7f9866d9d700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f986809a260 0x7f98681357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58528/0 (socket says 172.21.15.3:58528) 2021-05-26T16:45:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.562+0000 7f9865d9b700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f9868099db0 0x7f9868132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38638/0 (socket says 172.21.15.3:38638) 2021-05-26T16:45:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.562+0000 7f9866d9d700 1 -- 172.21.15.3:0/875299355 learned_addr learned my addr 172.21.15.3:0/875299355 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f9866d9d700 1 -- 172.21.15.3:0/875299355 >> v1:172.21.15.3:6792/0 conn(0x7f986809a260 legacy=0x7f98681357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f9865d9b700 1 -- 172.21.15.3:0/875299355 >> v1:172.21.15.3:6791/0 conn(0x7f9868099db0 legacy=0x7f9868132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458670884 0 0) 0x7f9868064e50 con 0x7f986809a260 2021-05-26T16:45:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient(hunting): my global_id is 5505 2021-05-26T16:45:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f984c003270 con 0x7f986809a260 2021-05-26T16:45:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200958490 0 0) 0x7f9868064620 con 0x7f9868099db0 2021-05-26T16:45:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient(hunting): my global_id is 114106 2021-05-26T16:45:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9868064e50 con 0x7f9868099db0 2021-05-26T16:45:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986659c700 1 -- 172.21.15.3:0/875299355 >> v1:172.21.15.137:6789/0 conn(0x7f9868096ca0 legacy=0x7f9868063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1173829413 0 0) 0x7f984c003270 con 0x7f986809a260 2021-05-26T16:45:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 >> v1:172.21.15.3:6791/0 conn(0x7f9868099db0 legacy=0x7f9868132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 >> v1:172.21.15.137:6789/0 conn(0x7f9868096ca0 legacy=0x7f9868063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: _finish_hunting 0 2021-05-26T16:45:47.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 monclient: found mon.noname-d 2021-05-26T16:45:47.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:47.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:45:47.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986809c390 con 0x7f986809a260 2021-05-26T16:45:47.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: _finish_auth 0 2021-05-26T16:45:47.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:47.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9858001de0 con 0x7f986809a260 2021-05-26T16:45:47.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:47.590 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: dump: 2021-05-26T16:45:47.590 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.590 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.590 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.591 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.591 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.591 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.591 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.592 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.592 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.592 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.592 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.593 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.593 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.593 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.594 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.594 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986cfe2700 5 monclient: authenticate success, global_id 5505 2021-05-26T16:45:47.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986cfe2700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:47.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f98580020f0 con 0x7f986809a260 2021-05-26T16:45:47.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:47.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 1 -- 172.21.15.3:0/875299355 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9858004cb0 con 0x7f986809a260 2021-05-26T16:45:47.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986cfe2700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:47.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986cfe2700 4 set_mon_vals no callback set 2021-05-26T16:45:47.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:47.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.564+0000 7f986559a700 10 monclient: dump: 2021-05-26T16:45:47.596 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.599 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.599 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.599 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.599 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.599 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.600 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 10 monclient: shutdown 2021-05-26T16:45:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 1 -- 172.21.15.3:0/875299355 >> v1:172.21.15.3:6792/0 conn(0x7f986809a260 legacy=0x7f98681357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 1 -- 172.21.15.3:0/875299355 shutdown_connections 2021-05-26T16:45:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 1 -- 172.21.15.3:0/875299355 >> 172.21.15.3:0/875299355 conn(0x7f986809cc00 msgr2=0x7f986809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 1 -- 172.21.15.3:0/875299355 shutdown_connections 2021-05-26T16:45:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 1 -- 172.21.15.3:0/875299355 wait complete. 2021-05-26T16:45:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 10 monclient: build_initial_monmap 2021-05-26T16:45:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.565+0000 7f986cfe2700 10 monclient: monmap: 2021-05-26T16:45:47.603 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:47.603 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:47.603 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:47.603 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:47.603 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:47.604 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.604 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:47.604 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:47.604 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:47.606 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 1 Processor -- start 2021-05-26T16:45:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 1 -- start start 2021-05-26T16:45:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient: init 2021-05-26T16:45:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient: _add_conns ranks=[8,5,2,7,1,3,6,4,0] 2021-05-26T16:45:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient(hunting): picked mon.noname-e con 0x7f9868096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient(hunting): picked mon.noname-h con 0x7f9868099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient(hunting): picked mon.noname-b con 0x7f986809a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9868116f20 con 0x7f986809a260 2021-05-26T16:45:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98681171c0 con 0x7f9868099db0 2021-05-26T16:45:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986812ffb0 con 0x7f9868096ca0 2021-05-26T16:45:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986cfe2700 10 monclient(hunting): authenticate will time out at 1105.197747s 2021-05-26T16:45:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f9866d9d700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f986809a260 0x7f9868144900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55176/0 (socket says 172.21.15.3:55176) 2021-05-26T16:45:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f986659c700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f9868096ca0 0x7f9868129780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54210/0 (socket says 172.21.15.3:54210) 2021-05-26T16:45:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.566+0000 7f9866d9d700 1 -- 172.21.15.3:0/2854028496 learned_addr learned my addr 172.21.15.3:0/2854028496 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f9866d9d700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6790/0 conn(0x7f986809a260 legacy=0x7f9868144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986659c700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6793/0 conn(0x7f9868096ca0 legacy=0x7f9868129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f9865d9b700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.137:6791/0 conn(0x7f9868099db0 legacy=0x7f98681411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431792538 0 0) 0x7f9868116f20 con 0x7f986809a260 2021-05-26T16:45:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): my global_id is 5501 2021-05-26T16:45:47.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9844003270 con 0x7f986809a260 2021-05-26T16:45:47.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035098114 0 0) 0x7f986812ffb0 con 0x7f9868096ca0 2021-05-26T16:45:47.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): my global_id is 104759 2021-05-26T16:45:47.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9868116f20 con 0x7f9868096ca0 2021-05-26T16:45:47.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692518190 0 0) 0x7f98681171c0 con 0x7f9868099db0 2021-05-26T16:45:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): my global_id is 5630 2021-05-26T16:45:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f986812ffb0 con 0x7f9868099db0 2021-05-26T16:45:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3397583261 0 0) 0x7f9844003270 con 0x7f986809a260 2021-05-26T16:45:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98681171c0 con 0x7f986809a260 2021-05-26T16:45:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9858001e10 con 0x7f986809a260 2021-05-26T16:45:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:45:47.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): dump: 2021-05-26T16:45:47.616 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.616 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.617 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.617 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.617 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.617 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.618 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.618 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.618 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.618 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.619 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.619 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.619 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.619 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.620 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.620 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:47.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2920790795 0 0) 0x7f9868116f20 con 0x7f9868096ca0 2021-05-26T16:45:47.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9844003270 con 0x7f9868096ca0 2021-05-26T16:45:47.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f985c001cb0 con 0x7f9868096ca0 2021-05-26T16:45:47.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:47.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient(hunting): dump: 2021-05-26T16:45:47.622 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.622 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.622 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.623 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.623 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.623 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.623 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.624 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.624 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.624 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.624 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.625 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.625 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.625 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.625 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.626 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 71181039 0 0) 0x7f986812ffb0 con 0x7f9868099db0 2021-05-26T16:45:47.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9868116f20 con 0x7f9868099db0 2021-05-26T16:45:47.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3873968954 0 0) 0x7f98681171c0 con 0x7f986809a260 2021-05-26T16:45:47.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6793/0 conn(0x7f9868096ca0 legacy=0x7f9868129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.137:6791/0 conn(0x7f9868099db0 legacy=0x7f98681411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient: _finish_hunting 0 2021-05-26T16:45:47.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 monclient: found mon.b 2021-05-26T16:45:47.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:47.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:45:47.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986812f4d0 con 0x7f986809a260 2021-05-26T16:45:47.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient: _finish_auth 0 2021-05-26T16:45:47.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:47.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986cfe2700 5 monclient: authenticate success, global_id 5501 2021-05-26T16:45:47.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986cfe2700 10 monclient: _renew_subs 2021-05-26T16:45:47.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986cfe2700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:45:47.629 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986813cc60 con 0x7f986809a260 2021-05-26T16:45:47.630 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986cfe2700 10 monclient: _renew_subs 2021-05-26T16:45:47.630 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986cfe2700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:45:47.630 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9868129e90 con 0x7f986809a260 2021-05-26T16:45:47.630 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9858004fe0 con 0x7f986809a260 2021-05-26T16:45:47.631 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:47.631 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9858005490 con 0x7f986809a260 2021-05-26T16:45:47.631 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.631 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f9864d99700 4 set_mon_vals no callback set 2021-05-26T16:45:47.632 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:47.632 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.569+0000 7f98567fc700 10 monclient: dump: 2021-05-26T16:45:47.632 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.632 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.633 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.633 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.633 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.633 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.634 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.634 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.634 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.634 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.634 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.635 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.635 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.635 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.635 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.636 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.636 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.570+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f9858005670 con 0x7f986809a260 2021-05-26T16:45:47.636 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.570+0000 7f986cfe2700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:47.636 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.570+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(203..203 src has 1..203) v4 ==== 3941+0+0 (unknown 3764480557 0 0) 0x7f985803de10 con 0x7f986809a260 2021-05-26T16:45:47.637 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.570+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f98480065a0 con 0x7f9848002840 2021-05-26T16:45:47.637 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.571+0000 7f986659c700 10 monclient: get_auth_request con 0x7f9844033200 auth_method 0 2021-05-26T16:45:47.637 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f9865d9b700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f9848002840 legacy=0x7f9848004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.637 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291808750 0 0) 0x7f98480065a0 con 0x7f9848002840 2021-05-26T16:45:47.637 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.638 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.638 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient(hunting): my global_id is 104805 2021-05-26T16:45:47.638 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98681171c0 con 0x7f9848002840 2021-05-26T16:45:47.638 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3613740721 0 0) 0x7f98681171c0 con 0x7f9848002840 2021-05-26T16:45:47.639 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98480065a0 con 0x7f9848002840 2021-05-26T16:45:47.639 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f9850004aa0 con 0x7f9848002840 2021-05-26T16:45:47.639 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.639 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:47.640 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient: dump: 2021-05-26T16:45:47.640 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.640 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.640 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.640 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.641 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.641 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.641 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.641 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.642 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.642 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.642 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.642 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.643 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.643 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.643 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.643 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3148451034 0 0) 0x7f98480065a0 con 0x7f9848002840 2021-05-26T16:45:47.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9848009e40 con 0x7f9848002840 2021-05-26T16:45:47.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f9850004f40 con 0x7f9848002840 2021-05-26T16:45:47.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:47.644 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:47.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f9848002840 legacy=0x7f9848004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.645 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.573+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f9848002840 legacy=0x7f9848004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.580+0000 7f986cfe2700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:47.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.580+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9848007510 con 0x7f98480068b0 2021-05-26T16:45:47.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.582+0000 7f9865d9b700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f98480068b0 legacy=0x7f9848006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.582+0000 7f9865d9b700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f98480068b0 legacy=0x7f9848006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-05-26T16:45:47.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.582+0000 7f9865d9b700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f98480068b0 legacy=0x7f9848006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:45:47.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.582+0000 7f9865d9b700 1 --1- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f98480068b0 0x7f9848006d40 :-1 s=OPENED pgs=300 cs=1 l=1).handle_message read tag failed 2021-05-26T16:45:47.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.582+0000 7f9865d9b700 1 --1- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f98480068b0 0x7f9848006d40 :-1 s=OPENED pgs=300 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:45:47.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.583+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f98480068b0 legacy=0x7f9848006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.583+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f98480068b0 legacy=0x7f9848006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.583+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f98480065a0 con 0x7f984403beb0 2021-05-26T16:45:47.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f9865d9b700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f984403beb0 legacy=0x7f984403a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642876525 0 0) 0x7f98480065a0 con 0x7f984403beb0 2021-05-26T16:45:47.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 10 monclient(hunting): my global_id is 104823 2021-05-26T16:45:47.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98681171c0 con 0x7f984403beb0 2021-05-26T16:45:47.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2604182624 0 0) 0x7f98681171c0 con 0x7f984403beb0 2021-05-26T16:45:47.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98480065a0 con 0x7f984403beb0 2021-05-26T16:45:47.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f98500058a0 con 0x7f984403beb0 2021-05-26T16:45:47.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:47.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 10 monclient: dump: 2021-05-26T16:45:47.653 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.653 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.654 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.654 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.654 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.654 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.655 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.655 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.655 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.655 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.656 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.656 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.656 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.656 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.656 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.657 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3862047922 0 0) 0x7f98480065a0 con 0x7f984403beb0 2021-05-26T16:45:47.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.585+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 --> v1:172.21.15.3:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9850004f40 con 0x7f984403beb0 2021-05-26T16:45:47.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7324 (unknown 0 0 4284636025) 0x7f9850007b40 con 0x7f984403beb0 2021-05-26T16:45:47.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f98567fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:47.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f98567fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:47.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f984403beb0 legacy=0x7f984403a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f98567fc700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6789/0 conn(0x7f984403beb0 legacy=0x7f984403a810 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.659 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f9866d9d700 1 -- 172.21.15.3:0/2854028496 reap_dead start 2021-05-26T16:45:47.659 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:47.659 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:47.660 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:47.660 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "leader", 2021-05-26T16:45:47.660 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:47.660 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:45:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.711 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.711 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:47.711 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:47.711 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.711 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.712 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.712 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.712 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:47.712 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:47.719 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:47.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.137:6812/30003 conn(0x7f9844033200 legacy=0x7f98440356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.721 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 10 monclient: shutdown 2021-05-26T16:45:47.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:47.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 >> v1:172.21.15.3:6790/0 conn(0x7f986809a260 legacy=0x7f9868144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 shutdown_connections 2021-05-26T16:45:47.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 >> 172.21.15.3:0/2854028496 conn(0x7f986809cc00 msgr2=0x7f986809ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:47.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 shutdown_connections 2021-05-26T16:45:47.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.586+0000 7f986cfe2700 1 -- 172.21.15.3:0/2854028496 wait complete. 2021-05-26T16:45:47.724 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-05-26T16:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.839+0000 7fa15de48700 10 monclient: get_monmap_and_config 2021-05-26T16:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.839+0000 7fa15de48700 10 monclient: build_initial_monmap 2021-05-26T16:45:47.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.839+0000 7fa15de48700 10 monclient: monmap: 2021-05-26T16:45:47.842 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:47.842 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.842 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:47.839770+0000 2021-05-26T16:45:47.843 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:47.839770+0000 2021-05-26T16:45:47.843 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:47.843 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.843 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:47.844 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:47.844 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:47.844 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:47.844 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.839+0000 7fa15de48700 1 Processor -- start 2021-05-26T16:45:47.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.839+0000 7fa15de48700 1 -- start start 2021-05-26T16:45:47.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.839+0000 7fa15de48700 10 monclient: init 2021-05-26T16:45:47.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:47.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 10 monclient: _add_conns ranks=[6,1,5,8,7,2,3,0,4] 2021-05-26T16:45:47.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 10 monclient(hunting): picked mon.noname-d con 0x7fa158096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:47.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 10 monclient(hunting): picked mon.noname-f con 0x7fa158099db0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:47.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 10 monclient(hunting): picked mon.noname-h con 0x7fa15809a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:47.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158059750 con 0x7fa158099db0 2021-05-26T16:45:47.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158064620 con 0x7fa15809a260 2021-05-26T16:45:47.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158064e50 con 0x7fa158096ca0 2021-05-26T16:45:47.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:47.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa15de48700 10 monclient(hunting): authenticate will time out at 1105.471509s 2021-05-26T16:45:47.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa1577fe700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fa158096ca0 0x7fa158063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58544/0 (socket says 172.21.15.3:58544) 2021-05-26T16:45:47.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.840+0000 7fa1577fe700 1 -- 172.21.15.3:0/1622904878 learned_addr learned my addr 172.21.15.3:0/1622904878 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:47.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.842+0000 7fa1577fe700 1 -- 172.21.15.3:0/1622904878 >> v1:172.21.15.3:6792/0 conn(0x7fa158096ca0 legacy=0x7fa158063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.842+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205433264 0 0) 0x7fa158064e50 con 0x7fa158096ca0 2021-05-26T16:45:47.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.842+0000 7fa1567fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.842+0000 7fa1567fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.842+0000 7fa1567fc700 10 monclient(hunting): my global_id is 5514 2021-05-26T16:45:47.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.842+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa13c003270 con 0x7fa158096ca0 2021-05-26T16:45:47.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa157fff700 1 -- 172.21.15.3:0/1622904878 >> v1:172.21.15.137:6791/0 conn(0x7fa15809a260 legacy=0x7fa1581357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa156ffd700 1 -- 172.21.15.3:0/1622904878 >> v1:172.21.15.137:6789/0 conn(0x7fa158099db0 legacy=0x7fa158132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2588694845 0 0) 0x7fa13c003270 con 0x7fa158096ca0 2021-05-26T16:45:47.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 >> v1:172.21.15.137:6791/0 conn(0x7fa15809a260 legacy=0x7fa1581357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 >> v1:172.21.15.137:6789/0 conn(0x7fa158099db0 legacy=0x7fa158132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: _finish_hunting 0 2021-05-26T16:45:47.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 monclient: found mon.noname-d 2021-05-26T16:45:47.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:47.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:45:47.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15809c390 con 0x7fa158096ca0 2021-05-26T16:45:47.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: _finish_auth 0 2021-05-26T16:45:47.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:47.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 5 monclient: authenticate success, global_id 5514 2021-05-26T16:45:47.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa144001a60 con 0x7fa158096ca0 2021-05-26T16:45:47.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:47.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:47.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: dump: 2021-05-26T16:45:47.865 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.865 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.865 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.865 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.866 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.866 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.866 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.866 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.867 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.867 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.867 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.867 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.867 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.868 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.868 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.868 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:47.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa144001d70 con 0x7fa158096ca0 2021-05-26T16:45:47.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:47.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:47.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 1 -- 172.21.15.3:0/1622904878 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa144004930 con 0x7fa158096ca0 2021-05-26T16:45:47.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 4 set_mon_vals no callback set 2021-05-26T16:45:47.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:47.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa1567fc700 10 monclient: dump: 2021-05-26T16:45:47.870 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.870 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.871 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.871 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.871 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.871 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.871 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.872 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.872 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.872 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.872 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.872 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.873 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.873 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.873 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.873 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 10 monclient: shutdown 2021-05-26T16:45:47.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:47.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 1 -- 172.21.15.3:0/1622904878 >> v1:172.21.15.3:6792/0 conn(0x7fa158096ca0 legacy=0x7fa158063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 1 -- 172.21.15.3:0/1622904878 shutdown_connections 2021-05-26T16:45:47.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 1 -- 172.21.15.3:0/1622904878 >> 172.21.15.3:0/1622904878 conn(0x7fa15809cc00 msgr2=0x7fa15809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:47.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 1 -- 172.21.15.3:0/1622904878 shutdown_connections 2021-05-26T16:45:47.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.843+0000 7fa15de48700 1 -- 172.21.15.3:0/1622904878 wait complete. 2021-05-26T16:45:47.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.844+0000 7fa15de48700 10 monclient: build_initial_monmap 2021-05-26T16:45:47.875 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.844+0000 7fa15de48700 10 monclient: monmap: 2021-05-26T16:45:47.876 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:47.876 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:47.876 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:47.876 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:47.877 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:47.877 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.877 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:47.877 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:47.877 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:47.878 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:47.878 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:47.878 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:47.878 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:47.878 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:47.879 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:47.879 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.844+0000 7fa15de48700 1 Processor -- start 2021-05-26T16:45:47.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.844+0000 7fa15de48700 1 -- start start 2021-05-26T16:45:47.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.844+0000 7fa15de48700 10 monclient: init 2021-05-26T16:45:47.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:47.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 10 monclient: _add_conns ranks=[1,5,3,4,8,0,2,6,7] 2021-05-26T16:45:47.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 10 monclient(hunting): picked mon.noname-f con 0x7fa158096ca0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:47.880 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 10 monclient(hunting): picked mon.noname-h con 0x7fa158099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:47.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 10 monclient(hunting): picked mon.noname-g con 0x7fa15809a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:47.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158116850 con 0x7fa158096ca0 2021-05-26T16:45:47.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158116a80 con 0x7fa15809a260 2021-05-26T16:45:47.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158116d20 con 0x7fa158099db0 2021-05-26T16:45:47.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:47.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa15de48700 10 monclient(hunting): authenticate will time out at 1105.476369s 2021-05-26T16:45:47.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa1577fe700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa158096ca0 0x7fa15813c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.3:48184/0 (socket says 172.21.15.3:48184) 2021-05-26T16:45:47.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.845+0000 7fa1577fe700 1 -- 172.21.15.3:0/1930590512 learned_addr learned my addr 172.21.15.3:0/1930590512 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:47.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa157fff700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.137:6790/0 conn(0x7fa15809a260 legacy=0x7fa158144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1577fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.137:6789/0 conn(0x7fa158096ca0 legacy=0x7fa15813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa156ffd700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.137:6791/0 conn(0x7fa158099db0 legacy=0x7fa158141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73136384 0 0) 0x7fa158116a80 con 0x7fa15809a260 2021-05-26T16:45:47.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 10 monclient(hunting): my global_id is 5466 2021-05-26T16:45:47.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa138003270 con 0x7fa15809a260 2021-05-26T16:45:47.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763999864 0 0) 0x7fa158116d20 con 0x7fa158099db0 2021-05-26T16:45:47.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 10 monclient(hunting): my global_id is 5648 2021-05-26T16:45:47.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa158116a80 con 0x7fa158099db0 2021-05-26T16:45:47.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.847+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112323782 0 0) 0x7fa158116850 con 0x7fa158096ca0 2021-05-26T16:45:47.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.885 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.886 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): my global_id is 5563 2021-05-26T16:45:47.886 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa158116d20 con 0x7fa158096ca0 2021-05-26T16:45:47.886 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4200354729 0 0) 0x7fa138003270 con 0x7fa15809a260 2021-05-26T16:45:47.886 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa158116850 con 0x7fa15809a260 2021-05-26T16:45:47.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2515180010 0 0) 0x7fa158116a80 con 0x7fa158099db0 2021-05-26T16:45:47.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa138003270 con 0x7fa158099db0 2021-05-26T16:45:47.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa14c001fe0 con 0x7fa15809a260 2021-05-26T16:45:47.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.887 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:45:47.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): dump: 2021-05-26T16:45:47.888 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.888 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.888 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.888 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.889 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.889 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.889 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.889 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.889 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.890 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.890 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.890 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.890 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.890 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.891 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.891 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.891 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:47.891 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa148001cf0 con 0x7fa158099db0 2021-05-26T16:45:47.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:45:47.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): dump: 2021-05-26T16:45:47.892 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.892 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.893 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.893 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.893 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.893 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.893 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.894 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.894 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.894 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.894 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.894 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.895 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2640665907 0 0) 0x7fa158116d20 con 0x7fa158096ca0 2021-05-26T16:45:47.896 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa158116a80 con 0x7fa158096ca0 2021-05-26T16:45:47.896 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa144004870 con 0x7fa158096ca0 2021-05-26T16:45:47.896 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.896 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:47.897 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient(hunting): dump: 2021-05-26T16:45:47.897 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.897 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.897 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.900 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.900 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.900 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.900 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4276490843 0 0) 0x7fa158116850 con 0x7fa15809a260 2021-05-26T16:45:47.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.137:6791/0 conn(0x7fa158099db0 legacy=0x7fa158141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.137:6789/0 conn(0x7fa158096ca0 legacy=0x7fa15813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient: _finish_hunting 0 2021-05-26T16:45:47.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 monclient: found mon.g 2021-05-26T16:45:47.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:47.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:45:47.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158116fc0 con 0x7fa15809a260 2021-05-26T16:45:47.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient: _finish_auth 0 2021-05-26T16:45:47.903 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:47.903 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa15de48700 5 monclient: authenticate success, global_id 5466 2021-05-26T16:45:47.903 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa15de48700 10 monclient: _renew_subs 2021-05-26T16:45:47.903 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa15de48700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:45:47.903 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa158094d30 con 0x7fa15809a260 2021-05-26T16:45:47.904 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa15de48700 10 monclient: _renew_subs 2021-05-26T16:45:47.904 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa15de48700 10 monclient: _send_mon_message to mon.g at v1:172.21.15.137:6790/0 2021-05-26T16:45:47.904 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.137:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15813cd60 con 0x7fa15809a260 2021-05-26T16:45:47.904 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa14c0025b0 con 0x7fa15809a260 2021-05-26T16:45:47.904 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:47.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa14c002a60 con 0x7fa15809a260 2021-05-26T16:45:47.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa155ffb700 4 set_mon_vals no callback set 2021-05-26T16:45:47.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:45:47.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.848+0000 7fa1437fe700 10 monclient: dump: 2021-05-26T16:45:47.906 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.906 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.906 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.906 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.907 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.907 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.907 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.907 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.908 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.908 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.908 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.908 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.908 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.909 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.909 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.909 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.909 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.849+0000 7fa15de48700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:47.909 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.849+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa1300065a0 con 0x7fa130002840 2021-05-26T16:45:47.910 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.849+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fa14c002c40 con 0x7fa15809a260 2021-05-26T16:45:47.910 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.849+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.3 v1:172.21.15.137:6790/0 8 ==== osd_map(203..203 src has 1..203) v4 ==== 3941+0+0 (unknown 3764480557 0 0) 0x7fa14c03dcd0 con 0x7fa15809a260 2021-05-26T16:45:47.910 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.849+0000 7fa156ffd700 10 monclient: get_auth_request con 0x7fa1380334c0 auth_method 0 2021-05-26T16:45:47.910 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.851+0000 7fa1577fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa130002840 legacy=0x7fa130004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.910 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.851+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329560234 0 0) 0x7fa1300065a0 con 0x7fa130002840 2021-05-26T16:45:47.911 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.851+0000 7fa1437fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.911 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.851+0000 7fa1437fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.911 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.851+0000 7fa1437fe700 10 monclient(hunting): my global_id is 5510 2021-05-26T16:45:47.911 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.851+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa158116850 con 0x7fa130002840 2021-05-26T16:45:47.912 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1762142006 0 0) 0x7fa158116850 con 0x7fa130002840 2021-05-26T16:45:47.912 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa1300065a0 con 0x7fa130002840 2021-05-26T16:45:47.912 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa144001320 con 0x7fa130002840 2021-05-26T16:45:47.912 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.912 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:47.913 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 10 monclient: dump: 2021-05-26T16:45:47.913 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.913 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.913 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.913 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.914 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.914 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.914 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.914 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.914 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.915 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.915 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.915 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.915 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.915 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.916 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.916 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.916 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1577229528 0 0) 0x7fa1300065a0 con 0x7fa130002840 2021-05-26T16:45:47.916 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa130009e40 con 0x7fa130002840 2021-05-26T16:45:47.916 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fa1440050b0 con 0x7fa130002840 2021-05-26T16:45:47.917 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:47.917 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:47.917 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa130002840 legacy=0x7fa130004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.917 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.852+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa130002840 legacy=0x7fa130004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.920 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa15de48700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:47.920 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa130007510 con 0x7fa1300068b0 2021-05-26T16:45:47.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa1577fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa1300068b0 legacy=0x7fa130006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-05-26T16:45:47.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa1577fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa1300068b0 legacy=0x7fa130006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:45:47.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa1577fe700 1 --1- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa1300068b0 0x7fa130006d40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-05-26T16:45:47.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa1577fe700 1 --1- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa1300068b0 0x7fa130006d40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-05-26T16:45:47.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa1300068b0 legacy=0x7fa130006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa1300068b0 legacy=0x7fa130006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.859+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa1300065a0 con 0x7fa13803bf70 2021-05-26T16:45:47.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.861+0000 7fa1577fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa13803bf70 legacy=0x7fa13803aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:47.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.861+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870554623 0 0) 0x7fa1300065a0 con 0x7fa13803bf70 2021-05-26T16:45:47.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.861+0000 7fa1437fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:47.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.861+0000 7fa1437fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:47.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.861+0000 7fa1437fe700 10 monclient(hunting): my global_id is 5519 2021-05-26T16:45:47.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.861+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa158116850 con 0x7fa13803bf70 2021-05-26T16:45:47.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2825592414 0 0) 0x7fa158116850 con 0x7fa13803bf70 2021-05-26T16:45:47.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa1300065a0 con 0x7fa13803bf70 2021-05-26T16:45:47.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fa1440058d0 con 0x7fa13803bf70 2021-05-26T16:45:47.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:47.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:47.925 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 10 monclient: dump: 2021-05-26T16:45:47.925 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:47.925 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:47.925 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.925 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:47.926 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:47.926 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:47.926 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:47.926 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:47.927 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:47.927 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:47.927 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:47.927 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:47.927 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:47.927 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:47.928 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:47.928 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:47.928 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3420820602 0 0) 0x7fa1300065a0 con 0x7fa13803bf70 2021-05-26T16:45:47.928 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 --> v1:172.21.15.3:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa1440050b0 con 0x7fa13803bf70 2021-05-26T16:45:47.929 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 2707413603) 0x7fa144007db0 con 0x7fa13803bf70 2021-05-26T16:45:47.929 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:47.929 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:47.929 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa13803bf70 legacy=0x7fa13803aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.929 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa1437fe700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.3:6790/0 conn(0x7fa13803bf70 legacy=0x7fa13803aa50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:47.930 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa157fff700 1 -- 172.21.15.3:0/1930590512 reap_dead start 2021-05-26T16:45:47.930 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:47.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:47.931 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:47.931 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:47.931 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:45:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:45:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:47.985 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:47.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.137:6812/30003 conn(0x7fa1380334c0 legacy=0x7fa138035980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa15de48700 10 monclient: shutdown 2021-05-26T16:45:47.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa15de48700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:47.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.862+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 >> v1:172.21.15.137:6790/0 conn(0x7fa15809a260 legacy=0x7fa158144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:47.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.863+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 shutdown_connections 2021-05-26T16:45:47.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.863+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 >> 172.21.15.3:0/1930590512 conn(0x7fa15809cc00 msgr2=0x7fa158099660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:47.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.863+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 shutdown_connections 2021-05-26T16:45:47.988 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:47.863+0000 7fa15de48700 1 -- 172.21.15.3:0/1930590512 wait complete. 2021-05-26T16:45:47.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-05-26T16:45:48.104 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.102+0000 7f5b22d7c700 10 monclient: get_monmap_and_config 2021-05-26T16:45:48.105 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.102+0000 7f5b22d7c700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.105 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.102+0000 7f5b22d7c700 10 monclient: monmap: 2021-05-26T16:45:48.105 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.105 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.106 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:48.103265+0000 2021-05-26T16:45:48.106 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:48.103265+0000 2021-05-26T16:45:48.106 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.106 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.109 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 1 Processor -- start 2021-05-26T16:45:48.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 1 -- start start 2021-05-26T16:45:48.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient: init 2021-05-26T16:45:48.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient: _add_conns ranks=[7,0,2,5,8,3,4,6,1] 2021-05-26T16:45:48.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient(hunting): picked mon.noname-i con 0x7f5b1c12cd90 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:48.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient(hunting): picked mon.noname-a con 0x7f5b1c096d10 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:48.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient(hunting): picked mon.noname-b con 0x7f5b1c12d760 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:48.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c046600 con 0x7f5b1c096d10 2021-05-26T16:45:48.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c097820 con 0x7f5b1c12d760 2021-05-26T16:45:48.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c09a3f0 con 0x7f5b1c12cd90 2021-05-26T16:45:48.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.103+0000 7f5b22d7c700 10 monclient(hunting): authenticate will time out at 1105.734995s 2021-05-26T16:45:48.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.104+0000 7f5b21579700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5b1c096d10 0x7f5b1c1320c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53170/0 (socket says 172.21.15.3:53170) 2021-05-26T16:45:48.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.104+0000 7f5b2257b700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f5b1c12d760 0x7f5b1c1357f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55214/0 (socket says 172.21.15.3:55214) 2021-05-26T16:45:48.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.104+0000 7f5b21579700 1 -- 172.21.15.3:0/42657240 learned_addr learned my addr 172.21.15.3:0/42657240 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b21579700 1 -- 172.21.15.3:0/42657240 >> v1:172.21.15.3:6789/0 conn(0x7f5b1c096d10 legacy=0x7f5b1c1320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b2257b700 1 -- 172.21.15.3:0/42657240 >> v1:172.21.15.3:6790/0 conn(0x7f5b1c12d760 legacy=0x7f5b1c1357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794737469 0 0) 0x7f5b1c046600 con 0x7f5b1c096d10 2021-05-26T16:45:48.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): my global_id is 104832 2021-05-26T16:45:48.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b04003270 con 0x7f5b1c096d10 2021-05-26T16:45:48.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818784746 0 0) 0x7f5b1c097820 con 0x7f5b1c12d760 2021-05-26T16:45:48.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.124 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): my global_id is 5528 2021-05-26T16:45:48.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c046600 con 0x7f5b1c12d760 2021-05-26T16:45:48.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b21d7a700 1 -- 172.21.15.3:0/42657240 >> v1:172.21.15.137:6792/0 conn(0x7f5b1c12cd90 legacy=0x7f5b1c099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.125 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601760052 0 0) 0x7f5b1c09a3f0 con 0x7f5b1c12cd90 2021-05-26T16:45:48.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient(hunting): my global_id is 104659 2021-05-26T16:45:48.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c097820 con 0x7f5b1c12cd90 2021-05-26T16:45:48.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3528672499 0 0) 0x7f5b1c046600 con 0x7f5b1c12d760 2021-05-26T16:45:48.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 >> v1:172.21.15.137:6792/0 conn(0x7f5b1c12cd90 legacy=0x7f5b1c099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 >> v1:172.21.15.3:6789/0 conn(0x7f5b1c096d10 legacy=0x7f5b1c1320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 monclient: found mon.noname-b 2021-05-26T16:45:48.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:45:48.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c09c7c0 con 0x7f5b1c12d760 2021-05-26T16:45:48.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5b18001de0 con 0x7f5b1c12d760 2021-05-26T16:45:48.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b22d7c700 5 monclient: authenticate success, global_id 5528 2021-05-26T16:45:48.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b22d7c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.129 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:45:48.130 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: dump: 2021-05-26T16:45:48.130 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.130 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.130 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.131 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.131 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.131 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.131 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.131 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.132 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.132 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.132 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.132 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.132 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.133 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.133 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.133 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b22d7c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5b180020f0 con 0x7f5b1c12d760 2021-05-26T16:45:48.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 1 -- 172.21.15.3:0/42657240 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5b18004bf0 con 0x7f5b1c12d760 2021-05-26T16:45:48.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b22d7c700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:48.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b22d7c700 4 set_mon_vals no callback set 2021-05-26T16:45:48.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:48.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.106+0000 7f5b20d78700 10 monclient: dump: 2021-05-26T16:45:48.135 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.136 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.136 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.136 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.136 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.136 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.137 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.137 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.137 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.137 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.138 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.138 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.138 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.138 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.139 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.139 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.107+0000 7f5b22d7c700 10 monclient: shutdown 2021-05-26T16:45:48.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.107+0000 7f5b22d7c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:48.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.107+0000 7f5b22d7c700 1 -- 172.21.15.3:0/42657240 >> v1:172.21.15.3:6790/0 conn(0x7f5b1c12d760 legacy=0x7f5b1c1357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.107+0000 7f5b22d7c700 1 -- 172.21.15.3:0/42657240 shutdown_connections 2021-05-26T16:45:48.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.107+0000 7f5b22d7c700 1 -- 172.21.15.3:0/42657240 >> 172.21.15.3:0/42657240 conn(0x7f5b1c09ffa0 msgr2=0x7f5b1c0a0380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:48.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.107+0000 7f5b22d7c700 1 -- 172.21.15.3:0/42657240 shutdown_connections 2021-05-26T16:45:48.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.107+0000 7f5b22d7c700 1 -- 172.21.15.3:0/42657240 wait complete. 2021-05-26T16:45:48.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient: monmap: 2021-05-26T16:45:48.141 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.141 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:48.141 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:48.142 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:48.142 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.142 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.142 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.143 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.143 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.143 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.143 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.143 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.144 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.144 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.144 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.144 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 1 Processor -- start 2021-05-26T16:45:48.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 1 -- start start 2021-05-26T16:45:48.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient: init 2021-05-26T16:45:48.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient: _add_conns ranks=[3,7,8,1,2,5,6,0,4] 2021-05-26T16:45:48.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient(hunting): picked mon.noname-g con 0x7f5b1c096d10 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:48.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient(hunting): picked mon.noname-i con 0x7f5b1c12cd90 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:48.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient(hunting): picked mon.noname-e con 0x7f5b1c12d760 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:48.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c119870 con 0x7f5b1c096d10 2021-05-26T16:45:48.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c119aa0 con 0x7f5b1c12cd90 2021-05-26T16:45:48.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c119d40 con 0x7f5b1c12d760 2021-05-26T16:45:48.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b22d7c700 10 monclient(hunting): authenticate will time out at 1105.739860s 2021-05-26T16:45:48.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.108+0000 7f5b2257b700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f5b1c12d760 0x7f5b1c1446c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54258/0 (socket says 172.21.15.3:54258) 2021-05-26T16:45:48.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.109+0000 7f5b2257b700 1 -- 172.21.15.3:0/87013733 learned_addr learned my addr 172.21.15.3:0/87013733 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b2257b700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6793/0 conn(0x7f5b1c12d760 legacy=0x7f5b1c1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930708293 0 0) 0x7f5b1c119d40 con 0x7f5b1c12d760 2021-05-26T16:45:48.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.148 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): my global_id is 104768 2021-05-26T16:45:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc003270 con 0x7f5b1c12d760 2021-05-26T16:45:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b21d7a700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.137:6790/0 conn(0x7f5b1c096d10 legacy=0x7f5b1c13c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b21579700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.137:6792/0 conn(0x7f5b1c12cd90 legacy=0x7f5b1c140f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 22752547 0 0) 0x7f5afc003270 con 0x7f5b1c12d760 2021-05-26T16:45:48.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b1c119d40 con 0x7f5b1c12d760 2021-05-26T16:45:48.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5b18004bf0 con 0x7f5b1c12d760 2021-05-26T16:45:48.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:48.150 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): dump: 2021-05-26T16:45:48.151 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.151 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.151 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.151 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.152 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.152 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.152 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.152 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.152 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.153 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.153 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.153 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.153 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.153 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.154 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.154 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:48.154 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771330732 0 0) 0x7f5b1c119870 con 0x7f5b1c096d10 2021-05-26T16:45:48.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): my global_id is 5475 2021-05-26T16:45:48.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc003270 con 0x7f5b1c096d10 2021-05-26T16:45:48.155 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48930505 0 0) 0x7f5b1c119aa0 con 0x7f5b1c12cd90 2021-05-26T16:45:48.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient(hunting): my global_id is 104668 2021-05-26T16:45:48.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c119870 con 0x7f5b1c12cd90 2021-05-26T16:45:48.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2851124577 0 0) 0x7f5b1c119d40 con 0x7f5b1c12d760 2021-05-26T16:45:48.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.137:6792/0 conn(0x7f5b1c12cd90 legacy=0x7f5b1c140f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.137:6790/0 conn(0x7f5b1c096d10 legacy=0x7f5b1c13c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 monclient: found mon.e 2021-05-26T16:45:48.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c119fe0 con 0x7f5b1c12d760 2021-05-26T16:45:48.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b22d7c700 5 monclient: authenticate success, global_id 104768 2021-05-26T16:45:48.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b22d7c700 10 monclient: _renew_subs 2021-05-26T16:45:48.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b22d7c700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c117e70 con 0x7f5b1c12d760 2021-05-26T16:45:48.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5b18005100 con 0x7f5b1c12d760 2021-05-26T16:45:48.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5b180055b0 con 0x7f5b1c12d760 2021-05-26T16:45:48.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:48.161 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b09ffb700 10 monclient: dump: 2021-05-26T16:45:48.161 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.161 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.161 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.161 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.162 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.162 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.162 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.162 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.162 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.163 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.163 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.163 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.163 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.163 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.164 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.164 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.164 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b0bfff700 4 set_mon_vals no callback set 2021-05-26T16:45:48.164 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b22d7c700 10 monclient: _renew_subs 2021-05-26T16:45:48.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b22d7c700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.111+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c13c9e0 con 0x7f5b1c12d760 2021-05-26T16:45:48.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.112+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f5b18005810 con 0x7f5b1c12d760 2021-05-26T16:45:48.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.112+0000 7f5b22d7c700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.112+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5b1c06c030 con 0x7f5b1c12dc70 2021-05-26T16:45:48.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.112+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(203..203 src has 1..203) v4 ==== 3941+0+0 (unknown 3764480557 0 0) 0x7f5b1803def0 con 0x7f5b1c12d760 2021-05-26T16:45:48.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.113+0000 7f5b21579700 10 monclient: get_auth_request con 0x7f5afc032b30 auth_method 0 2021-05-26T16:45:48.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b21d7a700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6791/0 conn(0x7f5b1c12dc70 legacy=0x7f5b1c091a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171370921 0 0) 0x7f5b1c06c030 con 0x7f5b1c12dc70 2021-05-26T16:45:48.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient(hunting): my global_id is 114115 2021-05-26T16:45:48.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c119d40 con 0x7f5b1c12dc70 2021-05-26T16:45:48.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 128630526 0 0) 0x7f5b1c119d40 con 0x7f5b1c12dc70 2021-05-26T16:45:48.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b1c06c030 con 0x7f5b1c12dc70 2021-05-26T16:45:48.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5b10001be0 con 0x7f5b1c12dc70 2021-05-26T16:45:48.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:48.169 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient: dump: 2021-05-26T16:45:48.169 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.169 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.169 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.169 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.170 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.170 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.170 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.170 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.170 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.171 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.171 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.171 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.171 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3818432396 0 0) 0x7f5b1c06c030 con 0x7f5b1c12dc70 2021-05-26T16:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b1c0008d0 con 0x7f5b1c12dc70 2021-05-26T16:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f5b10005510 con 0x7f5b1c12dc70 2021-05-26T16:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6791/0 conn(0x7f5b1c12dc70 legacy=0x7f5b1c091a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.115+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6791/0 conn(0x7f5b1c12dc70 legacy=0x7f5b1c091a40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.176 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:48.176 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36311]: starting. 2021-05-26T16:45:48.176 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36311]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36275 2021-05-26T16:45:48.177 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36311]: shutting down. 2021-05-26T16:45:48.177 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:48.177 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:48.177 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:45:48.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:45:48.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.122+0000 7f5b22d7c700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.122+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5b1c092860 con 0x7f5b1c027d00 2021-05-26T16:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b21d7a700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6791/0 conn(0x7f5b1c027d00 legacy=0x7f5b1c092150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79102488 0 0) 0x7f5b1c092860 con 0x7f5b1c027d00 2021-05-26T16:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient(hunting): my global_id is 114124 2021-05-26T16:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c06c030 con 0x7f5b1c027d00 2021-05-26T16:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2108639335 0 0) 0x7f5b1c06c030 con 0x7f5b1c027d00 2021-05-26T16:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b1c092860 con 0x7f5b1c027d00 2021-05-26T16:45:48.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f5b100026f0 con 0x7f5b1c027d00 2021-05-26T16:45:48.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:48.182 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient: dump: 2021-05-26T16:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.185 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.185 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.185 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.185 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.186 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.186 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2099732539 0 0) 0x7f5b1c092860 con 0x7f5b1c027d00 2021-05-26T16:45:48.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 --> v1:172.21.15.3:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5b1c0929f0 con 0x7f5b1c027d00 2021-05-26T16:45:48.186 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 435845130) 0x7f5b10002bc0 con 0x7f5b1c027d00 2021-05-26T16:45:48.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:48.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:48.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6791/0 conn(0x7f5b1c027d00 legacy=0x7f5b1c092150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.187 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.125+0000 7f5b09ffb700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6791/0 conn(0x7f5b1c027d00 legacy=0x7f5b1c092150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.187 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 1, 2021-05-26T16:45:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:48.242 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:48.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.137:6812/30003 conn(0x7f5afc032b30 legacy=0x7f5afc034ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 10 monclient: shutdown 2021-05-26T16:45:48.244 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:48.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 >> v1:172.21.15.3:6793/0 conn(0x7f5b1c12d760 legacy=0x7f5b1c1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b2257b700 1 -- 172.21.15.3:0/87013733 reap_dead start 2021-05-26T16:45:48.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b2257b700 1 -- 172.21.15.3:0/87013733 reap_dead start 2021-05-26T16:45:48.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 shutdown_connections 2021-05-26T16:45:48.245 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 >> 172.21.15.3:0/87013733 conn(0x7f5b1c09ffa0 msgr2=0x7f5b1c09e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:48.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 shutdown_connections 2021-05-26T16:45:48.246 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.126+0000 7f5b22d7c700 1 -- 172.21.15.3:0/87013733 wait complete. 2021-05-26T16:45:48.246 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2021-05-26T16:45:48.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.362+0000 7fbd8f2f6700 10 monclient: get_monmap_and_config 2021-05-26T16:45:48.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.362+0000 7fbd8f2f6700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.362+0000 7fbd8f2f6700 10 monclient: monmap: 2021-05-26T16:45:48.366 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.366 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.366 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:48.363226+0000 2021-05-26T16:45:48.367 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:48.363226+0000 2021-05-26T16:45:48.367 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.367 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.367 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.367 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.368 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.368 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.368 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.368 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.369 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.369 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.369 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.369 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.369 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 1 Processor -- start 2021-05-26T16:45:48.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 1 -- start start 2021-05-26T16:45:48.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient: init 2021-05-26T16:45:48.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient: _add_conns ranks=[1,6,5,4,2,0,7,8,3] 2021-05-26T16:45:48.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient(hunting): picked mon.noname-f con 0x7fbd8812cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:48.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient(hunting): picked mon.noname-d con 0x7fbd88099a30 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:48.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient(hunting): picked mon.noname-h con 0x7fbd88099eb0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:48.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd88046600 con 0x7fbd8812cbd0 2021-05-26T16:45:48.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8809b5e0 con 0x7fbd88099eb0 2021-05-26T16:45:48.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8812d8f0 con 0x7fbd88099a30 2021-05-26T16:45:48.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.363+0000 7fbd8f2f6700 10 monclient(hunting): authenticate will time out at 1105.994951s 2021-05-26T16:45:48.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.364+0000 7fbd8daf3700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fbd88099a30 0x7fbd88131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58590/0 (socket says 172.21.15.3:58590) 2021-05-26T16:45:48.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.364+0000 7fbd8daf3700 1 -- 172.21.15.3:0/4281171235 learned_addr learned my addr 172.21.15.3:0/4281171235 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8daf3700 1 -- 172.21.15.3:0/4281171235 >> v1:172.21.15.3:6792/0 conn(0x7fbd88099a30 legacy=0x7fbd88131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8eaf5700 1 -- 172.21.15.3:0/4281171235 >> v1:172.21.15.137:6791/0 conn(0x7fbd88099eb0 legacy=0x7fbd88135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8e2f4700 1 -- 172.21.15.3:0/4281171235 >> v1:172.21.15.137:6789/0 conn(0x7fbd8812cbd0 legacy=0x7fbd8812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277238261 0 0) 0x7fbd8812d8f0 con 0x7fbd88099a30 2021-05-26T16:45:48.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient(hunting): my global_id is 5541 2021-05-26T16:45:48.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd70003270 con 0x7fbd88099a30 2021-05-26T16:45:48.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750828277 0 0) 0x7fbd8809b5e0 con 0x7fbd88099eb0 2021-05-26T16:45:48.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient(hunting): my global_id is 5666 2021-05-26T16:45:48.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd8812d8f0 con 0x7fbd88099eb0 2021-05-26T16:45:48.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245769567 0 0) 0x7fbd70003270 con 0x7fbd88099a30 2021-05-26T16:45:48.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 >> v1:172.21.15.137:6791/0 conn(0x7fbd88099eb0 legacy=0x7fbd88135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 >> v1:172.21.15.137:6789/0 conn(0x7fbd8812cbd0 legacy=0x7fbd8812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 monclient: found mon.noname-d 2021-05-26T16:45:48.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:45:48.388 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8809c2b0 con 0x7fbd88099a30 2021-05-26T16:45:48.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8f2f6700 5 monclient: authenticate success, global_id 5541 2021-05-26T16:45:48.389 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd78001a60 con 0x7fbd88099a30 2021-05-26T16:45:48.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8f2f6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:48.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: dump: 2021-05-26T16:45:48.390 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.391 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.391 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.391 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.391 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.391 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.392 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.392 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.392 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.392 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.392 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.394 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8f2f6700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbd780045f0 con 0x7fbd88099a30 2021-05-26T16:45:48.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8f2f6700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 1 -- 172.21.15.3:0/4281171235 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd78001d80 con 0x7fbd88099a30 2021-05-26T16:45:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8f2f6700 4 set_mon_vals no callback set 2021-05-26T16:45:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.366+0000 7fbd8d2f2700 10 monclient: dump: 2021-05-26T16:45:48.396 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.396 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.396 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.396 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.398 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.398 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.398 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.398 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.399 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.399 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 10 monclient: shutdown 2021-05-26T16:45:48.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:48.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/4281171235 >> v1:172.21.15.3:6792/0 conn(0x7fbd88099a30 legacy=0x7fbd88131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/4281171235 shutdown_connections 2021-05-26T16:45:48.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/4281171235 >> 172.21.15.3:0/4281171235 conn(0x7fbd880a00c0 msgr2=0x7fbd880a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:48.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/4281171235 shutdown_connections 2021-05-26T16:45:48.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/4281171235 wait complete. 2021-05-26T16:45:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.367+0000 7fbd8f2f6700 10 monclient: monmap: 2021-05-26T16:45:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.403 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.403 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.403 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.405 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.405 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 1 Processor -- start 2021-05-26T16:45:48.405 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 1 -- start start 2021-05-26T16:45:48.405 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient: init 2021-05-26T16:45:48.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient: _add_conns ranks=[8,5,0,3,4,2,1,6,7] 2021-05-26T16:45:48.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient(hunting): picked mon.noname-e con 0x7fbd88099a30 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:48.406 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient(hunting): picked mon.noname-h con 0x7fbd88099eb0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:48.407 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient(hunting): picked mon.noname-a con 0x7fbd8812cbd0 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:48.407 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd88116890 con 0x7fbd8812cbd0 2021-05-26T16:45:48.407 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd88116b30 con 0x7fbd88099eb0 2021-05-26T16:45:48.407 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd88096970 con 0x7fbd88099a30 2021-05-26T16:45:48.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8f2f6700 10 monclient(hunting): authenticate will time out at 1105.999620s 2021-05-26T16:45:48.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8e2f4700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fbd88099a30 0x7fbd8813c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54274/0 (socket says 172.21.15.3:54274) 2021-05-26T16:45:48.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.368+0000 7fbd8e2f4700 1 -- 172.21.15.3:0/702268917 learned_addr learned my addr 172.21.15.3:0/702268917 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.370+0000 7fbd8eaf5700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6789/0 conn(0x7fbd8812cbd0 legacy=0x7fbd881446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.370+0000 7fbd8e2f4700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6793/0 conn(0x7fbd88099a30 legacy=0x7fbd8813c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.370+0000 7fbd8daf3700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.137:6791/0 conn(0x7fbd88099eb0 legacy=0x7fbd88140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458872156 0 0) 0x7fbd88116890 con 0x7fbd8812cbd0 2021-05-26T16:45:48.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): my global_id is 104850 2021-05-26T16:45:48.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd68003270 con 0x7fbd8812cbd0 2021-05-26T16:45:48.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537237195 0 0) 0x7fbd88096970 con 0x7fbd88099a30 2021-05-26T16:45:48.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): my global_id is 104777 2021-05-26T16:45:48.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd88116890 con 0x7fbd88099a30 2021-05-26T16:45:48.411 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158029321 0 0) 0x7fbd88116b30 con 0x7fbd88099eb0 2021-05-26T16:45:48.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): my global_id is 5675 2021-05-26T16:45:48.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd88096970 con 0x7fbd88099eb0 2021-05-26T16:45:48.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3217119294 0 0) 0x7fbd88116890 con 0x7fbd88099a30 2021-05-26T16:45:48.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd88116b30 con 0x7fbd88099a30 2021-05-26T16:45:48.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd7c001cc0 con 0x7fbd88099a30 2021-05-26T16:45:48.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.414 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:48.414 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): dump: 2021-05-26T16:45:48.414 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.414 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.414 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.415 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.415 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.415 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.415 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.416 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.416 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.416 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.416 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.417 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.417 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.417 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.417 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.417 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1007537119 0 0) 0x7fbd88096970 con 0x7fbd88099eb0 2021-05-26T16:45:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd88116890 con 0x7fbd88099eb0 2021-05-26T16:45:48.418 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd78001a20 con 0x7fbd88099eb0 2021-05-26T16:45:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2021-05-26T16:45:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): dump: 2021-05-26T16:45:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.419 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.423 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3043836339 0 0) 0x7fbd68003270 con 0x7fbd8812cbd0 2021-05-26T16:45:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd88096970 con 0x7fbd8812cbd0 2021-05-26T16:45:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd84002100 con 0x7fbd8812cbd0 2021-05-26T16:45:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient(hunting): dump: 2021-05-26T16:45:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.426 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.426 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.426 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.426 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.428 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1825134683 0 0) 0x7fbd88116b30 con 0x7fbd88099a30 2021-05-26T16:45:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.137:6791/0 conn(0x7fbd88099eb0 legacy=0x7fbd88140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6789/0 conn(0x7fbd8812cbd0 legacy=0x7fbd881446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 monclient: found mon.e 2021-05-26T16:45:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88095360 con 0x7fbd88099a30 2021-05-26T16:45:48.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.430 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8f2f6700 5 monclient: authenticate success, global_id 104777 2021-05-26T16:45:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8f2f6700 10 monclient: _renew_subs 2021-05-26T16:45:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8f2f6700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd88096030 con 0x7fbd88099a30 2021-05-26T16:45:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8f2f6700 10 monclient: _renew_subs 2021-05-26T16:45:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8f2f6700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8813cae0 con 0x7fbd88099a30 2021-05-26T16:45:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbd7c002330 con 0x7fbd88099a30 2021-05-26T16:45:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd7c0027e0 con 0x7fbd88099a30 2021-05-26T16:45:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd8caf1700 4 set_mon_vals no callback set 2021-05-26T16:45:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.371+0000 7fbd767fc700 10 monclient: dump: 2021-05-26T16:45:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.437 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.372+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fbd7c002970 con 0x7fbd88099a30 2021-05-26T16:45:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.372+0000 7fbd8f2f6700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.372+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbd6c0065a0 con 0x7fbd6c002840 2021-05-26T16:45:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.372+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(204..204 src has 1..204) v4 ==== 3549+0+0 (unknown 384543922 0 0) 0x7fbd7c03d730 con 0x7fbd88099a30 2021-05-26T16:45:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.373+0000 7fbd8eaf5700 10 monclient: get_auth_request con 0x7fbd680332f0 auth_method 0 2021-05-26T16:45:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.374+0000 7fbd8daf3700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6792/0 conn(0x7fbd6c002840 legacy=0x7fbd6c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640951937 0 0) 0x7fbd6c0065a0 con 0x7fbd6c002840 2021-05-26T16:45:48.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient(hunting): my global_id is 5550 2021-05-26T16:45:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd88116b30 con 0x7fbd6c002840 2021-05-26T16:45:48.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1363682834 0 0) 0x7fbd88116b30 con 0x7fbd6c002840 2021-05-26T16:45:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd6c0065a0 con 0x7fbd6c002840 2021-05-26T16:45:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd78001d80 con 0x7fbd6c002840 2021-05-26T16:45:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:48.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient: dump: 2021-05-26T16:45:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.441 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.442 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.444 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1079332189 0 0) 0x7fbd6c0065a0 con 0x7fbd6c002840 2021-05-26T16:45:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd6c009e40 con 0x7fbd6c002840 2021-05-26T16:45:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fbd78005620 con 0x7fbd6c002840 2021-05-26T16:45:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6792/0 conn(0x7fbd6c002840 legacy=0x7fbd6c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.445 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.375+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6792/0 conn(0x7fbd6c002840 legacy=0x7fbd6c004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.382+0000 7fbd8f2f6700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.382+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbd6c0074f0 con 0x7fbd6c006890 2021-05-26T16:45:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd8daf3700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6792/0 conn(0x7fbd6c006890 legacy=0x7fbd6c006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599727465 0 0) 0x7fbd6c0074f0 con 0x7fbd6c006890 2021-05-26T16:45:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 10 monclient(hunting): my global_id is 5559 2021-05-26T16:45:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd6c0065a0 con 0x7fbd6c006890 2021-05-26T16:45:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1477162956 0 0) 0x7fbd6c0065a0 con 0x7fbd6c006890 2021-05-26T16:45:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd6c0074f0 con 0x7fbd6c006890 2021-05-26T16:45:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbd78005d60 con 0x7fbd6c006890 2021-05-26T16:45:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.384+0000 7fbd767fc700 10 monclient: dump: 2021-05-26T16:45:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.452 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.453 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.453 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.453 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.453 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.453 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.454 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4135628298 0 0) 0x7fbd6c0074f0 con 0x7fbd6c006890 2021-05-26T16:45:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 --> v1:172.21.15.3:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbd6c008770 con 0x7fbd6c006890 2021-05-26T16:45:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 779287578) 0x7fbd780080f0 con 0x7fbd6c006890 2021-05-26T16:45:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd767fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd767fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6792/0 conn(0x7fbd6c006890 legacy=0x7fbd6c006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd767fc700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6792/0 conn(0x7fbd6c006890 legacy=0x7fbd6c006d20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.456 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:45:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:48.511 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:48.512 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.137:6812/30003 conn(0x7fbd680332f0 legacy=0x7fbd680357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 10 monclient: shutdown 2021-05-26T16:45:48.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:48.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 >> v1:172.21.15.3:6793/0 conn(0x7fbd88099a30 legacy=0x7fbd8813c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.513 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8eaf5700 1 -- 172.21.15.3:0/702268917 reap_dead start 2021-05-26T16:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8eaf5700 1 -- 172.21.15.3:0/702268917 reap_dead start 2021-05-26T16:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 shutdown_connections 2021-05-26T16:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 >> 172.21.15.3:0/702268917 conn(0x7fbd880a00c0 msgr2=0x7fbd8812b250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 shutdown_connections 2021-05-26T16:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.385+0000 7fbd8f2f6700 1 -- 172.21.15.3:0/702268917 wait complete. 2021-05-26T16:45:48.516 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2021-05-26T16:45:48.632 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.630+0000 7f7cd5e48700 10 monclient: get_monmap_and_config 2021-05-26T16:45:48.633 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.630+0000 7f7cd5e48700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.633 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.630+0000 7f7cd5e48700 10 monclient: monmap: 2021-05-26T16:45:48.633 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.633 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.633 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:48.630943+0000 2021-05-26T16:45:48.634 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:48.630943+0000 2021-05-26T16:45:48.634 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.634 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.634 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.635 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.635 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.635 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.635 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.635 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.636 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.636 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.636 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.636 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.647 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 1 Processor -- start 2021-05-26T16:45:48.647 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 1 -- start start 2021-05-26T16:45:48.647 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient: init 2021-05-26T16:45:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient: _add_conns ranks=[6,8,5,2,7,0,4,1,3] 2021-05-26T16:45:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient(hunting): picked mon.noname-d con 0x7f7cd0096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient(hunting): picked mon.noname-e con 0x7f7cd0099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient(hunting): picked mon.noname-h con 0x7f7cd009a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0059750 con 0x7f7cd009a260 2021-05-26T16:45:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0064620 con 0x7f7cd0096ca0 2021-05-26T16:45:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0064e50 con 0x7f7cd0099db0 2021-05-26T16:45:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cd5e48700 10 monclient(hunting): authenticate will time out at 1106.262678s 2021-05-26T16:45:48.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cceffd700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f7cd0099db0 0x7f7cd0132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54288/0 (socket says 172.21.15.3:54288) 2021-05-26T16:45:48.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7cceffd700 1 -- 172.21.15.3:0/804036652 learned_addr learned my addr 172.21.15.3:0/804036652 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.650 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.631+0000 7f7ccf7fe700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f7cd0096ca0 0x7f7cd0063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58606/0 (socket says 172.21.15.3:58606) 2021-05-26T16:45:48.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.633+0000 7f7cceffd700 1 -- 172.21.15.3:0/804036652 >> v1:172.21.15.3:6793/0 conn(0x7f7cd0099db0 legacy=0x7f7cd0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.633+0000 7f7ccf7fe700 1 -- 172.21.15.3:0/804036652 >> v1:172.21.15.3:6792/0 conn(0x7f7cd0096ca0 legacy=0x7f7cd0063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984369569 0 0) 0x7f7cd0064e50 con 0x7f7cd0099db0 2021-05-26T16:45:48.651 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): my global_id is 104786 2021-05-26T16:45:48.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7ccffff700 1 -- 172.21.15.3:0/804036652 >> v1:172.21.15.137:6791/0 conn(0x7f7cd009a260 legacy=0x7f7cd01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb8003270 con 0x7f7cd0099db0 2021-05-26T16:45:48.652 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149090185 0 0) 0x7f7cd0064620 con 0x7f7cd0096ca0 2021-05-26T16:45:48.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): my global_id is 5568 2021-05-26T16:45:48.653 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd0064e50 con 0x7f7cd0096ca0 2021-05-26T16:45:48.654 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282037282 0 0) 0x7f7cd0059750 con 0x7f7cd009a260 2021-05-26T16:45:48.654 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.654 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.654 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient(hunting): my global_id is 5684 2021-05-26T16:45:48.655 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd0064620 con 0x7f7cd009a260 2021-05-26T16:45:48.655 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 157717204 0 0) 0x7f7cb8003270 con 0x7f7cd0099db0 2021-05-26T16:45:48.655 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 >> v1:172.21.15.3:6792/0 conn(0x7f7cd0096ca0 legacy=0x7f7cd0063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.655 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 >> v1:172.21.15.137:6791/0 conn(0x7f7cd009a260 legacy=0x7f7cd01357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.655 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.656 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 monclient: found mon.noname-e 2021-05-26T16:45:48.656 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.656 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.656 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd009c390 con 0x7f7cd0099db0 2021-05-26T16:45:48.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cd5e48700 5 monclient: authenticate success, global_id 104786 2021-05-26T16:45:48.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cb4001a60 con 0x7f7cd0099db0 2021-05-26T16:45:48.657 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cd5e48700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:48.658 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: dump: 2021-05-26T16:45:48.658 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.659 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.659 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.659 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.659 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.660 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.660 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.660 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.660 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.660 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.661 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.661 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.661 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.661 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.662 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.662 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cd5e48700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7cb4001d70 con 0x7f7cd0099db0 2021-05-26T16:45:48.662 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cd5e48700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:48.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 1 -- 172.21.15.3:0/804036652 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cb4004930 con 0x7f7cd0099db0 2021-05-26T16:45:48.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.663 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cd5e48700 4 set_mon_vals no callback set 2021-05-26T16:45:48.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:48.664 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.634+0000 7f7cce7fc700 10 monclient: dump: 2021-05-26T16:45:48.664 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.664 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.664 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.665 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.665 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.665 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.665 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.666 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.666 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.666 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.666 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.666 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.667 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.667 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.667 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.667 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 10 monclient: shutdown 2021-05-26T16:45:48.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:48.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 1 -- 172.21.15.3:0/804036652 >> v1:172.21.15.3:6793/0 conn(0x7f7cd0099db0 legacy=0x7f7cd0132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 1 -- 172.21.15.3:0/804036652 shutdown_connections 2021-05-26T16:45:48.668 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 1 -- 172.21.15.3:0/804036652 >> 172.21.15.3:0/804036652 conn(0x7f7cd009cc00 msgr2=0x7f7cd009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:48.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 1 -- 172.21.15.3:0/804036652 shutdown_connections 2021-05-26T16:45:48.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 1 -- 172.21.15.3:0/804036652 wait complete. 2021-05-26T16:45:48.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.669 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.635+0000 7f7cd5e48700 10 monclient: monmap: 2021-05-26T16:45:48.669 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.670 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:48.670 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:48.670 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:48.670 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.671 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.671 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.671 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.671 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.671 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.672 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.672 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.672 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.672 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.672 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.673 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 1 Processor -- start 2021-05-26T16:45:48.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 1 -- start start 2021-05-26T16:45:48.673 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient: init 2021-05-26T16:45:48.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient: _add_conns ranks=[8,6,7,4,1,5,2,3,0] 2021-05-26T16:45:48.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient(hunting): picked mon.noname-e con 0x7f7cd0096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:48.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient(hunting): picked mon.noname-d con 0x7f7cd0099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:48.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient(hunting): picked mon.noname-i con 0x7f7cd009a260 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:48.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0116d90 con 0x7f7cd0099db0 2021-05-26T16:45:48.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0117030 con 0x7f7cd009a260 2021-05-26T16:45:48.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd012f340 con 0x7f7cd0096ca0 2021-05-26T16:45:48.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cd5e48700 10 monclient(hunting): authenticate will time out at 1106.267674s 2021-05-26T16:45:48.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7ccf7fe700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f7cd0096ca0 0x7f7cd013c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54294/0 (socket says 172.21.15.3:54294) 2021-05-26T16:45:48.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7cceffd700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f7cd0099db0 0x7f7cd01410e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58612/0 (socket says 172.21.15.3:58612) 2021-05-26T16:45:48.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.636+0000 7f7ccf7fe700 1 -- 172.21.15.3:0/3862539714 learned_addr learned my addr 172.21.15.3:0/3862539714 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.638+0000 7f7cceffd700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6792/0 conn(0x7f7cd0099db0 legacy=0x7f7cd01410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.638+0000 7f7ccf7fe700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cd0096ca0 legacy=0x7f7cd013c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393853074 0 0) 0x7f7cd0116d90 con 0x7f7cd0099db0 2021-05-26T16:45:48.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.677 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): my global_id is 5577 2021-05-26T16:45:48.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7ccffff700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.137:6792/0 conn(0x7f7cd009a260 legacy=0x7f7cd0144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cac003270 con 0x7f7cd0099db0 2021-05-26T16:45:48.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392193668 0 0) 0x7f7cd012f340 con 0x7f7cd0096ca0 2021-05-26T16:45:48.678 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): my global_id is 104795 2021-05-26T16:45:48.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd0116d90 con 0x7f7cd0096ca0 2021-05-26T16:45:48.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937068693 0 0) 0x7f7cd0117030 con 0x7f7cd009a260 2021-05-26T16:45:48.679 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): my global_id is 104695 2021-05-26T16:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd012f340 con 0x7f7cd009a260 2021-05-26T16:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 96246757 0 0) 0x7f7cd0116d90 con 0x7f7cd0096ca0 2021-05-26T16:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cd0117030 con 0x7f7cd0096ca0 2021-05-26T16:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1484159082 0 0) 0x7f7cac003270 con 0x7f7cd0099db0 2021-05-26T16:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cd0116d90 con 0x7f7cd0099db0 2021-05-26T16:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cbc0018a0 con 0x7f7cd0096ca0 2021-05-26T16:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:48.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): dump: 2021-05-26T16:45:48.682 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.682 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.683 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.683 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.683 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.683 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.684 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.684 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.684 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.684 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.684 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.685 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.685 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cb4004870 con 0x7f7cd0099db0 2021-05-26T16:45:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): dump: 2021-05-26T16:45:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.687 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.688 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.688 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.688 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.688 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.688 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.689 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.689 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.689 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.689 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.689 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.690 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.690 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.690 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2993543430 0 0) 0x7f7cd012f340 con 0x7f7cd009a260 2021-05-26T16:45:48.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cac003270 con 0x7f7cd009a260 2021-05-26T16:45:48.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cc4002010 con 0x7f7cd009a260 2021-05-26T16:45:48.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:48.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient(hunting): dump: 2021-05-26T16:45:48.692 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.692 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.692 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.692 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.693 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.693 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.693 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.693 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.693 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.695 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.695 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.695 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 639100992 0 0) 0x7f7cd0117030 con 0x7f7cd0096ca0 2021-05-26T16:45:48.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.137:6792/0 conn(0x7f7cd009a260 legacy=0x7f7cd0144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6792/0 conn(0x7f7cd0099db0 legacy=0x7f7cd01410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 monclient: found mon.e 2021-05-26T16:45:48.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0130010 con 0x7f7cd0096ca0 2021-05-26T16:45:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cd5e48700 5 monclient: authenticate success, global_id 104795 2021-05-26T16:45:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cd5e48700 10 monclient: _renew_subs 2021-05-26T16:45:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cd5e48700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd013cb60 con 0x7f7cd0096ca0 2021-05-26T16:45:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cd5e48700 10 monclient: _renew_subs 2021-05-26T16:45:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cd5e48700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd0130fb0 con 0x7f7cd0096ca0 2021-05-26T16:45:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7cbc001c40 con 0x7f7cd0096ca0 2021-05-26T16:45:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cbc004e60 con 0x7f7cd0096ca0 2021-05-26T16:45:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7ccdffb700 4 set_mon_vals no callback set 2021-05-26T16:45:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.639+0000 7f7cc37fe700 10 monclient: dump: 2021-05-26T16:45:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.701 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.704 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.640+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f7cbc00e450 con 0x7f7cd0096ca0 2021-05-26T16:45:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.640+0000 7f7cd5e48700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.640+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f7cb00065a0 con 0x7f7cb0002840 2021-05-26T16:45:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.640+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(204..204 src has 1..204) v4 ==== 3549+0+0 (unknown 384543922 0 0) 0x7f7cbc03d860 con 0x7f7cd0096ca0 2021-05-26T16:45:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.640+0000 7f7ccffff700 10 monclient: get_auth_request con 0x7f7cac033400 auth_method 0 2021-05-26T16:45:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.642+0000 7f7cceffd700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cb0002840 legacy=0x7f7cb0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.642+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342915301 0 0) 0x7f7cb00065a0 con 0x7f7cb0002840 2021-05-26T16:45:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.642+0000 7f7cc37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.642+0000 7f7cc37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.642+0000 7f7cc37fe700 10 monclient(hunting): my global_id is 104804 2021-05-26T16:45:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.642+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd0117030 con 0x7f7cb0002840 2021-05-26T16:45:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1008260127 0 0) 0x7f7cd0117030 con 0x7f7cb0002840 2021-05-26T16:45:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cb00065a0 con 0x7f7cb0002840 2021-05-26T16:45:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cb40049d0 con 0x7f7cb0002840 2021-05-26T16:45:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:48.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 10 monclient: dump: 2021-05-26T16:45:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.708 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.709 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.711 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.711 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3246695060 0 0) 0x7f7cb00065a0 con 0x7f7cb0002840 2021-05-26T16:45:48.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7cb0009e40 con 0x7f7cb0002840 2021-05-26T16:45:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f7cb40072a0 con 0x7f7cb0002840 2021-05-26T16:45:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:48.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cb0002840 legacy=0x7f7cb0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.643+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cb0002840 legacy=0x7f7cb0004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.650+0000 7f7cd5e48700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.650+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f7cb0007510 con 0x7f7cb00068b0 2021-05-26T16:45:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cceffd700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cb00068b0 legacy=0x7f7cb0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938403701 0 0) 0x7f7cb0007510 con 0x7f7cb00068b0 2021-05-26T16:45:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 10 monclient(hunting): my global_id is 104813 2021-05-26T16:45:48.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb00065a0 con 0x7f7cb00068b0 2021-05-26T16:45:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1057923793 0 0) 0x7f7cb00065a0 con 0x7f7cb00068b0 2021-05-26T16:45:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cb0007510 con 0x7f7cb00068b0 2021-05-26T16:45:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f7cb4005a80 con 0x7f7cb00068b0 2021-05-26T16:45:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 10 monclient: dump: 2021-05-26T16:45:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.718 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.719 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.720 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.721 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1754241493 0 0) 0x7f7cb0007510 con 0x7f7cb00068b0 2021-05-26T16:45:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.652+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 --> v1:172.21.15.3:6793/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7cb0008770 con 0x7f7cb00068b0 2021-05-26T16:45:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 184965122) 0x7f7cb400a250 con 0x7f7cb00068b0 2021-05-26T16:45:48.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cc37fe700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cc37fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cb00068b0 legacy=0x7f7cb0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cc37fe700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cb00068b0 legacy=0x7f7cb0006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.723 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:45:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:45:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:48.781 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:48.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.137:6812/30003 conn(0x7f7cac033400 legacy=0x7f7cac0358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 10 monclient: shutdown 2021-05-26T16:45:48.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:48.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 >> v1:172.21.15.3:6793/0 conn(0x7f7cd0096ca0 legacy=0x7f7cd013c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7ccffff700 1 -- 172.21.15.3:0/3862539714 reap_dead start 2021-05-26T16:45:48.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7ccffff700 1 -- 172.21.15.3:0/3862539714 reap_dead start 2021-05-26T16:45:48.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 shutdown_connections 2021-05-26T16:45:48.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 >> 172.21.15.3:0/3862539714 conn(0x7f7cd009cc00 msgr2=0x7f7cd009eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:48.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 shutdown_connections 2021-05-26T16:45:48.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.653+0000 7f7cd5e48700 1 -- 172.21.15.3:0/3862539714 wait complete. 2021-05-26T16:45:48.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2021-05-26T16:45:48.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.899+0000 7fe3f5589700 10 monclient: get_monmap_and_config 2021-05-26T16:45:48.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.899+0000 7fe3f5589700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.902 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.899+0000 7fe3f5589700 10 monclient: monmap: 2021-05-26T16:45:48.903 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.903 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.903 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:48.900551+0000 2021-05-26T16:45:48.904 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:48.900551+0000 2021-05-26T16:45:48.904 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.904 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.904 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.904 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.905 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.905 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.905 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.905 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.906 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.906 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.906 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.906 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.917 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 1 Processor -- start 2021-05-26T16:45:48.918 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 1 -- start start 2021-05-26T16:45:48.918 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 10 monclient: init 2021-05-26T16:45:48.918 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.918 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 10 monclient: _add_conns ranks=[3,2,5,7,6,4,0,1,8] 2021-05-26T16:45:48.919 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 10 monclient(hunting): picked mon.noname-g con 0x7fe3f0096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:48.919 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 10 monclient(hunting): picked mon.noname-b con 0x7fe3f0099cb0 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:48.919 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 10 monclient(hunting): picked mon.noname-h con 0x7fe3f009a130 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:48.919 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.900+0000 7fe3f5589700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f0059750 con 0x7fe3f0099cb0 2021-05-26T16:45:48.920 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.901+0000 7fe3f5589700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f0064750 con 0x7fe3f0096ca0 2021-05-26T16:45:48.920 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.901+0000 7fe3f5589700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f009c7c0 con 0x7fe3f009a130 2021-05-26T16:45:48.920 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.901+0000 7fe3f5589700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.920 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.901+0000 7fe3f5589700 10 monclient(hunting): authenticate will time out at 1106.532026s 2021-05-26T16:45:48.920 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.901+0000 7fe3ee7fc700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fe3f0099cb0 0x7fe3f0132030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55266/0 (socket says 172.21.15.3:55266) 2021-05-26T16:45:48.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.901+0000 7fe3ee7fc700 1 -- 172.21.15.3:0/3009191266 learned_addr learned my addr 172.21.15.3:0/3009191266 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3ee7fc700 1 -- 172.21.15.3:0/3009191266 >> v1:172.21.15.3:6790/0 conn(0x7fe3f0099cb0 legacy=0x7fe3f0132030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3ef7fe700 1 -- 172.21.15.3:0/3009191266 >> v1:172.21.15.137:6791/0 conn(0x7fe3f009a130 legacy=0x7fe3f0135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3eeffd700 1 -- 172.21.15.3:0/3009191266 >> v1:172.21.15.137:6790/0 conn(0x7fe3f0096ca0 legacy=0x7fe3f0064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.921 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497488728 0 0) 0x7fe3f0059750 con 0x7fe3f0099cb0 2021-05-26T16:45:48.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): my global_id is 5546 2021-05-26T16:45:48.922 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3dc003270 con 0x7fe3f0099cb0 2021-05-26T16:45:48.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072387640 0 0) 0x7fe3f009c7c0 con 0x7fe3f009a130 2021-05-26T16:45:48.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): my global_id is 5693 2021-05-26T16:45:48.923 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f0059750 con 0x7fe3f009a130 2021-05-26T16:45:48.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924523551 0 0) 0x7fe3f0064750 con 0x7fe3f0096ca0 2021-05-26T16:45:48.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient(hunting): my global_id is 5484 2021-05-26T16:45:48.924 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f009c7c0 con 0x7fe3f0096ca0 2021-05-26T16:45:48.925 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004305108 0 0) 0x7fe3dc003270 con 0x7fe3f0099cb0 2021-05-26T16:45:48.925 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 >> v1:172.21.15.137:6791/0 conn(0x7fe3f009a130 legacy=0x7fe3f0135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.925 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 >> v1:172.21.15.137:6790/0 conn(0x7fe3f0096ca0 legacy=0x7fe3f0064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.925 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.926 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 monclient: found mon.noname-b 2021-05-26T16:45:48.926 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.926 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:45:48.926 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0097550 con 0x7fe3f0099cb0 2021-05-26T16:45:48.926 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3f5589700 5 monclient: authenticate success, global_id 5546 2021-05-26T16:45:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe3e4001a60 con 0x7fe3f0099cb0 2021-05-26T16:45:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3f5589700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:45:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: dump: 2021-05-26T16:45:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.930 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.930 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.930 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.930 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.930 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.931 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.931 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.931 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.931 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.932 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3f5589700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:48.932 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe3e4001d70 con 0x7fe3f0099cb0 2021-05-26T16:45:48.932 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.932 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 1 -- 172.21.15.3:0/3009191266 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe3e4004930 con 0x7fe3f0099cb0 2021-05-26T16:45:48.932 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3f5589700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:48.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3f5589700 4 set_mon_vals no callback set 2021-05-26T16:45:48.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:48.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.903+0000 7fe3edffb700 10 monclient: dump: 2021-05-26T16:45:48.933 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.934 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.934 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.934 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.934 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.935 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.935 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.935 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.935 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.935 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.936 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.936 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.936 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.936 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.937 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.937 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.937 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.904+0000 7fe3f5589700 10 monclient: shutdown 2021-05-26T16:45:48.937 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.904+0000 7fe3f5589700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:48.937 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.904+0000 7fe3f5589700 1 -- 172.21.15.3:0/3009191266 >> v1:172.21.15.3:6790/0 conn(0x7fe3f0099cb0 legacy=0x7fe3f0132030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.938 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.904+0000 7fe3f5589700 1 -- 172.21.15.3:0/3009191266 shutdown_connections 2021-05-26T16:45:48.938 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.904+0000 7fe3f5589700 1 -- 172.21.15.3:0/3009191266 >> 172.21.15.3:0/3009191266 conn(0x7fe3f009cb30 msgr2=0x7fe3f009cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:48.938 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.904+0000 7fe3f5589700 1 -- 172.21.15.3:0/3009191266 shutdown_connections 2021-05-26T16:45:48.938 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.904+0000 7fe3f5589700 1 -- 172.21.15.3:0/3009191266 wait complete. 2021-05-26T16:45:48.939 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient: build_initial_monmap 2021-05-26T16:45:48.939 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient: monmap: 2021-05-26T16:45:48.939 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:48.939 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:48.940 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:48.940 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:48.940 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:48.940 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.941 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:48.941 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:48.941 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:48.941 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:48.941 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:48.942 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:48.942 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:48.942 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:48.942 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:48.943 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 1 Processor -- start 2021-05-26T16:45:48.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 1 -- start start 2021-05-26T16:45:48.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient: init 2021-05-26T16:45:48.943 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient: _add_conns ranks=[6,3,8,5,4,7,2,0,1] 2021-05-26T16:45:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient(hunting): picked mon.noname-d con 0x7fe3f0096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient(hunting): picked mon.noname-g con 0x7fe3f0099cb0 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient(hunting): picked mon.noname-e con 0x7fe3f009a130 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f0118170 con 0x7fe3f0099cb0 2021-05-26T16:45:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f0119f60 con 0x7fe3f0096ca0 2021-05-26T16:45:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f011a200 con 0x7fe3f009a130 2021-05-26T16:45:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:48.945 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.905+0000 7fe3f5589700 10 monclient(hunting): authenticate will time out at 1106.536983s 2021-05-26T16:45:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.906+0000 7fe3eeffd700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fe3f0096ca0 0x7fe3f013c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58628/0 (socket says 172.21.15.3:58628) 2021-05-26T16:45:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.906+0000 7fe3eeffd700 1 -- 172.21.15.3:0/3824134496 learned_addr learned my addr 172.21.15.3:0/3824134496 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3eeffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.3:6792/0 conn(0x7fe3f0096ca0 legacy=0x7fe3f013c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.946 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3ef7fe700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.3:6793/0 conn(0x7fe3f009a130 legacy=0x7fe3f01449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893529192 0 0) 0x7fe3f011a200 con 0x7fe3f009a130 2021-05-26T16:45:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): my global_id is 104822 2021-05-26T16:45:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d0003270 con 0x7fe3f009a130 2021-05-26T16:45:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813325921 0 0) 0x7fe3f0119f60 con 0x7fe3f0096ca0 2021-05-26T16:45:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): my global_id is 5586 2021-05-26T16:45:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f011a200 con 0x7fe3f0096ca0 2021-05-26T16:45:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3ee7fc700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6790/0 conn(0x7fe3f0099cb0 legacy=0x7fe3f0141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4144877644 0 0) 0x7fe3d0003270 con 0x7fe3f009a130 2021-05-26T16:45:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3f0119f60 con 0x7fe3f009a130 2021-05-26T16:45:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe3e00020c0 con 0x7fe3f009a130 2021-05-26T16:45:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): dump: 2021-05-26T16:45:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.953 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.953 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.953 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:48.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3035244789 0 0) 0x7fe3f011a200 con 0x7fe3f0096ca0 2021-05-26T16:45:48.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3d0003270 con 0x7fe3f0096ca0 2021-05-26T16:45:48.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe3d8001f00 con 0x7fe3f0096ca0 2021-05-26T16:45:48.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient(hunting): dump: 2021-05-26T16:45:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.958 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.958 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.958 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1729841953 0 0) 0x7fe3f0119f60 con 0x7fe3f009a130 2021-05-26T16:45:48.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.3:6792/0 conn(0x7fe3f0096ca0 legacy=0x7fe3f013c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6790/0 conn(0x7fe3f0099cb0 legacy=0x7fe3f0141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 monclient: found mon.e 2021-05-26T16:45:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f009bf60 con 0x7fe3f009a130 2021-05-26T16:45:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 10 monclient: _finish_auth 0 2021-05-26T16:45:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.908+0000 7fe3d6ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 5 monclient: authenticate success, global_id 104822 2021-05-26T16:45:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 10 monclient: _renew_subs 2021-05-26T16:45:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f01196c0 con 0x7fe3f009a130 2021-05-26T16:45:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 10 monclient: _renew_subs 2021-05-26T16:45:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f013cbe0 con 0x7fe3f009a130 2021-05-26T16:45:48.962 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe3e0002750 con 0x7fe3f009a130 2021-05-26T16:45:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3d6ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe3e0002c00 con 0x7fe3f009a130 2021-05-26T16:45:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3d6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3ed7fa700 4 set_mon_vals no callback set 2021-05-26T16:45:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3d6ffd700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3d6ffd700 10 monclient: dump: 2021-05-26T16:45:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.964 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.965 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.966 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.966 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.966 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.966 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.966 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.967 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.967 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.967 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.967 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fe3e0002d90 con 0x7fe3f009a130 2021-05-26T16:45:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.909+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe3c80065a0 con 0x7fe3c8002840 2021-05-26T16:45:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.910+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(204..204 src has 1..204) v4 ==== 3549+0+0 (unknown 384543922 0 0) 0x7fe3e003dbe0 con 0x7fe3f009a130 2021-05-26T16:45:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.910+0000 7fe3ee7fc700 10 monclient: get_auth_request con 0x7fe3d0032f40 auth_method 0 2021-05-26T16:45:48.968 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3eeffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6789/0 conn(0x7fe3c8002840 legacy=0x7fe3c8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060980731 0 0) 0x7fe3c80065a0 con 0x7fe3c8002840 2021-05-26T16:45:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 10 monclient(hunting): my global_id is 5581 2021-05-26T16:45:48.969 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f0119f60 con 0x7fe3c8002840 2021-05-26T16:45:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1369921433 0 0) 0x7fe3f0119f60 con 0x7fe3c8002840 2021-05-26T16:45:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3c80065a0 con 0x7fe3c8002840 2021-05-26T16:45:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe3d8002680 con 0x7fe3c8002840 2021-05-26T16:45:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.912+0000 7fe3d6ffd700 10 monclient: dump: 2021-05-26T16:45:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.972 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.974 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.913+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2097507030 0 0) 0x7fe3c80065a0 con 0x7fe3c8002840 2021-05-26T16:45:48.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.913+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3c8009e40 con 0x7fe3c8002840 2021-05-26T16:45:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.913+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe3d8002b00 con 0x7fe3c8002840 2021-05-26T16:45:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.913+0000 7fe3d6ffd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.913+0000 7fe3d6ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.913+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6789/0 conn(0x7fe3c8002840 legacy=0x7fe3c8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.913+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6789/0 conn(0x7fe3c8002840 legacy=0x7fe3c8004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.921+0000 7fe3f5589700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.921+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe3c8007510 con 0x7fe3c80068b0 2021-05-26T16:45:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3eeffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6789/0 conn(0x7fe3c80068b0 legacy=0x7fe3c8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448024103 0 0) 0x7fe3c8007510 con 0x7fe3c80068b0 2021-05-26T16:45:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 10 monclient(hunting): my global_id is 5590 2021-05-26T16:45:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c80065a0 con 0x7fe3c80068b0 2021-05-26T16:45:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1175515780 0 0) 0x7fe3c80065a0 con 0x7fe3c80068b0 2021-05-26T16:45:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3c8007510 con 0x7fe3c80068b0 2021-05-26T16:45:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe3d8002dd0 con 0x7fe3c80068b0 2021-05-26T16:45:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 10 monclient: dump: 2021-05-26T16:45:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:48.984 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2537980353 0 0) 0x7fe3c8007510 con 0x7fe3c80068b0 2021-05-26T16:45:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.924+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 --> v1:172.21.15.137:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe3c8008770 con 0x7fe3c80068b0 2021-05-26T16:45:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 4220225128) 0x7fe3d8005ed0 con 0x7fe3c80068b0 2021-05-26T16:45:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3d6ffd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3d6ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6789/0 conn(0x7fe3c80068b0 legacy=0x7fe3c8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3d6ffd700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6789/0 conn(0x7fe3c80068b0 legacy=0x7fe3c8006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:48.986 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:48.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:48.986 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:48.986 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:48.987 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:48.987 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:48.987 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:48.987 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:48.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:48.988 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:48.988 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:48.988 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:48.988 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:48.989 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:48.989 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:48.989 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.989 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:45:48.989 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.990 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:48.990 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:48.990 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.990 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.990 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.991 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.991 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.991 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.991 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.991 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.992 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.992 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:48.992 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:48.992 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:48.992 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.993 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.993 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.993 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.993 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.994 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.994 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:48.994 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:48.994 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:48.994 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:48.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:48.995 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:48.995 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:48.995 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:48.996 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:48.996 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:48.996 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:48.996 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.996 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:48.997 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:48.997 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:48.997 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:48.997 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:48.997 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:48.998 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:48.998 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:48.998 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:48.998 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:48.999 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:48.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:48.999 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:48.999 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:48.999 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.000 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.000 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.000 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.000 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:49.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.000 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:49.001 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.001 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:49.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:49.001 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.001 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.002 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.002 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.002 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:49.002 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.002 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.003 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.003 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.003 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.003 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.004 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.004 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.004 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.004 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:49.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:49.005 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.005 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.005 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.006 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.006 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:49.006 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.006 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.006 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.007 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.007 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.007 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.007 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.008 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.008 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.009 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:49.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:49.009 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.009 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.009 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.010 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.010 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:49.010 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.010 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.011 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.011 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.011 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.011 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.012 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.012 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.012 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.013 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:49.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:49.013 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.013 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.013 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.014 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.014 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:49.014 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.014 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.014 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.015 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.015 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.015 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.016 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.016 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.016 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.016 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:49.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:49.017 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.017 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.017 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.018 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.018 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:49.018 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.018 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.018 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.019 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.019 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.019 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.019 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.020 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.020 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.020 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:49.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:49.021 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.021 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.021 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.021 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.022 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:49.022 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.022 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.022 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.023 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:49.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.025 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.027 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:49.028 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.029 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.030 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.032 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.034 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.037 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:49.038 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:49.039 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.137:6812/30003 conn(0x7fe3d0032f40 legacy=0x7fe3d0035400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 10 monclient: shutdown 2021-05-26T16:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 >> v1:172.21.15.3:6793/0 conn(0x7fe3f009a130 legacy=0x7fe3f01449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3ef7fe700 1 -- 172.21.15.3:0/3824134496 reap_dead start 2021-05-26T16:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3ef7fe700 1 -- 172.21.15.3:0/3824134496 reap_dead start 2021-05-26T16:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 shutdown_connections 2021-05-26T16:45:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 >> 172.21.15.3:0/3824134496 conn(0x7fe3f009cb30 msgr2=0x7fe3f009f130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 shutdown_connections 2021-05-26T16:45:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:48.925+0000 7fe3f5589700 1 -- 172.21.15.3:0/3824134496 wait complete. 2021-05-26T16:45:49.044 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2021-05-26T16:45:49.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.157+0000 7f8ad3077700 10 monclient: get_monmap_and_config 2021-05-26T16:45:49.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.157+0000 7f8ad3077700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.157+0000 7f8ad3077700 10 monclient: monmap: 2021-05-26T16:45:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:49.158546+0000 2021-05-26T16:45:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:49.158546+0000 2021-05-26T16:45:49.162 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.162 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.162 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.162 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.164 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.164 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.164 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.158+0000 7f8ad3077700 1 Processor -- start 2021-05-26T16:45:49.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.158+0000 7f8ad3077700 1 -- start start 2021-05-26T16:45:49.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.158+0000 7f8ad3077700 10 monclient: init 2021-05-26T16:45:49.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 10 monclient: _add_conns ranks=[3,8,1,5,6,7,4,2,0] 2021-05-26T16:45:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 10 monclient(hunting): picked mon.noname-g con 0x7f8acc096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 10 monclient(hunting): picked mon.noname-e con 0x7f8acc099db0 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 10 monclient(hunting): picked mon.noname-f con 0x7f8acc09a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc059750 con 0x7f8acc09a260 2021-05-26T16:45:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc064620 con 0x7f8acc096ca0 2021-05-26T16:45:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc064e50 con 0x7f8acc099db0 2021-05-26T16:45:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad3077700 10 monclient(hunting): authenticate will time out at 1106.790450s 2021-05-26T16:45:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad0e13700 1 --1- >> v1:172.21.15.137:6790/0 conn(0x7f8acc096ca0 0x7f8acc063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6790/0 says I am v1:172.21.15.3:35620/0 (socket says 172.21.15.3:35620) 2021-05-26T16:45:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.159+0000 7f8ad0e13700 1 -- 172.21.15.3:0/3251496502 learned_addr learned my addr 172.21.15.3:0/3251496502 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.161+0000 7f8ad0e13700 1 -- 172.21.15.3:0/3251496502 >> v1:172.21.15.137:6790/0 conn(0x7f8acc096ca0 legacy=0x7f8acc063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.161+0000 7f8ac3fff700 1 -- 172.21.15.3:0/3251496502 >> v1:172.21.15.3:6793/0 conn(0x7f8acc099db0 legacy=0x7f8acc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.161+0000 7f8ad1614700 1 -- 172.21.15.3:0/3251496502 >> v1:172.21.15.137:6789/0 conn(0x7f8acc09a260 legacy=0x7f8acc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655449569 0 0) 0x7f8acc064e50 con 0x7f8acc099db0 2021-05-26T16:45:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient(hunting): my global_id is 104831 2021-05-26T16:45:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab8003270 con 0x7f8acc099db0 2021-05-26T16:45:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885322713 0 0) 0x7f8acc064620 con 0x7f8acc096ca0 2021-05-26T16:45:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient(hunting): my global_id is 5493 2021-05-26T16:45:49.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc064e50 con 0x7f8acc096ca0 2021-05-26T16:45:49.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155494969 0 0) 0x7f8ab8003270 con 0x7f8acc099db0 2021-05-26T16:45:49.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 >> v1:172.21.15.137:6790/0 conn(0x7f8acc096ca0 legacy=0x7f8acc063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.176 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 >> v1:172.21.15.137:6789/0 conn(0x7f8acc09a260 legacy=0x7f8acc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 monclient: found mon.noname-e 2021-05-26T16:45:49.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:45:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc09c390 con 0x7f8acc099db0 2021-05-26T16:45:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8ab40019e0 con 0x7f8acc099db0 2021-05-26T16:45:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ad3077700 5 monclient: authenticate success, global_id 104831 2021-05-26T16:45:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ad3077700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: dump: 2021-05-26T16:45:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.183 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ad3077700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8ab4001cf0 con 0x7f8acc099db0 2021-05-26T16:45:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 1 -- 172.21.15.3:0/3251496502 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8ab4002240 con 0x7f8acc099db0 2021-05-26T16:45:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ad3077700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ad3077700 4 set_mon_vals no callback set 2021-05-26T16:45:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.164+0000 7f8ac37fe700 10 monclient: dump: 2021-05-26T16:45:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.188 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.165+0000 7f8ad3077700 10 monclient: shutdown 2021-05-26T16:45:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.165+0000 7f8ad3077700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.165+0000 7f8ad3077700 1 -- 172.21.15.3:0/3251496502 >> v1:172.21.15.3:6793/0 conn(0x7f8acc099db0 legacy=0x7f8acc132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.165+0000 7f8ad3077700 1 -- 172.21.15.3:0/3251496502 shutdown_connections 2021-05-26T16:45:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.165+0000 7f8ad3077700 1 -- 172.21.15.3:0/3251496502 >> 172.21.15.3:0/3251496502 conn(0x7f8acc09cc00 msgr2=0x7f8acc09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.165+0000 7f8ad3077700 1 -- 172.21.15.3:0/3251496502 shutdown_connections 2021-05-26T16:45:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.165+0000 7f8ad3077700 1 -- 172.21.15.3:0/3251496502 wait complete. 2021-05-26T16:45:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.166+0000 7f8ad3077700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.166+0000 7f8ad3077700 10 monclient: monmap: 2021-05-26T16:45:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.192 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.192 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.192 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.192 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.192 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.193 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.193 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.193 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.193 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 1 Processor -- start 2021-05-26T16:45:49.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 1 -- start start 2021-05-26T16:45:49.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 10 monclient: init 2021-05-26T16:45:49.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.194 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 10 monclient: _add_conns ranks=[2,0,3,5,6,1,4,8,7] 2021-05-26T16:45:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 10 monclient(hunting): picked mon.noname-b con 0x7f8acc096ca0 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 10 monclient(hunting): picked mon.noname-a con 0x7f8acc099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 10 monclient(hunting): picked mon.noname-g con 0x7f8acc09a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.167+0000 7f8ad3077700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc116850 con 0x7f8acc099db0 2021-05-26T16:45:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.168+0000 7f8ad3077700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc116a80 con 0x7f8acc096ca0 2021-05-26T16:45:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.168+0000 7f8ad0e13700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f8acc096ca0 0x7f8acc13c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55288/0 (socket says 172.21.15.3:55288) 2021-05-26T16:45:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.168+0000 7f8ad0e13700 1 -- 172.21.15.3:0/3646588205 learned_addr learned my addr 172.21.15.3:0/3646588205 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.168+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc116d60 con 0x7f8acc09a260 2021-05-26T16:45:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.168+0000 7f8ad3077700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.168+0000 7f8ad3077700 10 monclient(hunting): authenticate will time out at 1106.799181s 2021-05-26T16:45:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.170+0000 7f8ad0e13700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.3:6790/0 conn(0x7f8acc096ca0 legacy=0x7f8acc13c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.170+0000 7f8ad1614700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc09a260 legacy=0x7f8acc144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.171+0000 7f8ac3fff700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.3:6789/0 conn(0x7f8acc099db0 legacy=0x7f8acc141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667950194 0 0) 0x7f8acc116850 con 0x7f8acc099db0 2021-05-26T16:45:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 10 monclient(hunting): my global_id is 104859 2021-05-26T16:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aac003270 con 0x7f8acc099db0 2021-05-26T16:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002273547 0 0) 0x7f8acc116a80 con 0x7f8acc096ca0 2021-05-26T16:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 10 monclient(hunting): my global_id is 5555 2021-05-26T16:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc116850 con 0x7f8acc096ca0 2021-05-26T16:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3289863793 0 0) 0x7f8acc116850 con 0x7f8acc096ca0 2021-05-26T16:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.172+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8acc116a80 con 0x7f8acc096ca0 2021-05-26T16:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8abc001da0 con 0x7f8acc096ca0 2021-05-26T16:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient(hunting): dump: 2021-05-26T16:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 503735427 0 0) 0x7f8acc116a80 con 0x7f8acc096ca0 2021-05-26T16:45:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc09a260 legacy=0x7f8acc144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.3:6789/0 conn(0x7f8acc099db0 legacy=0x7f8acc141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 monclient: found mon.b 2021-05-26T16:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc117000 con 0x7f8acc096ca0 2021-05-26T16:45:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ad3077700 5 monclient: authenticate success, global_id 5555 2021-05-26T16:45:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ad3077700 10 monclient: _renew_subs 2021-05-26T16:45:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ad3077700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:45:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.3:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc094f90 con 0x7f8acc096ca0 2021-05-26T16:45:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8abc0049e0 con 0x7f8acc096ca0 2021-05-26T16:45:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8abc004e90 con 0x7f8acc096ca0 2021-05-26T16:45:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac0ff9700 10 monclient: dump: 2021-05-26T16:45:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.215 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ad3077700 10 monclient: _renew_subs 2021-05-26T16:45:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ad3077700 10 monclient: _send_mon_message to mon.b at v1:172.21.15.3:6790/0 2021-05-26T16:45:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.3:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc095990 con 0x7f8acc096ca0 2021-05-26T16:45:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.173+0000 7f8ac2ffd700 4 set_mon_vals no callback set 2021-05-26T16:45:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.174+0000 7f8ad3077700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.174+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8acc095c40 con 0x7f8acc129970 2021-05-26T16:45:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.175+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f8abc00e400 con 0x7f8acc096ca0 2021-05-26T16:45:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.175+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.2 v1:172.21.15.3:6790/0 8 ==== osd_map(205..205 src has 1..205) v4 ==== 3941+0+0 (unknown 371714674 0 0) 0x7f8abc03d9e0 con 0x7f8acc096ca0 2021-05-26T16:45:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.175+0000 7f8ad1614700 10 monclient: get_auth_request con 0x7f8aac032c70 auth_method 0 2021-05-26T16:45:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.177+0000 7f8ac3fff700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc129970 legacy=0x7f8acc12a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.177+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287424359 0 0) 0x7f8acc095c40 con 0x7f8acc129970 2021-05-26T16:45:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.177+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.177+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.177+0000 7f8ac0ff9700 10 monclient(hunting): my global_id is 5502 2021-05-26T16:45:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.177+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc116a80 con 0x7f8acc129970 2021-05-26T16:45:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2291157351 0 0) 0x7f8acc116a80 con 0x7f8acc129970 2021-05-26T16:45:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8acc095c40 con 0x7f8acc129970 2021-05-26T16:45:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8ab40014c0 con 0x7f8acc129970 2021-05-26T16:45:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:45:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 10 monclient: dump: 2021-05-26T16:45:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.223 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1723654041 0 0) 0x7f8acc095c40 con 0x7f8acc129970 2021-05-26T16:45:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.178+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8acc06c030 con 0x7f8acc129970 2021-05-26T16:45:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.179+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f8ab40018d0 con 0x7f8acc129970 2021-05-26T16:45:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.179+0000 7f8ac0ff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.179+0000 7f8ac0ff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.179+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc129970 legacy=0x7f8acc12a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.179+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc129970 legacy=0x7f8acc12a950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.185+0000 7f8ad3077700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.185+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8acc09d2f0 con 0x7f8acc027d00 2021-05-26T16:45:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.188+0000 7f8ac3fff700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc027d00 legacy=0x7f8acc12b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.188+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314891055 0 0) 0x7f8acc09d2f0 con 0x7f8acc027d00 2021-05-26T16:45:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.188+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.188+0000 7f8ac0ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.188+0000 7f8ac0ff9700 10 monclient(hunting): my global_id is 5511 2021-05-26T16:45:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.188+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc095c40 con 0x7f8acc027d00 2021-05-26T16:45:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2330532530 0 0) 0x7f8acc095c40 con 0x7f8acc027d00 2021-05-26T16:45:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8acc09d2f0 con 0x7f8acc027d00 2021-05-26T16:45:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8ab4002ab0 con 0x7f8acc027d00 2021-05-26T16:45:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:45:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 10 monclient: dump: 2021-05-26T16:45:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.231 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1984225496 0 0) 0x7f8acc09d2f0 con 0x7f8acc027d00 2021-05-26T16:45:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 --> v1:172.21.15.137:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8acc069b10 con 0x7f8acc027d00 2021-05-26T16:45:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7662 (unknown 0 0 2822549089) 0x7f8ab4005510 con 0x7f8acc027d00 2021-05-26T16:45:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc027d00 legacy=0x7f8acc12b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ac0ff9700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6790/0 conn(0x7f8acc027d00 legacy=0x7f8acc12b060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:49.234 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:49.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:49.234 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:49.234 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:49.235 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:49.235 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:49.235 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:49.235 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:49.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:49.236 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:49.236 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:49.236 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:49.236 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:49.236 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:49.237 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:49.237 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.237 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 2, 2021-05-26T16:45:49.237 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:49.237 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:49.238 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:49.238 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.238 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.238 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.239 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.239 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.239 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.239 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.239 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.240 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.240 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.240 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:49.240 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:49.241 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.241 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.241 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.241 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.241 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.242 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.242 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.242 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.242 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.243 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.243 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:49.243 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:49.243 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:49.244 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:49.244 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:49.244 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:49.244 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:49.244 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:49.245 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:49.245 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:49.245 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:49.245 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:49.245 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:49.246 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:49.246 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:49.246 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.246 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.247 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.247 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.247 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.247 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.247 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.248 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.248 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.248 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.248 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:49.248 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.249 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:49.249 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.249 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:49.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:49.249 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.250 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.250 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.250 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.250 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:49.251 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.251 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.251 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.251 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.252 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.252 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.252 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.252 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.253 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.253 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:49.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:49.254 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.254 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.254 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.255 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.255 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:49.255 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.255 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.256 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.256 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.257 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.257 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.257 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.257 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.258 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.258 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:49.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:49.258 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.259 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.259 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.259 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.259 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:49.260 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.260 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.260 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.260 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.261 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.261 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.261 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.261 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.262 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.262 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:49.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:49.262 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.263 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.263 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.263 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.263 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:49.264 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.264 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.264 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.264 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.265 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.265 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.265 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.265 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.266 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.266 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:49.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:49.266 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.267 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.267 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.267 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.267 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:49.268 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.268 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.268 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.268 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.269 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.269 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.269 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.269 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.270 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.270 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:49.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:49.270 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.271 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.271 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.271 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.271 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:49.271 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.272 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.272 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.272 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.272 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.273 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.273 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.273 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.273 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.274 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:49.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:49.274 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.274 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.275 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.275 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.275 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:49.275 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.275 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.276 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.276 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.276 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.277 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.277 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.277 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.277 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.278 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:49.278 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:49.278 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.278 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.279 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.279 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.279 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:49.279 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.279 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.281 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.281 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.281 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.281 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:49.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:49.282 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.282 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.282 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.282 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.282 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:49.283 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.283 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.283 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.285 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.286 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:45:49.287 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.288 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.289 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": [ 2021-05-26T16:45:49.290 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:49.291 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.292 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.292 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:49.292 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:49.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.137:6812/30003 conn(0x7f8aac032c70 legacy=0x7f8aac035130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ad3077700 10 monclient: shutdown 2021-05-26T16:45:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ad3077700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.189+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 >> v1:172.21.15.3:6790/0 conn(0x7f8acc096ca0 legacy=0x7f8acc13c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.190+0000 7f8ad1614700 1 -- 172.21.15.3:0/3646588205 reap_dead start 2021-05-26T16:45:49.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.190+0000 7f8ad1614700 1 -- 172.21.15.3:0/3646588205 reap_dead start 2021-05-26T16:45:49.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.190+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 shutdown_connections 2021-05-26T16:45:49.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.190+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 >> 172.21.15.3:0/3646588205 conn(0x7f8acc09cc00 msgr2=0x7f8acc09ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.190+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 shutdown_connections 2021-05-26T16:45:49.296 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.190+0000 7f8ad3077700 1 -- 172.21.15.3:0/3646588205 wait complete. 2021-05-26T16:45:49.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2021-05-26T16:45:49.414 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.412+0000 7f8406957700 10 monclient: get_monmap_and_config 2021-05-26T16:45:49.415 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.412+0000 7f8406957700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.415 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.412+0000 7f8406957700 10 monclient: monmap: 2021-05-26T16:45:49.415 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.415 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.416 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:49.413051+0000 2021-05-26T16:45:49.416 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:49.413051+0000 2021-05-26T16:45:49.416 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.416 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.417 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.417 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.417 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.417 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.417 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.418 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.418 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.418 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.418 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.418 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 1 Processor -- start 2021-05-26T16:45:49.433 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 1 -- start start 2021-05-26T16:45:49.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient: init 2021-05-26T16:45:49.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.434 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient: _add_conns ranks=[2,0,1,8,7,4,3,5,6] 2021-05-26T16:45:49.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient(hunting): picked mon.noname-b con 0x7f840012cbd0 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:49.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient(hunting): picked mon.noname-a con 0x7f8400099a30 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:49.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient(hunting): picked mon.noname-f con 0x7f8400099eb0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:49.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8400046600 con 0x7f8400099a30 2021-05-26T16:45:49.435 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840009b5e0 con 0x7f8400099eb0 2021-05-26T16:45:49.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840012d8f0 con 0x7f840012cbd0 2021-05-26T16:45:49.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8406957700 10 monclient(hunting): authenticate will time out at 1107.044856s 2021-05-26T16:45:49.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8405955700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f840012cbd0 0x7f840012d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55300/0 (socket says 172.21.15.3:55300) 2021-05-26T16:45:49.436 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8405955700 1 -- 172.21.15.3:0/594111628 learned_addr learned my addr 172.21.15.3:0/594111628 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.413+0000 7f8405154700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8400099a30 0x7f8400131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53260/0 (socket says 172.21.15.3:53260) 2021-05-26T16:45:49.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8405154700 1 -- 172.21.15.3:0/594111628 >> v1:172.21.15.3:6789/0 conn(0x7f8400099a30 legacy=0x7f8400131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8405955700 1 -- 172.21.15.3:0/594111628 >> v1:172.21.15.3:6790/0 conn(0x7f840012cbd0 legacy=0x7f840012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.437 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165163805 0 0) 0x7f8400046600 con 0x7f8400099a30 2021-05-26T16:45:49.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient(hunting): my global_id is 104868 2021-05-26T16:45:49.438 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e8003270 con 0x7f8400099a30 2021-05-26T16:45:49.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212994841 0 0) 0x7f840012d8f0 con 0x7f840012cbd0 2021-05-26T16:45:49.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient(hunting): my global_id is 5564 2021-05-26T16:45:49.439 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8400046600 con 0x7f840012cbd0 2021-05-26T16:45:49.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8406156700 1 -- 172.21.15.3:0/594111628 >> v1:172.21.15.137:6789/0 conn(0x7f8400099eb0 legacy=0x7f8400135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1357025755 0 0) 0x7f8400046600 con 0x7f840012cbd0 2021-05-26T16:45:49.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 >> v1:172.21.15.137:6789/0 conn(0x7f8400099eb0 legacy=0x7f8400135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.440 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 >> v1:172.21.15.3:6789/0 conn(0x7f8400099a30 legacy=0x7f8400131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 monclient: found mon.noname-b 2021-05-26T16:45:49.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:45:49.441 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840009c2b0 con 0x7f840012cbd0 2021-05-26T16:45:49.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f83f4001a60 con 0x7f840012cbd0 2021-05-26T16:45:49.442 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:45:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient: dump: 2021-05-26T16:45:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.444 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.444 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.444 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.444 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.445 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.445 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.445 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.445 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.446 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.446 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.446 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.446 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.447 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8406957700 5 monclient: authenticate success, global_id 5564 2021-05-26T16:45:49.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8406957700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:49.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8405955700 1 --1- 172.21.15.3:0/594111628 >> v1:172.21.15.3:6790/0 conn(0x7f840012cbd0 0x7f840012d1e0 :-1 s=OPENED pgs=359 cs=1 l=1).queue_received will delay after 1.62205e+09 on 0x7f83f4004930 mon_map magic: 0 v1 2021-05-26T16:45:49.447 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f83f4001d70 con 0x7f840012cbd0 2021-05-26T16:45:49.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8404953700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8406957700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:49.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.416+0000 7f8406957700 4 set_mon_vals no callback set 2021-05-26T16:45:49.448 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 10 monclient: shutdown 2021-05-26T16:45:49.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 1 -- 172.21.15.3:0/594111628 >> v1:172.21.15.3:6790/0 conn(0x7f840012cbd0 legacy=0x7f840012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8404953700 1 -- 172.21.15.3:0/594111628 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f83f4004930 con 0x7f840012cbd0 2021-05-26T16:45:49.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8404953700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2021-05-26T16:45:49.449 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 1 -- 172.21.15.3:0/594111628 shutdown_connections 2021-05-26T16:45:49.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 1 -- 172.21.15.3:0/594111628 >> 172.21.15.3:0/594111628 conn(0x7f84000a00c0 msgr2=0x7f84000a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 1 -- 172.21.15.3:0/594111628 shutdown_connections 2021-05-26T16:45:49.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 1 -- 172.21.15.3:0/594111628 wait complete. 2021-05-26T16:45:49.450 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.451 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.417+0000 7f8406957700 10 monclient: monmap: 2021-05-26T16:45:49.451 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.451 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:49.451 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:49.451 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:49.452 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.452 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.452 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.452 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.452 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.453 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.453 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.453 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.453 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.454 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.454 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.454 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 1 Processor -- start 2021-05-26T16:45:49.454 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 1 -- start start 2021-05-26T16:45:49.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient: init 2021-05-26T16:45:49.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient: _add_conns ranks=[5,4,3,7,2,1,6,8,0] 2021-05-26T16:45:49.455 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient(hunting): picked mon.noname-h con 0x7f8400099a30 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:49.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient(hunting): picked mon.noname-c con 0x7f8400099eb0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:49.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient(hunting): picked mon.noname-g con 0x7f840012cbd0 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:49.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840009bd30 con 0x7f840012cbd0 2021-05-26T16:45:49.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8400116ba0 con 0x7f8400099eb0 2021-05-26T16:45:49.456 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8400116e40 con 0x7f8400099a30 2021-05-26T16:45:49.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8406957700 10 monclient(hunting): authenticate will time out at 1107.049575s 2021-05-26T16:45:49.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8405154700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f8400099eb0 0x7f84001411a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38780/0 (socket says 172.21.15.3:38780) 2021-05-26T16:45:49.457 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.418+0000 7f8405154700 1 -- 172.21.15.3:0/3256189116 learned_addr learned my addr 172.21.15.3:0/3256189116 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.420+0000 7f8405154700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.3:6791/0 conn(0x7f8400099eb0 legacy=0x7f84001411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.420+0000 7f8405955700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400099a30 legacy=0x7f840013c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.420+0000 7f8406156700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6790/0 conn(0x7f840012cbd0 legacy=0x7f84001448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.420+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447557762 0 0) 0x7f8400116ba0 con 0x7f8400099eb0 2021-05-26T16:45:49.458 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): my global_id is 114133 2021-05-26T16:45:49.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e0003270 con 0x7f8400099eb0 2021-05-26T16:45:49.459 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555460342 0 0) 0x7f840009bd30 con 0x7f840012cbd0 2021-05-26T16:45:49.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): my global_id is 5520 2021-05-26T16:45:49.460 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8400116ba0 con 0x7f840012cbd0 2021-05-26T16:45:49.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 707577588 0 0) 0x7f83e0003270 con 0x7f8400099eb0 2021-05-26T16:45:49.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f840009bd30 con 0x7f8400099eb0 2021-05-26T16:45:49.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f83f0001950 con 0x7f8400099eb0 2021-05-26T16:45:49.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.461 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:49.462 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): dump: 2021-05-26T16:45:49.462 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.462 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.462 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.463 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.463 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.463 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.463 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.463 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.464 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.465 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:49.465 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344105950 0 0) 0x7f8400116e40 con 0x7f8400099a30 2021-05-26T16:45:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient(hunting): my global_id is 5702 2021-05-26T16:45:49.466 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e0003270 con 0x7f8400099a30 2021-05-26T16:45:49.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 236191419 0 0) 0x7f840009bd30 con 0x7f8400099eb0 2021-05-26T16:45:49.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400099a30 legacy=0x7f840013c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6790/0 conn(0x7f840012cbd0 legacy=0x7f84001448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.467 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 monclient: found mon.c 2021-05-26T16:45:49.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000969c0 con 0x7f8400099eb0 2021-05-26T16:45:49.468 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f8406957700 5 monclient: authenticate success, global_id 114133 2021-05-26T16:45:49.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f8406957700 10 monclient: _renew_subs 2021-05-26T16:45:49.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f8406957700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.469 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8400095f90 con 0x7f8400099eb0 2021-05-26T16:45:49.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f83f0004b20 con 0x7f8400099eb0 2021-05-26T16:45:49.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f83f0004fd0 con 0x7f8400099eb0 2021-05-26T16:45:49.470 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:49.471 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83edffb700 10 monclient: dump: 2021-05-26T16:45:49.471 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.471 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.471 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.472 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.472 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.472 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.472 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.472 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.473 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.473 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.473 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.473 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.474 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.474 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.474 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.474 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.474 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f83effff700 4 set_mon_vals no callback set 2021-05-26T16:45:49.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f8406957700 10 monclient: _renew_subs 2021-05-26T16:45:49.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f8406957700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.421+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f840013cd40 con 0x7f8400099eb0 2021-05-26T16:45:49.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.422+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f83f000e5c0 con 0x7f8400099eb0 2021-05-26T16:45:49.475 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.422+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(205..205 src has 1..205) v4 ==== 3941+0+0 (unknown 371714674 0 0) 0x7f83f003db40 con 0x7f8400099eb0 2021-05-26T16:45:49.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.422+0000 7f8406957700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.422+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f840006cab0 con 0x7f8400130eb0 2021-05-26T16:45:49.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.422+0000 7f8405955700 10 monclient: get_auth_request con 0x7f83e00328b0 auth_method 0 2021-05-26T16:45:49.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.424+0000 7f8406156700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400130eb0 legacy=0x7f840009dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.476 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391658177 0 0) 0x7f840006cab0 con 0x7f8400130eb0 2021-05-26T16:45:49.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient(hunting): my global_id is 5711 2021-05-26T16:45:49.477 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f840009bd30 con 0x7f8400130eb0 2021-05-26T16:45:49.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2346974718 0 0) 0x7f840009bd30 con 0x7f8400130eb0 2021-05-26T16:45:49.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f840006cab0 con 0x7f8400130eb0 2021-05-26T16:45:49.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f83fc002840 con 0x7f8400130eb0 2021-05-26T16:45:49.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.478 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:45:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient: dump: 2021-05-26T16:45:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.482 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.482 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.482 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2140435801 0 0) 0x7f840006cab0 con 0x7f8400130eb0 2021-05-26T16:45:49.482 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8400096180 con 0x7f8400130eb0 2021-05-26T16:45:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f83fc002d60 con 0x7f8400130eb0 2021-05-26T16:45:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400130eb0 legacy=0x7f840009dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.425+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400130eb0 legacy=0x7f840009dd10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.432+0000 7f8406957700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.432+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f840006c030 con 0x7f8400027d00 2021-05-26T16:45:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.434+0000 7f8406156700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400027d00 legacy=0x7f840009e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.434+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275417443 0 0) 0x7f840006c030 con 0x7f8400027d00 2021-05-26T16:45:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 10 monclient(hunting): my global_id is 5720 2021-05-26T16:45:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f840006cab0 con 0x7f8400027d00 2021-05-26T16:45:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2661203042 0 0) 0x7f840006cab0 con 0x7f8400027d00 2021-05-26T16:45:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f840006c030 con 0x7f8400027d00 2021-05-26T16:45:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f83fc005bd0 con 0x7f8400027d00 2021-05-26T16:45:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:45:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 10 monclient: dump: 2021-05-26T16:45:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.493 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1838380163 0 0) 0x7f840006c030 con 0x7f8400027d00 2021-05-26T16:45:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.435+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 --> v1:172.21.15.137:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f840009b850 con 0x7f8400027d00 2021-05-26T16:45:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 3192295668) 0x7f83fc0061c0 con 0x7f8400027d00 2021-05-26T16:45:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f83edffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f83edffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400027d00 legacy=0x7f840009e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f83edffb700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6791/0 conn(0x7f8400027d00 legacy=0x7f840009e420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:49.495 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:49.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:49.495 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:49.495 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:49.495 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:49.496 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:49.496 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:49.496 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:49.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:49.497 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:49.497 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:49.497 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:49.497 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:49.497 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:49.498 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:49.498 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.498 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 3, 2021-05-26T16:45:49.498 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:49.499 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:49.499 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:49.499 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.499 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.499 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.500 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.500 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.500 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.500 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.501 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.501 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.501 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.501 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:49.501 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:49.502 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.502 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.502 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.502 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.503 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.503 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.503 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.503 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.503 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.504 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.504 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:49.504 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:49.505 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:49.505 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:49.505 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:49.505 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:49.505 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:49.506 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:49.506 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:49.506 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:49.506 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:49.507 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:49.507 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:49.507 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:49.507 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:49.507 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.508 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.508 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.508 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.508 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.509 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.509 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.509 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.509 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.509 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.510 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:49.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.510 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:49.510 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.510 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:49.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:49.511 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.511 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.511 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.512 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.512 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:49.512 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.512 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.512 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.513 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.513 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.513 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.513 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.514 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.514 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.514 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:49.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:49.515 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.515 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.515 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.515 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.516 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:49.516 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.516 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.516 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.517 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.517 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.517 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.517 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.518 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.518 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.518 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:49.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:49.519 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.519 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.519 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.519 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.520 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:49.520 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.520 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.520 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.521 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.521 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.521 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.521 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.522 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.522 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.522 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:49.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:49.523 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.523 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.523 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.523 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.524 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:49.524 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.524 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.524 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.525 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.525 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.525 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.525 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.526 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.526 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.526 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:49.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:49.527 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.527 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.527 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.527 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.527 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:49.528 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.528 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.528 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.529 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.529 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.529 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.529 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.529 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.530 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.530 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:49.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:49.531 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.531 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.531 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.531 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.532 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:49.532 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.532 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.532 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.533 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.533 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.533 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.533 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.533 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.534 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.534 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:49.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:49.535 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.535 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.535 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.535 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.535 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:49.536 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.536 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.536 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.536 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.537 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.537 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.537 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.537 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.538 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.538 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:49.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:49.539 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.539 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.539 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.539 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.540 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:49.540 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.540 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.540 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.541 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.541 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.541 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.541 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.542 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.542 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.542 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:49.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:49.543 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.543 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.543 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.544 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.544 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:49.544 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.544 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.544 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.545 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.545 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.545 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.545 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.546 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.546 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.546 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.547 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:49.547 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:49.547 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.547 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.548 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.548 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:49.548 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.548 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.548 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:49.549 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.549 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.549 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.549 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:49.549 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.550 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.550 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:49.550 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:49.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.137:6812/30003 conn(0x7f83e00328b0 legacy=0x7f83e0034d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 10 monclient: shutdown 2021-05-26T16:45:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 >> v1:172.21.15.3:6791/0 conn(0x7f8400099eb0 legacy=0x7f84001411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406156700 1 -- 172.21.15.3:0/3256189116 reap_dead start 2021-05-26T16:45:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 shutdown_connections 2021-05-26T16:45:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 >> 172.21.15.3:0/3256189116 conn(0x7f84000a00c0 msgr2=0x7f840012b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 shutdown_connections 2021-05-26T16:45:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.436+0000 7f8406957700 1 -- 172.21.15.3:0/3256189116 wait complete. 2021-05-26T16:45:49.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2021-05-26T16:45:49.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.668+0000 7fbe71233700 10 monclient: get_monmap_and_config 2021-05-26T16:45:49.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.668+0000 7fbe71233700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.671 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.668+0000 7fbe71233700 10 monclient: monmap: 2021-05-26T16:45:49.672 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.672 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.672 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:49.669318+0000 2021-05-26T16:45:49.672 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:49.669318+0000 2021-05-26T16:45:49.672 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.675 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 1 Processor -- start 2021-05-26T16:45:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 1 -- start start 2021-05-26T16:45:49.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient: init 2021-05-26T16:45:49.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient: _add_conns ranks=[3,7,4,1,5,0,2,8,6] 2021-05-26T16:45:49.686 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient(hunting): picked mon.noname-g con 0x7fbe6c096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:49.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient(hunting): picked mon.noname-i con 0x7fbe6c099db0 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:49.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient(hunting): picked mon.noname-c con 0x7fbe6c09a260 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:49.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c059750 con 0x7fbe6c096ca0 2021-05-26T16:45:49.687 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c064620 con 0x7fbe6c09a260 2021-05-26T16:45:49.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c064e50 con 0x7fbe6c099db0 2021-05-26T16:45:49.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe71233700 10 monclient(hunting): authenticate will time out at 1107.300786s 2021-05-26T16:45:49.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe6b59e700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fbe6c09a260 0x7fbe6c1357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38792/0 (socket says 172.21.15.3:38792) 2021-05-26T16:45:49.688 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.669+0000 7fbe6b59e700 1 -- 172.21.15.3:0/1873974059 learned_addr learned my addr 172.21.15.3:0/1873974059 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe6b59e700 1 -- 172.21.15.3:0/1873974059 >> v1:172.21.15.3:6791/0 conn(0x7fbe6c09a260 legacy=0x7fbe6c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183286954 0 0) 0x7fbe6c064620 con 0x7fbe6c09a260 2021-05-26T16:45:49.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.689 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): my global_id is 114142 2021-05-26T16:45:49.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe58003270 con 0x7fbe6c09a260 2021-05-26T16:45:49.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe6a59c700 1 -- 172.21.15.3:0/1873974059 >> v1:172.21.15.137:6792/0 conn(0x7fbe6c099db0 legacy=0x7fbe6c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe6ad9d700 1 -- 172.21.15.3:0/1873974059 >> v1:172.21.15.137:6790/0 conn(0x7fbe6c096ca0 legacy=0x7fbe6c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.690 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162454051 0 0) 0x7fbe6c064e50 con 0x7fbe6c099db0 2021-05-26T16:45:49.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): my global_id is 104704 2021-05-26T16:45:49.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c064620 con 0x7fbe6c099db0 2021-05-26T16:45:49.691 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490754044 0 0) 0x7fbe6c059750 con 0x7fbe6c096ca0 2021-05-26T16:45:49.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient(hunting): my global_id is 5529 2021-05-26T16:45:49.692 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c064e50 con 0x7fbe6c096ca0 2021-05-26T16:45:49.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947546960 0 0) 0x7fbe58003270 con 0x7fbe6c09a260 2021-05-26T16:45:49.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 >> v1:172.21.15.137:6792/0 conn(0x7fbe6c099db0 legacy=0x7fbe6c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 >> v1:172.21.15.137:6790/0 conn(0x7fbe6c096ca0 legacy=0x7fbe6c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.693 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 monclient: found mon.noname-c 2021-05-26T16:45:49.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c09c390 con 0x7fbe6c09a260 2021-05-26T16:45:49.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.694 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe71233700 5 monclient: authenticate success, global_id 114142 2021-05-26T16:45:49.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe5c001e20 con 0x7fbe6c09a260 2021-05-26T16:45:49.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe71233700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:49.695 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:49.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: dump: 2021-05-26T16:45:49.696 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.696 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.696 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.697 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.697 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.697 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.697 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.698 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.698 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.698 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.698 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.698 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.699 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.699 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.699 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.699 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.699 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe71233700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:49.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbe5c002040 con 0x7fbe6c09a260 2021-05-26T16:45:49.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe71233700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:49.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 1 -- 172.21.15.3:0/1873974059 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe5c004cb0 con 0x7fbe6c09a260 2021-05-26T16:45:49.700 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe71233700 4 set_mon_vals no callback set 2021-05-26T16:45:49.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:49.701 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.672+0000 7fbe69d9b700 10 monclient: dump: 2021-05-26T16:45:49.701 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.702 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.702 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.702 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.702 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.702 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.703 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.703 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.703 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.703 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.703 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.704 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.704 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.704 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.704 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.705 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 10 monclient: shutdown 2021-05-26T16:45:49.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 1 -- 172.21.15.3:0/1873974059 >> v1:172.21.15.3:6791/0 conn(0x7fbe6c09a260 legacy=0x7fbe6c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.705 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 1 -- 172.21.15.3:0/1873974059 shutdown_connections 2021-05-26T16:45:49.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 1 -- 172.21.15.3:0/1873974059 >> 172.21.15.3:0/1873974059 conn(0x7fbe6c09cc00 msgr2=0x7fbe6c09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 1 -- 172.21.15.3:0/1873974059 shutdown_connections 2021-05-26T16:45:49.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 1 -- 172.21.15.3:0/1873974059 wait complete. 2021-05-26T16:45:49.706 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.707 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.673+0000 7fbe71233700 10 monclient: monmap: 2021-05-26T16:45:49.707 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.707 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:49.707 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:49.707 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:49.708 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.708 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.708 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.708 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.708 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.709 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.709 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.709 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.709 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.710 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.710 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.710 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 1 Processor -- start 2021-05-26T16:45:49.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 1 -- start start 2021-05-26T16:45:49.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient: init 2021-05-26T16:45:49.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient: _add_conns ranks=[3,6,0,2,5,8,7,4,1] 2021-05-26T16:45:49.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient(hunting): picked mon.noname-g con 0x7fbe6c096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:49.711 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient(hunting): picked mon.noname-d con 0x7fbe6c099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:49.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient(hunting): picked mon.noname-a con 0x7fbe6c09a260 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:49.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c116740 con 0x7fbe6c09a260 2021-05-26T16:45:49.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c1169e0 con 0x7fbe6c096ca0 2021-05-26T16:45:49.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c116c80 con 0x7fbe6c099db0 2021-05-26T16:45:49.712 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe71233700 10 monclient(hunting): authenticate will time out at 1107.305677s 2021-05-26T16:45:49.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe6a59c700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fbe6c099db0 0x7fbe6c1411d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58684/0 (socket says 172.21.15.3:58684) 2021-05-26T16:45:49.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe6a59c700 1 -- 172.21.15.3:0/427125892 learned_addr learned my addr 172.21.15.3:0/427125892 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.674+0000 7fbe6b59e700 1 --1- 172.21.15.3:0/427125892 >> v1:172.21.15.3:6789/0 conn(0x7fbe6c09a260 0x7fbe6c144900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53286/0 (socket says 172.21.15.3:53286) 2021-05-26T16:45:49.713 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.676+0000 7fbe6b59e700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.3:6789/0 conn(0x7fbe6c09a260 legacy=0x7fbe6c144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.676+0000 7fbe6a59c700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.3:6792/0 conn(0x7fbe6c099db0 legacy=0x7fbe6c1411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe6ad9d700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6790/0 conn(0x7fbe6c096ca0 legacy=0x7fbe6c13c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890869479 0 0) 0x7fbe6c116740 con 0x7fbe6c09a260 2021-05-26T16:45:49.714 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): my global_id is 104877 2021-05-26T16:45:49.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe4c003270 con 0x7fbe6c09a260 2021-05-26T16:45:49.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072254425 0 0) 0x7fbe6c116c80 con 0x7fbe6c099db0 2021-05-26T16:45:49.715 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): my global_id is 5595 2021-05-26T16:45:49.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c116740 con 0x7fbe6c099db0 2021-05-26T16:45:49.716 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663653459 0 0) 0x7fbe6c1169e0 con 0x7fbe6c096ca0 2021-05-26T16:45:49.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): my global_id is 5538 2021-05-26T16:45:49.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c116c80 con 0x7fbe6c096ca0 2021-05-26T16:45:49.717 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 940728072 0 0) 0x7fbe4c003270 con 0x7fbe6c09a260 2021-05-26T16:45:49.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe6c1169e0 con 0x7fbe6c09a260 2021-05-26T16:45:49.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe5c004bf0 con 0x7fbe6c09a260 2021-05-26T16:45:49.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:45:49.718 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): dump: 2021-05-26T16:45:49.719 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.719 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.719 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.719 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.720 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.720 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.720 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.720 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.720 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.721 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.721 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.721 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.721 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.721 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.722 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.722 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:49.722 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2398513711 0 0) 0x7fbe6c116740 con 0x7fbe6c099db0 2021-05-26T16:45:49.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe4c003270 con 0x7fbe6c099db0 2021-05-26T16:45:49.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe54002240 con 0x7fbe6c099db0 2021-05-26T16:45:49.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:49.723 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): dump: 2021-05-26T16:45:49.724 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.724 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.724 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.724 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.724 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.725 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.725 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.725 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.725 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.726 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.726 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.726 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.726 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.726 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.727 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.727 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 952002264 0 0) 0x7fbe6c116c80 con 0x7fbe6c096ca0 2021-05-26T16:45:49.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe6c116740 con 0x7fbe6c096ca0 2021-05-26T16:45:49.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe60001d20 con 0x7fbe6c096ca0 2021-05-26T16:45:49.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2021-05-26T16:45:49.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient(hunting): dump: 2021-05-26T16:45:49.728 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.728 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.729 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.729 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.729 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.729 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.729 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.730 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.731 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.731 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1081318077 0 0) 0x7fbe6c1169e0 con 0x7fbe6c09a260 2021-05-26T16:45:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.3:6792/0 conn(0x7fbe6c099db0 legacy=0x7fbe6c1411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6790/0 conn(0x7fbe6c096ca0 legacy=0x7fbe6c13c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 monclient: found mon.a 2021-05-26T16:45:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c12f2c0 con 0x7fbe6c09a260 2021-05-26T16:45:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe71233700 5 monclient: authenticate success, global_id 104877 2021-05-26T16:45:49.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe71233700 10 monclient: _renew_subs 2021-05-26T16:45:49.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe71233700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:49.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c12ff90 con 0x7fbe6c09a260 2021-05-26T16:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe71233700 10 monclient: _renew_subs 2021-05-26T16:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe71233700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c13cd00 con 0x7fbe6c09a260 2021-05-26T16:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbe5c0018c0 con 0x7fbe6c09a260 2021-05-26T16:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe5c001dd0 con 0x7fbe6c09a260 2021-05-26T16:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe6959a700 4 set_mon_vals no callback set 2021-05-26T16:45:49.737 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.677+0000 7fbe52ffd700 10 monclient: dump: 2021-05-26T16:45:49.737 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.737 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.737 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.738 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.738 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.738 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.738 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.738 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.739 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.739 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.739 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.739 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.740 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.740 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.740 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.740 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.678+0000 7fbe71233700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.678+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fbe5c00e8c0 con 0x7fbe6c09a260 2021-05-26T16:45:49.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.678+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbe440065a0 con 0x7fbe44002840 2021-05-26T16:45:49.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.678+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(205..205 src has 1..205) v4 ==== 3941+0+0 (unknown 371714674 0 0) 0x7fbe5c03dd90 con 0x7fbe6c09a260 2021-05-26T16:45:49.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.679+0000 7fbe6a59c700 10 monclient: get_auth_request con 0x7fbe4c033270 auth_method 0 2021-05-26T16:45:49.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe6ad9d700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6792/0 conn(0x7fbe44002840 legacy=0x7fbe44004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940321551 0 0) 0x7fbe440065a0 con 0x7fbe44002840 2021-05-26T16:45:49.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 10 monclient(hunting): my global_id is 104713 2021-05-26T16:45:49.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c1169e0 con 0x7fbe44002840 2021-05-26T16:45:49.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1053336080 0 0) 0x7fbe6c1169e0 con 0x7fbe44002840 2021-05-26T16:45:49.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe440065a0 con 0x7fbe44002840 2021-05-26T16:45:49.743 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe600024b0 con 0x7fbe44002840 2021-05-26T16:45:49.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:49.744 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 10 monclient: dump: 2021-05-26T16:45:49.744 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.744 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.745 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.746 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.747 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.747 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1510654868 0 0) 0x7fbe440065a0 con 0x7fbe44002840 2021-05-26T16:45:49.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.681+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe44009e40 con 0x7fbe44002840 2021-05-26T16:45:49.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.682+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fbe60002ab0 con 0x7fbe44002840 2021-05-26T16:45:49.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.682+0000 7fbe52ffd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.682+0000 7fbe52ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:49.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.682+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6792/0 conn(0x7fbe44002840 legacy=0x7fbe44004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.749 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.682+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6792/0 conn(0x7fbe44002840 legacy=0x7fbe44004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:49.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.688+0000 7fbe71233700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:49.751 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.688+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbe44009ad0 con 0x7fbe44008d90 2021-05-26T16:45:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe6ad9d700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6792/0 conn(0x7fbe44008d90 legacy=0x7fbe44009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109668711 0 0) 0x7fbe44009ad0 con 0x7fbe44008d90 2021-05-26T16:45:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 10 monclient(hunting): my global_id is 104722 2021-05-26T16:45:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe440065a0 con 0x7fbe44008d90 2021-05-26T16:45:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4100025520 0 0) 0x7fbe440065a0 con 0x7fbe44008d90 2021-05-26T16:45:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe44009ad0 con 0x7fbe44008d90 2021-05-26T16:45:49.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbe60002d60 con 0x7fbe44008d90 2021-05-26T16:45:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 10 monclient: dump: 2021-05-26T16:45:49.754 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.755 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.756 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.757 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.758 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3116218312 0 0) 0x7fbe44009ad0 con 0x7fbe44008d90 2021-05-26T16:45:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.691+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 --> v1:172.21.15.137:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbe44008740 con 0x7fbe44008d90 2021-05-26T16:45:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 1609629969) 0x7fbe60007ba0 con 0x7fbe44008d90 2021-05-26T16:45:49.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe52ffd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:49.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe52ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:49.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6792/0 conn(0x7fbe44008d90 legacy=0x7fbe44009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe52ffd700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6792/0 conn(0x7fbe44008d90 legacy=0x7fbe44009220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:49.760 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:49.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:49.760 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:49.760 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:49.760 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:49.761 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:49.761 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:49.761 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:49.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:49.761 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:49.762 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:49.762 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:49.762 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:49.762 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:49.763 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:49.763 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.763 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 3, 2021-05-26T16:45:49.763 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:49.763 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:49.764 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:49.764 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.764 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.764 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.764 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.765 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.765 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.765 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.765 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.765 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.766 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.766 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:49.766 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:49.766 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.767 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.767 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.767 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.767 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.767 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.768 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.768 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.768 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.768 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.768 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.769 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:49.769 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:49.769 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:49.769 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:49.770 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:49.770 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:49.770 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:49.770 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:49.770 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:49.771 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:49.771 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:49.771 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:49.771 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:49.771 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:49.772 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:49.772 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:49.772 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:49.772 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:49.772 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:49.773 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:49.773 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:49.773 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:49.773 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:49.773 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:49.774 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.774 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:49.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.774 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:49.774 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.775 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:49.775 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:49.775 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.775 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.775 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.776 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.776 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:49.776 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.776 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.776 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.777 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.777 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:49.777 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.778 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.778 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.778 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.778 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.778 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:49.779 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:49.779 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.779 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.779 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.779 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.780 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:49.780 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.780 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.780 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.781 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.781 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:49.781 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.781 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.782 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.782 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.782 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:49.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:49.783 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.783 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.783 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.783 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.784 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:49.784 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.784 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.784 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.785 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.785 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:49.785 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.785 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.785 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.786 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.786 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:49.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:49.787 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.787 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.787 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.787 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.787 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:49.788 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.788 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.788 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.788 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.789 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:49.789 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.789 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.789 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.790 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.790 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:49.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:49.790 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.791 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.791 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.791 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.791 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:49.792 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.792 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.792 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.792 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.793 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:49.793 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.793 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.793 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.794 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.794 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:49.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:49.794 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.795 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.795 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.795 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.795 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:49.795 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.796 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.796 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.796 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.796 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:49.796 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.797 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.797 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.797 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.798 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:49.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:49.798 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.798 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.798 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.799 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.799 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:49.799 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.799 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.800 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.800 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.800 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:49.800 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.801 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.801 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.801 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.801 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:49.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:49.802 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.802 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.802 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.803 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.803 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:49.803 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.803 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.803 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.804 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.804 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:49.804 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.804 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.805 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.805 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.805 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.805 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:49.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:49.806 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:49.806 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:49.806 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.806 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:49.806 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:49.807 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:49.807 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.807 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.808 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.808 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:49.808 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:49.808 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:49.808 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:49.809 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.809 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.809 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:49.809 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:49.810 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.810 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.810 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.810 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:49.811 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.811 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:49.811 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:49.811 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:49.811 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:49.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:49.813 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:49.813 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:49.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.137:6812/30003 conn(0x7fbe4c033270 legacy=0x7fbe4c035730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 10 monclient: shutdown 2021-05-26T16:45:49.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 >> v1:172.21.15.3:6789/0 conn(0x7fbe6c09a260 legacy=0x7fbe6c144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe6b59e700 1 -- 172.21.15.3:0/427125892 reap_dead start 2021-05-26T16:45:49.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe6b59e700 1 -- 172.21.15.3:0/427125892 reap_dead start 2021-05-26T16:45:49.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 shutdown_connections 2021-05-26T16:45:49.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 >> 172.21.15.3:0/427125892 conn(0x7fbe6c09cc00 msgr2=0x7fbe6c098c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 shutdown_connections 2021-05-26T16:45:49.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.692+0000 7fbe71233700 1 -- 172.21.15.3:0/427125892 wait complete. 2021-05-26T16:45:49.817 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-05-26T16:45:49.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-05-26T16:45:49.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.930+0000 7f36b07ed700 10 monclient: get_monmap_and_config 2021-05-26T16:45:49.933 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.930+0000 7f36b07ed700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.934 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.930+0000 7f36b07ed700 10 monclient: monmap: 2021-05-26T16:45:49.934 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.934 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.934 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:49.931429+0000 2021-05-26T16:45:49.935 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:49.931429+0000 2021-05-26T16:45:49.935 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.935 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.935 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.935 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.936 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.936 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.936 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.936 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.937 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.937 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.937 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.937 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.937 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.931+0000 7f36b07ed700 1 Processor -- start 2021-05-26T16:45:49.938 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.931+0000 7f36b07ed700 1 -- start start 2021-05-26T16:45:49.938 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.931+0000 7f36b07ed700 10 monclient: init 2021-05-26T16:45:49.946 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 10 monclient: _add_conns ranks=[5,6,1,0,3,8,2,7,4] 2021-05-26T16:45:49.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 10 monclient(hunting): picked mon.noname-h con 0x7f36a8096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:49.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 10 monclient(hunting): picked mon.noname-d con 0x7f36a8099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:49.947 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 10 monclient(hunting): picked mon.noname-f con 0x7f36a809a260 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:49.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a8059750 con 0x7f36a809a260 2021-05-26T16:45:49.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a8064620 con 0x7f36a8096ca0 2021-05-26T16:45:49.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a8064e50 con 0x7f36a8099db0 2021-05-26T16:45:49.948 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36b07ed700 10 monclient(hunting): authenticate will time out at 1107.563204s 2021-05-26T16:45:49.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36add88700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f36a8099db0 0x7f36a8132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58696/0 (socket says 172.21.15.3:58696) 2021-05-26T16:45:49.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.932+0000 7f36add88700 1 -- 172.21.15.3:0/4101468191 learned_addr learned my addr 172.21.15.3:0/4101468191 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36add88700 1 -- 172.21.15.3:0/4101468191 >> v1:172.21.15.3:6792/0 conn(0x7f36a8099db0 legacy=0x7f36a8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.949 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36aed8a700 1 -- 172.21.15.3:0/4101468191 >> v1:172.21.15.137:6789/0 conn(0x7f36a809a260 legacy=0x7f36a81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ae589700 1 -- 172.21.15.3:0/4101468191 >> v1:172.21.15.137:6791/0 conn(0x7f36a8096ca0 legacy=0x7f36a8063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704858136 0 0) 0x7f36a8064e50 con 0x7f36a8099db0 2021-05-26T16:45:49.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.950 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 10 monclient(hunting): my global_id is 5604 2021-05-26T16:45:49.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3690003270 con 0x7f36a8099db0 2021-05-26T16:45:49.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3456442420 0 0) 0x7f3690003270 con 0x7f36a8099db0 2021-05-26T16:45:49.951 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 >> v1:172.21.15.137:6791/0 conn(0x7f36a8096ca0 legacy=0x7f36a8063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 >> v1:172.21.15.137:6789/0 conn(0x7f36a809a260 legacy=0x7f36a81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 monclient: found mon.noname-d 2021-05-26T16:45:49.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.952 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:45:49.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a809c390 con 0x7f36a8099db0 2021-05-26T16:45:49.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.953 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36b07ed700 5 monclient: authenticate success, global_id 5604 2021-05-26T16:45:49.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36b07ed700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:49.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3698001a60 con 0x7f36a8099db0 2021-05-26T16:45:49.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.934+0000 7f36ad587700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.954 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:49.955 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 10 monclient: dump: 2021-05-26T16:45:49.955 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.955 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.955 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.955 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.956 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.956 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.956 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.956 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.957 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.957 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.957 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.957 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.957 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.958 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.958 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.958 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.958 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:49.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3698001d70 con 0x7f36a8099db0 2021-05-26T16:45:49.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:49.959 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 1 -- 172.21.15.3:0/4101468191 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3698004930 con 0x7f36a8099db0 2021-05-26T16:45:49.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 4 set_mon_vals no callback set 2021-05-26T16:45:49.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:49.960 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36ad587700 10 monclient: dump: 2021-05-26T16:45:49.960 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.961 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.961 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.961 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.961 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.961 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.962 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.962 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.962 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.963 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.963 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.963 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.963 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.963 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.964 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.964 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 10 monclient: shutdown 2021-05-26T16:45:49.964 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:49.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 1 -- 172.21.15.3:0/4101468191 >> v1:172.21.15.3:6792/0 conn(0x7f36a8099db0 legacy=0x7f36a8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 1 -- 172.21.15.3:0/4101468191 shutdown_connections 2021-05-26T16:45:49.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 1 -- 172.21.15.3:0/4101468191 >> 172.21.15.3:0/4101468191 conn(0x7f36a809cc00 msgr2=0x7f36a809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:49.965 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 1 -- 172.21.15.3:0/4101468191 shutdown_connections 2021-05-26T16:45:49.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.935+0000 7f36b07ed700 1 -- 172.21.15.3:0/4101468191 wait complete. 2021-05-26T16:45:49.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient: build_initial_monmap 2021-05-26T16:45:49.966 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient: monmap: 2021-05-26T16:45:49.966 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:49.966 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:49.967 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:49.967 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:49.967 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:49.967 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.968 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:49.968 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:49.968 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:49.968 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:49.970 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 1 Processor -- start 2021-05-26T16:45:49.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 1 -- start start 2021-05-26T16:45:49.970 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient: init 2021-05-26T16:45:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient: _add_conns ranks=[7,4,5,8,0,6,3,1,2] 2021-05-26T16:45:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient(hunting): picked mon.noname-i con 0x7f36a8096ca0 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient(hunting): picked mon.noname-c con 0x7f36a8099db0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient(hunting): picked mon.noname-h con 0x7f36a809a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a809bfb0 con 0x7f36a8099db0 2021-05-26T16:45:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a809bce0 con 0x7f36a809a260 2021-05-26T16:45:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a811d1a0 con 0x7f36a8096ca0 2021-05-26T16:45:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.936+0000 7f36b07ed700 10 monclient(hunting): authenticate will time out at 1107.567956s 2021-05-26T16:45:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.937+0000 7f36add88700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f36a8099db0 0x7f36a813bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38814/0 (socket says 172.21.15.3:38814) 2021-05-26T16:45:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.937+0000 7f36add88700 1 -- 172.21.15.3:0/1907808372 learned_addr learned my addr 172.21.15.3:0/1907808372 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36add88700 1 -- 172.21.15.3:0/1907808372 >> v1:172.21.15.3:6791/0 conn(0x7f36a8099db0 legacy=0x7f36a813bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902918399 0 0) 0x7f36a809bfb0 con 0x7f36a8099db0 2021-05-26T16:45:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36ae589700 1 -- 172.21.15.3:0/1907808372 >> v1:172.21.15.137:6792/0 conn(0x7f36a8096ca0 legacy=0x7f36a81299a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): my global_id is 114151 2021-05-26T16:45:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3688003270 con 0x7f36a8099db0 2021-05-26T16:45:49.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36aed8a700 1 -- 172.21.15.3:0/1907808372 >> v1:172.21.15.137:6791/0 conn(0x7f36a809a260 legacy=0x7f36a8143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:49.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844335095 0 0) 0x7f36a809bce0 con 0x7f36a809a260 2021-05-26T16:45:49.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.975 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): my global_id is 5738 2021-05-26T16:45:49.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a809bfb0 con 0x7f36a809a260 2021-05-26T16:45:49.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737496964 0 0) 0x7f36a811d1a0 con 0x7f36a8096ca0 2021-05-26T16:45:49.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:49.976 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:49.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): my global_id is 104731 2021-05-26T16:45:49.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a809bce0 con 0x7f36a8096ca0 2021-05-26T16:45:49.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2893320750 0 0) 0x7f3688003270 con 0x7f36a8099db0 2021-05-26T16:45:49.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f36a811d1a0 con 0x7f36a8099db0 2021-05-26T16:45:49.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3698004870 con 0x7f36a8099db0 2021-05-26T16:45:49.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:49.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): dump: 2021-05-26T16:45:49.978 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.979 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.979 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.979 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.979 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.980 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.980 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.980 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.980 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.980 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.982 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.982 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:49.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4069701453 0 0) 0x7f36a811d1a0 con 0x7f36a8099db0 2021-05-26T16:45:49.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 >> v1:172.21.15.137:6792/0 conn(0x7f36a8096ca0 legacy=0x7f36a81299a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 >> v1:172.21.15.137:6791/0 conn(0x7f36a809a260 legacy=0x7f36a8143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:49.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient: _finish_hunting 0 2021-05-26T16:45:49.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 monclient: found mon.c 2021-05-26T16:45:49.983 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:49.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a811d440 con 0x7f36a8099db0 2021-05-26T16:45:49.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient: _finish_auth 0 2021-05-26T16:45:49.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:49.984 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36b07ed700 5 monclient: authenticate success, global_id 114151 2021-05-26T16:45:49.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36b07ed700 10 monclient: _renew_subs 2021-05-26T16:45:49.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36b07ed700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a813c320 con 0x7f36a8099db0 2021-05-26T16:45:49.985 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36b07ed700 10 monclient: _renew_subs 2021-05-26T16:45:49.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36b07ed700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a811bf70 con 0x7f36a8099db0 2021-05-26T16:45:49.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3698001a70 con 0x7f36a8099db0 2021-05-26T16:45:49.986 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:49.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3698005260 con 0x7f36a8099db0 2021-05-26T16:45:49.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36967fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:49.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.939+0000 7f36acd86700 4 set_mon_vals no callback set 2021-05-26T16:45:49.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36967fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:49.987 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36967fc700 10 monclient: dump: 2021-05-26T16:45:49.988 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:49.988 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:49.988 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.988 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:49.988 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:49.989 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:49.989 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:49.989 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:49.989 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:49.990 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:49.990 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:49.990 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:49.990 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:49.991 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:49.991 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:49.991 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:49.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f369800e7d0 con 0x7f36a8099db0 2021-05-26T16:45:49.991 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(205..205 src has 1..205) v4 ==== 3941+0+0 (unknown 371714674 0 0) 0x7f369803dc40 con 0x7f36a8099db0 2021-05-26T16:45:49.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36ae589700 10 monclient: get_auth_request con 0x7f3688032b10 auth_method 0 2021-05-26T16:45:49.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36b07ed700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36b07ed700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.992 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36b07ed700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:49.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.940+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c004db0 con 0x7f36a8099db0 2021-05-26T16:45:49.993 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.945+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7f3698013790 con 0x7f36a8099db0 2021-05-26T16:45:49.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.945+0000 7f36967fc700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:49.994 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:49.945+0000 7f36967fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:50.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.165+0000 7f36b07ed700 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2021-05-26T16:45:50.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.165+0000 7f36b07ed700 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2021-05-26T16:45:50.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.165+0000 7f36b07ed700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:50.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.165+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 --> v1:172.21.15.3:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f368c005870 con 0x7f36a8099db0 2021-05-26T16:45:50.169 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.166+0000 7f36967fc700 1 -- 172.21.15.3:0/1907808372 <== mon.4 v1:172.21.15.3:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7f3698013380 con 0x7f36a8099db0 2021-05-26T16:45:50.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f36967fc700 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2021-05-26T16:45:50.170 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f36967fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:50.173 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.173 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.173 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=12,kv=6,logm=60} crc {auth=3094374621,config=3140514009,health=3359746853,kv=2777291952,logm=3995947335}) 2021-05-26T16:45:50.173 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.174 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.174 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=2,health=12,kv=5,logm=61} crc {auth=3094374621,config=3140514009,health=3359746853,kv=3821257401,logm=1446188116}) 2021-05-26T16:45:50.174 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.174 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.175 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=318090938,config=3140514009,health=3359746853,kv=2777291952,logm=4253175140}) 2021-05-26T16:45:50.175 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.175 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.176 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=20,config=2,health=9,kv=6,logm=63} crc {auth=3094374621,config=3140514009,health=3690624906,kv=2777291952,logm=1909283458}) 2021-05-26T16:45:50.176 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.176 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.176 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=12,kv=6,logm=62} crc {auth=138525190,config=3140514009,health=3359746853,kv=2777291952,logm=2987490064}) 2021-05-26T16:45:50.177 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.177 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.177 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=20,config=2,health=12,kv=6,logm=60} crc {auth=3094374621,config=3140514009,health=1783898129,kv=2777291952,logm=2688170332}) 2021-05-26T16:45:50.177 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.178 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.178 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=2,health=11,kv=6,logm=62} crc {auth=1272807006,config=3140514009,health=3770515234,kv=2777291952,logm=1181273984}) 2021-05-26T16:45:50.178 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.178 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3508965633,config=3140514009,health=3359746853,kv=2777291952,logm=252233711}) 2021-05-26T16:45:50.179 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.167+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=20,config=2,health=9,kv=6,logm=63} crc {auth=3094374621,config=3140514009,health=637401008,kv=2777291952,logm=3562561181}) 2021-05-26T16:45:50.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 >> v1:172.21.15.137:6812/30003 conn(0x7f3688032b10 legacy=0x7f3688034fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:50.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 10 monclient: shutdown 2021-05-26T16:45:50.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:50.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 >> v1:172.21.15.3:6791/0 conn(0x7f36a8099db0 legacy=0x7f36a813bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:50.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 shutdown_connections 2021-05-26T16:45:50.181 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 >> 172.21.15.3:0/1907808372 conn(0x7f36a809cc00 msgr2=0x7f36a809df10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:50.181 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.182 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.182 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3104294840}) 2021-05-26T16:45:50.182 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.182 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.183 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3884468975}) 2021-05-26T16:45:50.183 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 shutdown_connections 2021-05-26T16:45:50.184 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.184 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f36b07ed700 1 -- 172.21.15.3:0/1907808372 wait complete. 2021-05-26T16:45:50.190 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1602318546}) 2021-05-26T16:45:50.190 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.190 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.190 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=704116795}) 2021-05-26T16:45:50.191 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.191 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.191 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2997715205}) 2021-05-26T16:45:50.191 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.192 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.192 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=301400853}) 2021-05-26T16:45:50.192 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.192 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.192 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4231298437}) 2021-05-26T16:45:50.193 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.193 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205990274}) 2021-05-26T16:45:50.193 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.169+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=297586988}) 2021-05-26T16:45:50.193 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.193 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.194 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=435896237}) 2021-05-26T16:45:50.194 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.194 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.194 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2262551156}) 2021-05-26T16:45:50.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1603176315}) 2021-05-26T16:45:50.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.196 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.196 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2640481560}) 2021-05-26T16:45:50.196 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.196 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.196 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3664562136}) 2021-05-26T16:45:50.197 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.197 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.197 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3511527149}) 2021-05-26T16:45:50.197 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.197 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.198 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.176+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2115345245}) 2021-05-26T16:45:50.198 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.177+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.198 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.177+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241464964}) 2021-05-26T16:45:50.198 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.177+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3765002163}) 2021-05-26T16:45:50.199 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.199 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.199 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942819735}) 2021-05-26T16:45:50.200 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.200 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.200 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=369117900}) 2021-05-26T16:45:50.200 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.200 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.201 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1855917632}) 2021-05-26T16:45:50.201 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.201 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.201 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1882132973}) 2021-05-26T16:45:50.202 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.202 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.202 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4057069077}) 2021-05-26T16:45:50.202 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.202 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.203 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1745353169}) 2021-05-26T16:45:50.203 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.203 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.203 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2914974147}) 2021-05-26T16:45:50.204 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.204 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2870463248}) 2021-05-26T16:45:50.204 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.183+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=370828815}) 2021-05-26T16:45:50.205 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-05-26T16:45:50.237 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.237 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.237 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=46} crc {logm=2668176411,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=2559827177,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=2928563162,osdmap=1445953289}) 2021-05-26T16:45:50.238 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.238 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.238 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=15,mdsmap=2,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=4,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=50} crc {logm=2682684742,mdsmap=3585761405,mgr=3884139035,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=1332081842,mon_config_key=2640620570,monmap=1956297588,osd_metadata=3457011954,osd_pg_creating=2928563162,osdmap=1106463446}) 2021-05-26T16:45:50.238 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.238 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.232+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.239 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=14,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=4,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=1186083591,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=2640620570,monmap=3140514009,osd_metadata=1902142961,osd_pg_creating=2928563162,osdmap=919357578}) 2021-05-26T16:45:50.239 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.239 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.239 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=15,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=49} crc {logm=1793556280,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=3894403795,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1759680956,osd_pg_creating=2928563162,osdmap=2600825191}) 2021-05-26T16:45:50.240 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.240 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.240 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=45} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=3728141238,mon_config_key=2310641763,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=2928563162,osdmap=867706646}) 2021-05-26T16:45:50.240 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.241 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.241 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=4,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=46} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=2640620570,monmap=82091487,osd_metadata=1902142962,osd_pg_creating=2928563162,osdmap=3260190980}) 2021-05-26T16:45:50.241 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.241 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.242 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=15,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=186852957,mdsmap=1531151339,mgr=2401461864,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=3749102620,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1902142961,osd_pg_creating=2928563162,osdmap=2330811566}) 2021-05-26T16:45:50.242 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.242 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=2,monmap=3,osd_metadata=6,osdmap=48} crc {logm=1060942573,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgr_metadata=3215074340,mgrstat=247519874,mon_config_key=3312846214,monmap=1956297588,osd_metadata=1902142961,osdmap=3771907481}) 2021-05-26T16:45:50.242 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.233+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=14,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=11,mon_config_key=4,monmap=3,osd_metadata=5,osdmap=52} crc {logm=3478983187,mdsmap=1531151339,mgr=2631599771,mgr_command_descs=2322758115,mgrstat=66400808,mon_config_key=2640620570,monmap=1956297588,osd_metadata=1096450327,osdmap=3502515365}) 2021-05-26T16:45:50.262 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.262 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.262 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2932085865}) 2021-05-26T16:45:50.262 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.263 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.263 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3356304090}) 2021-05-26T16:45:50.263 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.263 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3910050}) 2021-05-26T16:45:50.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3405282717}) 2021-05-26T16:45:50.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.265 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.265 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=569074242}) 2021-05-26T16:45:50.265 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.265 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.267 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2137916811}) 2021-05-26T16:45:50.267 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.267 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.267 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=4221552132}) 2021-05-26T16:45:50.268 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.268 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=818074057}) 2021-05-26T16:45:50.268 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.257+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=4290424200}) 2021-05-26T16:45:50.319 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36386]: starting. 2021-05-26T16:45:50.319 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36386]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36385 2021-05-26T16:45:50.319 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36386]: created object 0... 2021-05-26T16:45:50.319 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36386]: created object 25... 2021-05-26T16:45:50.320 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36386]: created object 49... 2021-05-26T16:45:50.320 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36386]: finishing. 2021-05-26T16:45:50.320 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36386]: shutting down. 2021-05-26T16:45:50.679 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.679 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.680 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3989107473}) 2021-05-26T16:45:50.680 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.680 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.680 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3007084872}) 2021-05-26T16:45:50.681 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.681 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.681 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2089970581}) 2021-05-26T16:45:50.681 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.681 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.682 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=197103728}) 2021-05-26T16:45:50.682 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.682 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.682 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1364038731}) 2021-05-26T16:45:50.683 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.683 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.683 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=4249897395}) 2021-05-26T16:45:50.683 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.683 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.684 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=952011464}) 2021-05-26T16:45:50.684 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.684 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2489556609}) 2021-05-26T16:45:50.684 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.675+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3022111458}) 2021-05-26T16:45:50.688 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.683+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.688 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.688 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=57} crc {osdmap=1646184973}) 2021-05-26T16:45:50.688 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.689 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.689 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=57} crc {osdmap=231026431}) 2021-05-26T16:45:50.689 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.689 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.690 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=60} crc {osdmap=4014593578}) 2021-05-26T16:45:50.690 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.690 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.690 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=57} crc {osdmap=1675670714}) 2021-05-26T16:45:50.691 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.691 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.691 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=58} crc {osdmap=2730968746}) 2021-05-26T16:45:50.691 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.691 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.692 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=56} crc {osdmap=365767469}) 2021-05-26T16:45:50.692 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.692 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.692 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=58} crc {osdmap=2438784339}) 2021-05-26T16:45:50.692 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-05-26T16:45:50.693 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=2249822838}) 2021-05-26T16:45:50.693 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:45:50.684+0000 7f789a7d2700 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=58} crc {osdmap=772555615}) 2021-05-26T16:45:51.199 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36387]: starting. 2021-05-26T16:45:51.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36387]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36385 2021-05-26T16:45:51.200 INFO:teuthology.orchestra.run.smithi137.stdout:process_2_[36387]: shutting down. 2021-05-26T16:45:51.206 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2021-05-26T16:45:51.207 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-05-26T16:45:51.343 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.341+0000 7fc00ffff700 10 monclient: get_monmap_and_config 2021-05-26T16:45:51.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.341+0000 7fc00ffff700 10 monclient: build_initial_monmap 2021-05-26T16:45:51.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.341+0000 7fc00ffff700 10 monclient: monmap: 2021-05-26T16:45:51.344 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:51.342325+0000 2021-05-26T16:45:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:51.342325+0000 2021-05-26T16:45:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.346 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:51.346 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:51.346 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:51.347 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:51.347 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:51.347 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:51.347 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:51.348 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 1 Processor -- start 2021-05-26T16:45:51.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 1 -- start start 2021-05-26T16:45:51.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 10 monclient: init 2021-05-26T16:45:51.357 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:51.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 10 monclient: _add_conns ranks=[5,2,8,0,1,3,6,7,4] 2021-05-26T16:45:51.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 10 monclient(hunting): picked mon.noname-h con 0x7fc010129770 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:51.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 10 monclient(hunting): picked mon.noname-b con 0x7fc010096d10 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:51.358 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 10 monclient(hunting): picked mon.noname-e con 0x7fc01012a050 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:51.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc010046600 con 0x7fc010096d10 2021-05-26T16:45:51.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01009c5d0 con 0x7fc010129770 2021-05-26T16:45:51.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00ffff700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01012a4c0 con 0x7fc01012a050 2021-05-26T16:45:51.359 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.343+0000 7fc00ffff700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:51.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00f7fe700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fc01012a050 0x7fc010135750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54392/0 (socket says 172.21.15.3:54392) 2021-05-26T16:45:51.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.342+0000 7fc00e7fc700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fc010096d10 0x7fc010132020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55352/0 (socket says 172.21.15.3:55352) 2021-05-26T16:45:51.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.343+0000 7fc00f7fe700 1 -- 172.21.15.3:0/4128342647 learned_addr learned my addr 172.21.15.3:0/4128342647 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:51.360 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.343+0000 7fc00ffff700 10 monclient(hunting): authenticate will time out at 1108.974015s 2021-05-26T16:45:51.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00e7fc700 1 -- 172.21.15.3:0/4128342647 >> v1:172.21.15.3:6790/0 conn(0x7fc010096d10 legacy=0x7fc010132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00f7fe700 1 -- 172.21.15.3:0/4128342647 >> v1:172.21.15.3:6793/0 conn(0x7fc01012a050 legacy=0x7fc010135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00effd700 1 -- 172.21.15.3:0/4128342647 >> v1:172.21.15.137:6791/0 conn(0x7fc010129770 legacy=0x7fc010099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174648411 0 0) 0x7fc01012a4c0 con 0x7fc01012a050 2021-05-26T16:45:51.361 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient(hunting): my global_id is 104849 2021-05-26T16:45:51.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbffc003270 con 0x7fc01012a050 2021-05-26T16:45:51.362 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3306765549 0 0) 0x7fbffc003270 con 0x7fc01012a050 2021-05-26T16:45:51.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 >> v1:172.21.15.137:6791/0 conn(0x7fc010129770 legacy=0x7fc010099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 >> v1:172.21.15.3:6790/0 conn(0x7fc010096d10 legacy=0x7fc010132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:51.363 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 monclient: found mon.noname-e 2021-05-26T16:45:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:45:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010097580 con 0x7fc01012a050 2021-05-26T16:45:51.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:51.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:51.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc000001de0 con 0x7fc01012a050 2021-05-26T16:45:51.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00ffff700 5 monclient: authenticate success, global_id 104849 2021-05-26T16:45:51.365 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00ffff700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:51.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:51.366 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: dump: 2021-05-26T16:45:51.367 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.367 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.367 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.367 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.368 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.368 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.368 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.368 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.368 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.369 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.369 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.369 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.369 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.370 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.370 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.370 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00ffff700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:51.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc0000020f0 con 0x7fc01012a050 2021-05-26T16:45:51.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:51.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00ffff700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:51.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 1 -- 172.21.15.3:0/4128342647 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fc000004cb0 con 0x7fc01012a050 2021-05-26T16:45:51.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00ffff700 4 set_mon_vals no callback set 2021-05-26T16:45:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.345+0000 7fc00dffb700 10 monclient: dump: 2021-05-26T16:45:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.373 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.373 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.373 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.373 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.373 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.374 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.374 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.374 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.374 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.374 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.375 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.375 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.375 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.375 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.375 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 10 monclient: shutdown 2021-05-26T16:45:51.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:51.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 1 -- 172.21.15.3:0/4128342647 >> v1:172.21.15.3:6793/0 conn(0x7fc01012a050 legacy=0x7fc010135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 1 -- 172.21.15.3:0/4128342647 shutdown_connections 2021-05-26T16:45:51.376 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 1 -- 172.21.15.3:0/4128342647 >> 172.21.15.3:0/4128342647 conn(0x7fc01009ff30 msgr2=0x7fc0100a0340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:51.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 1 -- 172.21.15.3:0/4128342647 shutdown_connections 2021-05-26T16:45:51.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 1 -- 172.21.15.3:0/4128342647 wait complete. 2021-05-26T16:45:51.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 10 monclient: build_initial_monmap 2021-05-26T16:45:51.377 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.346+0000 7fc00ffff700 10 monclient: monmap: 2021-05-26T16:45:51.378 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:51.378 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:51.378 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:51.378 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:51.378 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:51.379 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.379 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:51.379 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:51.379 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:51.381 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 1 Processor -- start 2021-05-26T16:45:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 1 -- start start 2021-05-26T16:45:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient: init 2021-05-26T16:45:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient: _add_conns ranks=[4,0,2,3,7,5,8,6,1] 2021-05-26T16:45:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient(hunting): picked mon.noname-c con 0x7fc010096d10 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient(hunting): picked mon.noname-a con 0x7fc010129770 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient(hunting): picked mon.noname-b con 0x7fc01012a050 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:51.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01009c080 con 0x7fc010129770 2021-05-26T16:45:51.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc010096170 con 0x7fc01012a050 2021-05-26T16:45:51.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc010096410 con 0x7fc010096d10 2021-05-26T16:45:51.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:51.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00ffff700 10 monclient(hunting): authenticate will time out at 1108.978880s 2021-05-26T16:45:51.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00f7fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7fc01012a050 0x7fc010144a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55358/0 (socket says 172.21.15.3:55358) 2021-05-26T16:45:51.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.347+0000 7fc00f7fe700 1 -- 172.21.15.3:0/3926128765 learned_addr learned my addr 172.21.15.3:0/3926128765 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:51.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00effd700 1 -- 172.21.15.3:0/3926128765 >> v1:172.21.15.3:6791/0 conn(0x7fc010096d10 legacy=0x7fc0101286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00f7fe700 1 -- 172.21.15.3:0/3926128765 >> v1:172.21.15.3:6790/0 conn(0x7fc01012a050 legacy=0x7fc010144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00e7fc700 1 -- 172.21.15.3:0/3926128765 >> v1:172.21.15.3:6789/0 conn(0x7fc010129770 legacy=0x7fc010141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308539000 0 0) 0x7fc01009c080 con 0x7fc010129770 2021-05-26T16:45:51.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient(hunting): my global_id is 104904 2021-05-26T16:45:51.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff0003270 con 0x7fc010129770 2021-05-26T16:45:51.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3546043010 0 0) 0x7fbff0003270 con 0x7fc010129770 2021-05-26T16:45:51.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc01009c080 con 0x7fc010129770 2021-05-26T16:45:51.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbff8001d10 con 0x7fc010129770 2021-05-26T16:45:51.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:45:51.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient(hunting): dump: 2021-05-26T16:45:51.387 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.387 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.389 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.389 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.389 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.389 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.389 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.390 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.390 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.390 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.390 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.390 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 618868741 0 0) 0x7fc01009c080 con 0x7fc010129770 2021-05-26T16:45:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 >> v1:172.21.15.3:6791/0 conn(0x7fc010096d10 legacy=0x7fc0101286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 >> v1:172.21.15.3:6790/0 conn(0x7fc01012a050 legacy=0x7fc010144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 monclient: found mon.a 2021-05-26T16:45:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100942a0 con 0x7fc010129770 2021-05-26T16:45:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 10 monclient: _finish_auth 0 2021-05-26T16:45:51.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fbff6ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:51.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00ffff700 5 monclient: authenticate success, global_id 104904 2021-05-26T16:45:51.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00ffff700 10 monclient: _renew_subs 2021-05-26T16:45:51.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00ffff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:51.393 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0100958a0 con 0x7fc010129770 2021-05-26T16:45:51.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00ffff700 10 monclient: _renew_subs 2021-05-26T16:45:51.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00ffff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:51.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.350+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc010131520 con 0x7fc010129770 2021-05-26T16:45:51.394 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbff8004a50 con 0x7fc010129770 2021-05-26T16:45:51.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fbff6ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:51.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fbff8004f00 con 0x7fc010129770 2021-05-26T16:45:51.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fbff6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fc00d7fa700 4 set_mon_vals no callback set 2021-05-26T16:45:51.395 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fbff6ffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:51.396 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fbff6ffd700 10 monclient: dump: 2021-05-26T16:45:51.396 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.396 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.396 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.396 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.397 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.397 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.397 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.397 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.397 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.398 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.398 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.398 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.398 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.399 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.399 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.399 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fbff80050e0 con 0x7fc010129770 2021-05-26T16:45:51.399 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fc00ffff700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fc00ffff700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fc00ffff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.351+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8004db0 con 0x7fc010129770 2021-05-26T16:45:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.352+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(207..207 src has 1..207) v4 ==== 3549+0+0 (unknown 2358273560 0 0) 0x7fbff803d960 con 0x7fc010129770 2021-05-26T16:45:51.401 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.352+0000 7fc00effd700 10 monclient: get_auth_request con 0x7fbff0032950 auth_method 0 2021-05-26T16:45:51.401 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.356+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+153125 (unknown 1092875540 0 970985795) 0x7fbff8013400 con 0x7fc010129770 2021-05-26T16:45:51.402 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.356+0000 7fbff6ffd700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:51.402 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.356+0000 7fbff6ffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:51.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.578+0000 7fc00ffff700 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2021-05-26T16:45:51.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.578+0000 7fc00ffff700 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2021-05-26T16:45:51.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.578+0000 7fc00ffff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:51.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.578+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 --> v1:172.21.15.3:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbfe80055e0 con 0x7fc010129770 2021-05-26T16:45:51.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.578+0000 7fbff6ffd700 1 -- 172.21.15.3:0/3926128765 <== mon.0 v1:172.21.15.3:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+2644 (unknown 254746657 0 2808409945) 0x7fbff8013220 con 0x7fc010129770 2021-05-26T16:45:51.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.578+0000 7fbff6ffd700 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2021-05-26T16:45:51.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.578+0000 7fbff6ffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:51.583 INFO:teuthology.orchestra.run.smithi003.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1c28cdc4-a665-4986-9729-a987ae3508f4","modified":"2021-05-26T16:40:21.025302Z","created":"2021-05-26T16:40:21.025302Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6790","nonce":0}]},"addr":"172.21.15.3:6790/0","public_addr":"172.21.15.3:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6791","nonce":0}]},"addr":"172.21.15.3:6791/0","public_addr":"172.21.15.3:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6791","nonce":0}]},"addr":"172.21.15.137:6791/0","public_addr":"172.21.15.137:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6792","nonce":0}]},"addr":"172.21.15.3:6792/0","public_addr":"172.21.15.3:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.137:6792","nonce":0}]},"addr":"172.21.15.137:6792/0","public_addr":"172.21.15.137:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.3:6793","nonce":0}]},"addr":"172.21.15.3:6793/0","public_addr":"172.21.15.3:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-05-26T16:45:51.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 >> v1:172.21.15.137:6812/30003 conn(0x7fbff0032950 legacy=0x7fbff0034e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 10 monclient: shutdown 2021-05-26T16:45:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 >> v1:172.21.15.3:6789/0 conn(0x7fc010129770 legacy=0x7fc010141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 shutdown_connections 2021-05-26T16:45:51.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 >> 172.21.15.3:0/3926128765 conn(0x7fc01009ff30 msgr2=0x7fc010098200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:51.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 shutdown_connections 2021-05-26T16:45:51.585 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.580+0000 7fc00ffff700 1 -- 172.21.15.3:0/3926128765 wait complete. 2021-05-26T16:45:51.594 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2021-05-26T16:45:51.594 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-05-26T16:45:51.594 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-05-26T16:45:51.709 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.707+0000 7f19cc910700 10 monclient: get_monmap_and_config 2021-05-26T16:45:51.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.707+0000 7f19cc910700 10 monclient: build_initial_monmap 2021-05-26T16:45:51.710 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.707+0000 7f19cc910700 10 monclient: monmap: 2021-05-26T16:45:51.710 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:51.710 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.711 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:51.708114+0000 2021-05-26T16:45:51.711 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:51.708114+0000 2021-05-26T16:45:51.711 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:51.711 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.712 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:51.712 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:51.712 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:51.712 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:51.712 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:51.713 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:51.713 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:51.713 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:51.713 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:51.713 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.724 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 1 Processor -- start 2021-05-26T16:45:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 1 -- start start 2021-05-26T16:45:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient: init 2021-05-26T16:45:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:51.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient: _add_conns ranks=[2,8,3,1,6,7,5,0,4] 2021-05-26T16:45:51.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient(hunting): picked mon.noname-b con 0x7f19c8129770 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:51.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient(hunting): picked mon.noname-e con 0x7f19c8096d10 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:51.726 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient(hunting): picked mon.noname-g con 0x7f19c812a050 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:51.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c8046600 con 0x7f19c8129770 2021-05-26T16:45:51.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c809c5d0 con 0x7f19c812a050 2021-05-26T16:45:51.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c812a4c0 con 0x7f19c8096d10 2021-05-26T16:45:51.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:51.727 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19cc910700 10 monclient(hunting): authenticate will time out at 1109.339750s 2021-05-26T16:45:51.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19c77fe700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f19c8129770 0x7f19c8099ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55364/0 (socket says 172.21.15.3:55364) 2021-05-26T16:45:51.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19c77fe700 1 -- 172.21.15.3:0/2833484770 learned_addr learned my addr 172.21.15.3:0/2833484770 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:51.728 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.708+0000 7f19c6ffd700 1 --1- 172.21.15.3:0/2833484770 >> v1:172.21.15.3:6793/0 conn(0x7f19c8096d10 0x7f19c8132020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54402/0 (socket says 172.21.15.3:54402) 2021-05-26T16:45:51.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c77fe700 1 -- 172.21.15.3:0/2833484770 >> v1:172.21.15.3:6790/0 conn(0x7f19c8129770 legacy=0x7f19c8099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c6ffd700 1 -- 172.21.15.3:0/2833484770 >> v1:172.21.15.3:6793/0 conn(0x7f19c8096d10 legacy=0x7f19c8132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.729 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341137657 0 0) 0x7f19c8046600 con 0x7f19c8129770 2021-05-26T16:45:51.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient(hunting): my global_id is 5591 2021-05-26T16:45:51.730 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ac003270 con 0x7f19c8129770 2021-05-26T16:45:51.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364769627 0 0) 0x7f19c812a4c0 con 0x7f19c8096d10 2021-05-26T16:45:51.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient(hunting): my global_id is 104858 2021-05-26T16:45:51.731 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c8046600 con 0x7f19c8096d10 2021-05-26T16:45:51.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c7fff700 1 -- 172.21.15.3:0/2833484770 >> v1:172.21.15.137:6790/0 conn(0x7f19c812a050 legacy=0x7f19c8135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863375959 0 0) 0x7f19ac003270 con 0x7f19c8129770 2021-05-26T16:45:51.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 >> v1:172.21.15.3:6793/0 conn(0x7f19c8096d10 legacy=0x7f19c8132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.732 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 >> v1:172.21.15.137:6790/0 conn(0x7f19c812a050 legacy=0x7f19c8135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: _finish_hunting 0 2021-05-26T16:45:51.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 monclient: found mon.noname-b 2021-05-26T16:45:51.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:51.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.3:6790/0 2021-05-26T16:45:51.733 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 --> v1:172.21.15.3:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8097580 con 0x7f19c8129770 2021-05-26T16:45:51.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: _finish_auth 0 2021-05-26T16:45:51.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:51.734 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f19b4001a60 con 0x7f19c8129770 2021-05-26T16:45:51.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19cc910700 5 monclient: authenticate success, global_id 5591 2021-05-26T16:45:51.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19cc910700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:51.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2021-05-26T16:45:51.735 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: dump: 2021-05-26T16:45:51.736 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.736 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.736 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.736 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.737 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.737 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.737 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.738 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.738 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.738 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.739 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.739 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.739 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.739 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.740 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.740 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19cc910700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:51.740 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 <== mon.2 v1:172.21.15.3:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f19b4001d70 con 0x7f19c8129770 2021-05-26T16:45:51.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:51.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 1 -- 172.21.15.3:0/2833484770 <== mon.2 v1:172.21.15.3:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f19b4004930 con 0x7f19c8129770 2021-05-26T16:45:51.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19cc910700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:51.741 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19cc910700 4 set_mon_vals no callback set 2021-05-26T16:45:51.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:51.742 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.711+0000 7f19c67fc700 10 monclient: dump: 2021-05-26T16:45:51.743 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.743 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.743 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.743 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.744 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.744 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.744 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.744 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.744 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.745 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.745 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.745 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.745 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.746 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.746 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.746 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 10 monclient: shutdown 2021-05-26T16:45:51.746 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 1 -- 172.21.15.3:0/2833484770 >> v1:172.21.15.3:6790/0 conn(0x7f19c8129770 legacy=0x7f19c8099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 1 -- 172.21.15.3:0/2833484770 shutdown_connections 2021-05-26T16:45:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 1 -- 172.21.15.3:0/2833484770 >> 172.21.15.3:0/2833484770 conn(0x7f19c809ff30 msgr2=0x7f19c80a0340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 1 -- 172.21.15.3:0/2833484770 shutdown_connections 2021-05-26T16:45:51.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 1 -- 172.21.15.3:0/2833484770 wait complete. 2021-05-26T16:45:51.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 10 monclient: build_initial_monmap 2021-05-26T16:45:51.748 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.712+0000 7f19cc910700 10 monclient: monmap: 2021-05-26T16:45:51.748 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:51.749 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:51.749 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:51.749 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:51.749 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:51.751 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:51.751 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:51.751 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:51.751 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:51.752 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:51.752 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:51.752 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.752 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 1 Processor -- start 2021-05-26T16:45:51.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 1 -- start start 2021-05-26T16:45:51.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient: init 2021-05-26T16:45:51.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:51.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient: _add_conns ranks=[8,4,1,7,2,0,6,3,5] 2021-05-26T16:45:51.753 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient(hunting): picked mon.noname-e con 0x7f19c8096d10 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:51.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient(hunting): picked mon.noname-c con 0x7f19c8129770 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:51.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient(hunting): picked mon.noname-f con 0x7f19c812a050 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:51.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c81165d0 con 0x7f19c812a050 2021-05-26T16:45:51.754 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c80933d0 con 0x7f19c8129770 2021-05-26T16:45:51.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c8095d90 con 0x7f19c8096d10 2021-05-26T16:45:51.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19c77fe700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f19c8096d10 0x7f19c80925b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54408/0 (socket says 172.21.15.3:54408) 2021-05-26T16:45:51.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19c77fe700 1 -- 172.21.15.3:0/1177139576 learned_addr learned my addr 172.21.15.3:0/1177139576 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:51.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:51.755 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.713+0000 7f19cc910700 10 monclient(hunting): authenticate will time out at 1109.344852s 2021-05-26T16:45:51.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.715+0000 7f19c77fe700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6793/0 conn(0x7f19c8096d10 legacy=0x7f19c80925b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19c6ffd700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6791/0 conn(0x7f19c8129770 legacy=0x7f19c8092cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183110609 0 0) 0x7f19c8095d90 con 0x7f19c8096d10 2021-05-26T16:45:51.756 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): my global_id is 104867 2021-05-26T16:45:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a8003270 con 0x7f19c8096d10 2021-05-26T16:45:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872880393 0 0) 0x7f19c80933d0 con 0x7f19c8129770 2021-05-26T16:45:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): my global_id is 114169 2021-05-26T16:45:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c8095d90 con 0x7f19c8129770 2021-05-26T16:45:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19c7fff700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.137:6789/0 conn(0x7f19c812a050 legacy=0x7f19c8144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1784987229 0 0) 0x7f19c8095d90 con 0x7f19c8129770 2021-05-26T16:45:51.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19c80933d0 con 0x7f19c8129770 2021-05-26T16:45:51.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f19b8001cc0 con 0x7f19c8129770 2021-05-26T16:45:51.759 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:51.760 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): dump: 2021-05-26T16:45:51.760 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.760 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.764 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456260165 0 0) 0x7f19c81165d0 con 0x7f19c812a050 2021-05-26T16:45:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): my global_id is 5635 2021-05-26T16:45:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c8095d90 con 0x7f19c812a050 2021-05-26T16:45:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1970146820 0 0) 0x7f19a8003270 con 0x7f19c8096d10 2021-05-26T16:45:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19c81165d0 con 0x7f19c8096d10 2021-05-26T16:45:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f19b4004870 con 0x7f19c8096d10 2021-05-26T16:45:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient(hunting): dump: 2021-05-26T16:45:51.767 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.767 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.767 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.767 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.768 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.768 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.768 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.768 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.769 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.769 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.769 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.769 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.770 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.770 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.770 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.770 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3764927552 0 0) 0x7f19c80933d0 con 0x7f19c8129770 2021-05-26T16:45:51.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6793/0 conn(0x7f19c8096d10 legacy=0x7f19c80925b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.771 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.137:6789/0 conn(0x7f19c812a050 legacy=0x7f19c8144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient: _finish_hunting 0 2021-05-26T16:45:51.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 monclient: found mon.c 2021-05-26T16:45:51.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:51.772 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:51.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8096030 con 0x7f19c8129770 2021-05-26T16:45:51.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient: _finish_auth 0 2021-05-26T16:45:51.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:51.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19cc910700 5 monclient: authenticate success, global_id 114169 2021-05-26T16:45:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19cc910700 10 monclient: _renew_subs 2021-05-26T16:45:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19cc910700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c80962d0 con 0x7f19c8129770 2021-05-26T16:45:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19cc910700 10 monclient: _renew_subs 2021-05-26T16:45:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19cc910700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8094e00 con 0x7f19c8129770 2021-05-26T16:45:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f19b80019f0 con 0x7f19c8129770 2021-05-26T16:45:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f19b8004e60 con 0x7f19c8129770 2021-05-26T16:45:51.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19c5ffb700 4 set_mon_vals no callback set 2021-05-26T16:45:51.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:51.776 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.716+0000 7f19b37fe700 10 monclient: dump: 2021-05-26T16:45:51.776 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.777 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.777 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.777 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.777 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.778 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.778 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.778 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.778 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.779 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.779 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.779 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.779 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.779 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.780 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.780 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.717+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f19b800e3d0 con 0x7f19c8129770 2021-05-26T16:45:51.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.717+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(207..207 src has 1..207) v4 ==== 3549+0+0 (unknown 2358273560 0 0) 0x7f19b803d8c0 con 0x7f19c8129770 2021-05-26T16:45:51.781 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.717+0000 7f19cc910700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:51.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.717+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f19a00065a0 con 0x7f19a0002840 2021-05-26T16:45:51.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.717+0000 7f19c77fe700 10 monclient: get_auth_request con 0x7f19a8033030 auth_method 0 2021-05-26T16:45:51.782 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19c7fff700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6789/0 conn(0x7f19a0002840 legacy=0x7f19a0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564453161 0 0) 0x7f19a00065a0 con 0x7f19a0002840 2021-05-26T16:45:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient(hunting): my global_id is 104913 2021-05-26T16:45:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c80933d0 con 0x7f19a0002840 2021-05-26T16:45:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1416863118 0 0) 0x7f19c80933d0 con 0x7f19a0002840 2021-05-26T16:45:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19a00065a0 con 0x7f19a0002840 2021-05-26T16:45:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f19bc001ed0 con 0x7f19a0002840 2021-05-26T16:45:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient: dump: 2021-05-26T16:45:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.787 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.787 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.787 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.787 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.788 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.788 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.788 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.788 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.789 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2649464411 0 0) 0x7f19a00065a0 con 0x7f19a0002840 2021-05-26T16:45:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19a0009e40 con 0x7f19a0002840 2021-05-26T16:45:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f19bc005890 con 0x7f19a0002840 2021-05-26T16:45:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:51.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:51.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6789/0 conn(0x7f19a0002840 legacy=0x7f19a0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.790 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.720+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6789/0 conn(0x7f19a0002840 legacy=0x7f19a0004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:51.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.727+0000 7f19cc910700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:51.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.727+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f19a0007510 con 0x7f19a00068b0 2021-05-26T16:45:51.793 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.729+0000 7f19c7fff700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6789/0 conn(0x7f19a00068b0 legacy=0x7f19a0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:51.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531645501 0 0) 0x7f19a0007510 con 0x7f19a00068b0 2021-05-26T16:45:51.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:51.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:51.794 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient(hunting): my global_id is 104922 2021-05-26T16:45:51.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a00065a0 con 0x7f19a00068b0 2021-05-26T16:45:51.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1934932350 0 0) 0x7f19a00065a0 con 0x7f19a00068b0 2021-05-26T16:45:51.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19a0007510 con 0x7f19a00068b0 2021-05-26T16:45:51.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f19bc0029f0 con 0x7f19a00068b0 2021-05-26T16:45:51.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:51.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:51.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient: dump: 2021-05-26T16:45:51.796 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:51.796 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.797 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.797 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:51.797 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:51.797 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.798 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:51.798 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:51.798 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:51.798 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:51.798 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:51.800 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1231602072 0 0) 0x7f19a0007510 con 0x7f19a00068b0 2021-05-26T16:45:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 --> v1:172.21.15.3:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f19a0008770 con 0x7f19a00068b0 2021-05-26T16:45:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 <== mon.0 v1:172.21.15.3:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7324 (unknown 0 0 3104584930) 0x7f19bc005b60 con 0x7f19a00068b0 2021-05-26T16:45:51.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:51.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:51.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6789/0 conn(0x7f19a00068b0 legacy=0x7f19a0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.801 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.730+0000 7f19b37fe700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6789/0 conn(0x7f19a00068b0 legacy=0x7f19a0006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:51.802 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:51.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:51.802 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:51.803 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "leader", 2021-05-26T16:45:51.803 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:51.803 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:51.804 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:51.804 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:51.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:51.804 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:51.805 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:51.805 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:51.805 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:51.805 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:51.805 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:51.806 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:51.806 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 5, 2021-05-26T16:45:51.806 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:51.806 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:51.807 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:51.807 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:51.807 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:51.807 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:51.808 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:51.808 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:51.808 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:51.808 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:51.823 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.823 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.823 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.824 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.824 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:51.824 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:51.824 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.824 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.825 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.825 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.825 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:51.825 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.826 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.826 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.826 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:51.826 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:51.827 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.827 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.827 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.828 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.828 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:51.828 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:51.828 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.828 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.829 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.829 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.829 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:51.829 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.830 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.830 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.830 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.830 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:51.830 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:51.831 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.831 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.831 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.831 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.832 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.832 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:51.832 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:51.832 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.832 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.833 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.833 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.833 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:51.833 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.834 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.834 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.834 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:51.834 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:51.835 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.835 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.835 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.836 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.836 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:51.836 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:51.836 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.837 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.837 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.837 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.837 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:51.837 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.838 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.838 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.838 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:51.838 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:51.839 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.839 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.839 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.840 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.840 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:51.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:51.840 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.840 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.841 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.841 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.841 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:51.841 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.842 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.842 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.842 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:51.843 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:51.843 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.843 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.843 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.844 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.844 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:51.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:51.844 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.845 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.845 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.845 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.845 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:51.846 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.846 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.846 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.846 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:51.847 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:51.847 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.847 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.847 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.848 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.848 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:51.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:51.848 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.849 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.849 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.849 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.849 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:51.850 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.850 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.850 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.851 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:51.851 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:51.851 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.851 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.851 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.852 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.852 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:51.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:51.853 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:51.853 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:51.853 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.853 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:51.853 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:51.854 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:51.854 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.854 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.855 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:51.855 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:51.855 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:51.855 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:51.856 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:51.856 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.856 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.856 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:51.857 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:51.857 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.857 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:51.857 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:51.857 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:51.858 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.858 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:51.858 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:51.858 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:51.859 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:51.859 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:51.859 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:51.859 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:51.859 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:51.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:51.860 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:51.860 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:51.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.137:6812/30003 conn(0x7f19a8033030 legacy=0x7f19a80354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 10 monclient: shutdown 2021-05-26T16:45:51.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:51.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 >> v1:172.21.15.3:6791/0 conn(0x7f19c8129770 legacy=0x7f19c8092cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:51.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19c7fff700 1 -- 172.21.15.3:0/1177139576 reap_dead start 2021-05-26T16:45:51.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 shutdown_connections 2021-05-26T16:45:51.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 >> 172.21.15.3:0/1177139576 conn(0x7f19c809ff30 msgr2=0x7f19c8098760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:51.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 shutdown_connections 2021-05-26T16:45:51.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.731+0000 7f19cc910700 1 -- 172.21.15.3:0/1177139576 wait complete. 2021-05-26T16:45:51.864 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-05-26T16:45:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.979+0000 7fe106dcc700 10 monclient: get_monmap_and_config 2021-05-26T16:45:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.979+0000 7fe106dcc700 10 monclient: build_initial_monmap 2021-05-26T16:45:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.979+0000 7fe106dcc700 10 monclient: monmap: 2021-05-26T16:45:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:51.983 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:51.979890+0000 2021-05-26T16:45:51.983 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:51.979890+0000 2021-05-26T16:45:51.983 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:51.983 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:51.984 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:51.984 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:51.984 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:51.984 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:51.984 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:51.985 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:51.985 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:51.985 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:51.985 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:51.986 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:51.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.979+0000 7fe106dcc700 1 Processor -- start 2021-05-26T16:45:51.997 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 1 -- start start 2021-05-26T16:45:51.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient: init 2021-05-26T16:45:51.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:51.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient: _add_conns ranks=[5,0,8,6,2,7,4,1,3] 2021-05-26T16:45:51.998 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient(hunting): picked mon.noname-h con 0x7fe100096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:51.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient(hunting): picked mon.noname-a con 0x7fe100099db0 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:51.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient(hunting): picked mon.noname-e con 0x7fe10009a260 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:51.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe100059750 con 0x7fe100099db0 2021-05-26T16:45:51.999 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe100064620 con 0x7fe100096ca0 2021-05-26T16:45:52.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe100064e50 con 0x7fe10009a260 2021-05-26T16:45:52.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe106dcc700 10 monclient(hunting): authenticate will time out at 1109.611507s 2021-05-26T16:45:52.000 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe0f7fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe100099db0 0x7fe100132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53340/0 (socket says 172.21.15.3:53340) 2021-05-26T16:45:52.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe0f7fff700 1 -- 172.21.15.3:0/572325904 learned_addr learned my addr 172.21.15.3:0/572325904 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.980+0000 7fe105369700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7fe10009a260 0x7fe1001357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54424/0 (socket says 172.21.15.3:54424) 2021-05-26T16:45:52.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.982+0000 7fe0f7fff700 1 -- 172.21.15.3:0/572325904 >> v1:172.21.15.3:6789/0 conn(0x7fe100099db0 legacy=0x7fe100132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.001 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.982+0000 7fe105369700 1 -- 172.21.15.3:0/572325904 >> v1:172.21.15.3:6793/0 conn(0x7fe10009a260 legacy=0x7fe1001357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe104b68700 1 -- 172.21.15.3:0/572325904 >> v1:172.21.15.137:6791/0 conn(0x7fe100096ca0 legacy=0x7fe100063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218805221 0 0) 0x7fe100059750 con 0x7fe100099db0 2021-05-26T16:45:52.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.002 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): my global_id is 104931 2021-05-26T16:45:52.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ec003270 con 0x7fe100099db0 2021-05-26T16:45:52.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379004243 0 0) 0x7fe100064e50 con 0x7fe10009a260 2021-05-26T16:45:52.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.003 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): my global_id is 104876 2021-05-26T16:45:52.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe100059750 con 0x7fe10009a260 2021-05-26T16:45:52.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270339926 0 0) 0x7fe100064620 con 0x7fe100096ca0 2021-05-26T16:45:52.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.004 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient(hunting): my global_id is 5774 2021-05-26T16:45:52.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe100064e50 con 0x7fe100096ca0 2021-05-26T16:45:52.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1191438571 0 0) 0x7fe0ec003270 con 0x7fe100099db0 2021-05-26T16:45:52.005 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 >> v1:172.21.15.3:6793/0 conn(0x7fe10009a260 legacy=0x7fe1001357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 >> v1:172.21.15.137:6791/0 conn(0x7fe100096ca0 legacy=0x7fe100063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 monclient: found mon.noname-a 2021-05-26T16:45:52.006 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:45:52.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10009c390 con 0x7fe100099db0 2021-05-26T16:45:52.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.007 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe106dcc700 5 monclient: authenticate success, global_id 104931 2021-05-26T16:45:52.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe0e8001a50 con 0x7fe100099db0 2021-05-26T16:45:52.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe106dcc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:52.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:45:52.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: dump: 2021-05-26T16:45:52.009 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.009 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.010 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.010 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.010 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.011 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.011 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.011 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.011 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.011 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.012 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.012 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.012 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.012 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.013 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.013 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe106dcc700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:52.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe0e8001d60 con 0x7fe100099db0 2021-05-26T16:45:52.013 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 1 -- 172.21.15.3:0/572325904 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe0e8004930 con 0x7fe100099db0 2021-05-26T16:45:52.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe106dcc700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:52.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe106dcc700 4 set_mon_vals no callback set 2021-05-26T16:45:52.014 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:52.015 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.983+0000 7fe0f77fe700 10 monclient: dump: 2021-05-26T16:45:52.015 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.015 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.016 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.016 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.016 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.016 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.016 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.017 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.017 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.017 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.017 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.018 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.018 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.018 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.018 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.018 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 10 monclient: shutdown 2021-05-26T16:45:52.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 1 -- 172.21.15.3:0/572325904 >> v1:172.21.15.3:6789/0 conn(0x7fe100099db0 legacy=0x7fe100132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 1 -- 172.21.15.3:0/572325904 shutdown_connections 2021-05-26T16:45:52.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 1 -- 172.21.15.3:0/572325904 >> 172.21.15.3:0/572325904 conn(0x7fe10009cc00 msgr2=0x7fe10009d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 1 -- 172.21.15.3:0/572325904 shutdown_connections 2021-05-26T16:45:52.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 1 -- 172.21.15.3:0/572325904 wait complete. 2021-05-26T16:45:52.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 10 monclient: build_initial_monmap 2021-05-26T16:45:52.021 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.984+0000 7fe106dcc700 10 monclient: monmap: 2021-05-26T16:45:52.021 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:52.021 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:52.022 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:52.022 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:52.022 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:52.022 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.023 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:52.023 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:52.023 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:52.023 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:52.024 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:52.024 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:52.024 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:52.024 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:52.025 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:52.025 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 1 Processor -- start 2021-05-26T16:45:52.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 1 -- start start 2021-05-26T16:45:52.025 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient: init 2021-05-26T16:45:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient: _add_conns ranks=[6,5,7,3,8,0,2,1,4] 2021-05-26T16:45:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient(hunting): picked mon.noname-d con 0x7fe100096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient(hunting): picked mon.noname-h con 0x7fe100099db0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient(hunting): picked mon.noname-i con 0x7fe10009a260 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10011ca30 con 0x7fe100099db0 2021-05-26T16:45:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10011ccd0 con 0x7fe100096ca0 2021-05-26T16:45:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10011cf70 con 0x7fe10009a260 2021-05-26T16:45:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe106dcc700 10 monclient(hunting): authenticate will time out at 1109.616819s 2021-05-26T16:45:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe104b68700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fe100096ca0 0x7fe10013bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58746/0 (socket says 172.21.15.3:58746) 2021-05-26T16:45:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.985+0000 7fe104b68700 1 -- 172.21.15.3:0/3395757941 learned_addr learned my addr 172.21.15.3:0/3395757941 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe104b68700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6792/0 conn(0x7fe100096ca0 legacy=0x7fe10013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623404167 0 0) 0x7fe10011ccd0 con 0x7fe100096ca0 2021-05-26T16:45:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): my global_id is 5640 2021-05-26T16:45:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e0003270 con 0x7fe100096ca0 2021-05-26T16:45:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f7fff700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.137:6791/0 conn(0x7fe100099db0 legacy=0x7fe10013c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe105369700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.137:6792/0 conn(0x7fe10009a260 legacy=0x7fe100143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2252717974 0 0) 0x7fe0e0003270 con 0x7fe100096ca0 2021-05-26T16:45:52.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe10011ccd0 con 0x7fe100096ca0 2021-05-26T16:45:52.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe0f0002240 con 0x7fe100096ca0 2021-05-26T16:45:52.031 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): dump: 2021-05-26T16:45:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.032 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.033 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.033 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.033 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.033 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.034 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.034 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.034 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.034 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.034 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.035 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.036 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052656986 0 0) 0x7fe10011ca30 con 0x7fe100099db0 2021-05-26T16:45:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): my global_id is 5783 2021-05-26T16:45:52.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e0003270 con 0x7fe100099db0 2021-05-26T16:45:52.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798647141 0 0) 0x7fe10011cf70 con 0x7fe10009a260 2021-05-26T16:45:52.037 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient(hunting): my global_id is 104740 2021-05-26T16:45:52.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10011ca30 con 0x7fe10009a260 2021-05-26T16:45:52.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4198808535 0 0) 0x7fe10011ccd0 con 0x7fe100096ca0 2021-05-26T16:45:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.137:6792/0 conn(0x7fe10009a260 legacy=0x7fe100143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.137:6791/0 conn(0x7fe100099db0 legacy=0x7fe10013c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 monclient: found mon.d 2021-05-26T16:45:52.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10011b0a0 con 0x7fe100096ca0 2021-05-26T16:45:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe106dcc700 5 monclient: authenticate success, global_id 5640 2021-05-26T16:45:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe106dcc700 10 monclient: _renew_subs 2021-05-26T16:45:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe106dcc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10011db70 con 0x7fe100096ca0 2021-05-26T16:45:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe106dcc700 10 monclient: _renew_subs 2021-05-26T16:45:52.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe106dcc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:52.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10011a500 con 0x7fe100096ca0 2021-05-26T16:45:52.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe0f0002550 con 0x7fe100096ca0 2021-05-26T16:45:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe0f0002a00 con 0x7fe100096ca0 2021-05-26T16:45:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:52.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f6ffd700 4 set_mon_vals no callback set 2021-05-26T16:45:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.988+0000 7fe0f4ff9700 10 monclient: dump: 2021-05-26T16:45:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.044 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.045 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.045 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.045 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.045 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.046 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.047 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.048 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.989+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fe0f0002be0 con 0x7fe100096ca0 2021-05-26T16:45:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.989+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(207..207 src has 1..207) v4 ==== 3549+0+0 (unknown 2358273560 0 0) 0x7fe0f003d970 con 0x7fe100096ca0 2021-05-26T16:45:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.989+0000 7fe106dcc700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.989+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe0d80065a0 con 0x7fe0d8002840 2021-05-26T16:45:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.989+0000 7fe0f7fff700 10 monclient: get_auth_request con 0x7fe0e0032af0 auth_method 0 2021-05-26T16:45:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.991+0000 7fe105369700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6790/0 conn(0x7fe0d8002840 legacy=0x7fe0d8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645924504 0 0) 0x7fe0d80065a0 con 0x7fe0d8002840 2021-05-26T16:45:52.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient(hunting): my global_id is 5600 2021-05-26T16:45:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10011ccd0 con 0x7fe0d8002840 2021-05-26T16:45:52.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3656300726 0 0) 0x7fe10011ccd0 con 0x7fe0d8002840 2021-05-26T16:45:52.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe0d80065a0 con 0x7fe0d8002840 2021-05-26T16:45:52.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe0fc001c00 con 0x7fe0d8002840 2021-05-26T16:45:52.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient: dump: 2021-05-26T16:45:52.052 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.053 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.054 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.054 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.055 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.055 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.055 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.056 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.056 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.057 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.057 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.057 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.058 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.058 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2665125351 0 0) 0x7fe0d80065a0 con 0x7fe0d8002840 2021-05-26T16:45:52.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0d8009e40 con 0x7fe0d8002840 2021-05-26T16:45:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe0fc0049f0 con 0x7fe0d8002840 2021-05-26T16:45:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:52.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6790/0 conn(0x7fe0d8002840 legacy=0x7fe0d8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.992+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6790/0 conn(0x7fe0d8002840 legacy=0x7fe0d8004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.999+0000 7fe106dcc700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:51.999+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe0d8007510 con 0x7fe0d80068b0 2021-05-26T16:45:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.001+0000 7fe105369700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6790/0 conn(0x7fe0d80068b0 legacy=0x7fe0d8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.001+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112104062 0 0) 0x7fe0d8007510 con 0x7fe0d80068b0 2021-05-26T16:45:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.001+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.001+0000 7fe0f4ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.001+0000 7fe0f4ff9700 10 monclient(hunting): my global_id is 5609 2021-05-26T16:45:52.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.001+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d80065a0 con 0x7fe0d80068b0 2021-05-26T16:45:52.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3047295999 0 0) 0x7fe0d80065a0 con 0x7fe0d80068b0 2021-05-26T16:45:52.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe0d8007510 con 0x7fe0d80068b0 2021-05-26T16:45:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fe0fc005230 con 0x7fe0d80068b0 2021-05-26T16:45:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 10 monclient: got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 10 monclient: dump: 2021-05-26T16:45:52.065 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.066 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.067 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.068 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.069 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3778868562 0 0) 0x7fe0d8007510 con 0x7fe0d80068b0 2021-05-26T16:45:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 --> v1:172.21.15.3:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe0d8008770 con 0x7fe0d80068b0 2021-05-26T16:45:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 <== mon.2 v1:172.21.15.3:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 382846359) 0x7fe0fc007530 con 0x7fe0d80068b0 2021-05-26T16:45:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6790/0 conn(0x7fe0d80068b0 legacy=0x7fe0d8006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe0f4ff9700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6790/0 conn(0x7fe0d80068b0 legacy=0x7fe0d8006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.071 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:52.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:52.071 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:52.072 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:52.072 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:52.072 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:52.072 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:52.072 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:52.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:52.073 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:52.073 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:52.074 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:52.074 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:52.074 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:52.074 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:52.075 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.075 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 5, 2021-05-26T16:45:52.075 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.075 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:52.076 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:52.076 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.076 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.076 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.077 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.077 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.077 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.077 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.077 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.078 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.078 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.078 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:52.078 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:52.079 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.079 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.079 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.079 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.080 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.080 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.080 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.080 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.081 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.081 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.081 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:52.082 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:52.082 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:52.082 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:52.082 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:52.082 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:52.083 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.083 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.083 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:52.083 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:52.084 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:52.084 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:52.084 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:52.085 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.085 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:52.085 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.085 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.086 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.086 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.086 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.086 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.086 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.087 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.087 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.087 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.087 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:52.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.088 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:52.088 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.088 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:52.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:52.089 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.089 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.089 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.089 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.090 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:52.090 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.090 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.090 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.091 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.091 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.091 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.091 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.092 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.092 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:52.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:52.093 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.093 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.093 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.094 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:52.094 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.094 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.094 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.095 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.095 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.096 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.096 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.096 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.096 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.097 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:52.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:52.097 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.098 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.098 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:52.098 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.098 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.099 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.099 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.099 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.100 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.100 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.100 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.101 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:52.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:52.101 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.102 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.102 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.102 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:52.103 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.103 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.103 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.104 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.104 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.104 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.104 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.104 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.105 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:52.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:52.106 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.106 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.106 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.107 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.107 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:52.107 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.107 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.107 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.108 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.108 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.108 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.109 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.109 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.109 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.109 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:52.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:52.110 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.110 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.111 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.111 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.111 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:52.111 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.111 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.112 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.112 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.112 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.113 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.113 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.113 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.113 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.114 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:52.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:52.114 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.114 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.115 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.115 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.115 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:52.116 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.116 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.116 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.117 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.117 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.117 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.117 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.118 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.118 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.118 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:52.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:52.119 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.119 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.119 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.119 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.120 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:52.120 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.120 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.120 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.121 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.121 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.121 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.121 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.122 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.122 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.122 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:52.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:52.123 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.123 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.123 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.123 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.124 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:52.124 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.124 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.124 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.125 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.125 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.125 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.125 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.126 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.126 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.126 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.127 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:52.127 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:52.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.128 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.128 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.128 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:52.128 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.128 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.129 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:45:52.129 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.129 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.129 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.130 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:52.130 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.130 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.130 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:52.130 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.131 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.131 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.131 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:45:52.131 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.132 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.132 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:52.132 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:52.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.137:6812/30003 conn(0x7fe0e0032af0 legacy=0x7fe0e0034fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe106dcc700 10 monclient: shutdown 2021-05-26T16:45:52.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe106dcc700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 >> v1:172.21.15.3:6792/0 conn(0x7fe100096ca0 legacy=0x7fe10013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe105369700 1 -- 172.21.15.3:0/3395757941 reap_dead start 2021-05-26T16:45:52.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 shutdown_connections 2021-05-26T16:45:52.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.002+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 >> 172.21.15.3:0/3395757941 conn(0x7fe10009cc00 msgr2=0x7fe100097d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.135 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.003+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 shutdown_connections 2021-05-26T16:45:52.136 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.003+0000 7fe106dcc700 1 -- 172.21.15.3:0/3395757941 wait complete. 2021-05-26T16:45:52.136 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-05-26T16:45:52.257 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.255+0000 7f0230c39700 10 monclient: get_monmap_and_config 2021-05-26T16:45:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.255+0000 7f0230c39700 10 monclient: build_initial_monmap 2021-05-26T16:45:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.255+0000 7f0230c39700 10 monclient: monmap: 2021-05-26T16:45:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:52.255739+0000 2021-05-26T16:45:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:52.255739+0000 2021-05-26T16:45:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:52.260 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.260 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:52.260 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:52.261 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:52.261 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:52.261 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:52.261 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:52.262 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:52.262 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:52.262 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:52.263 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.255+0000 7f0230c39700 1 Processor -- start 2021-05-26T16:45:52.263 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.255+0000 7f0230c39700 1 -- start start 2021-05-26T16:45:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.255+0000 7f0230c39700 10 monclient: init 2021-05-26T16:45:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 10 monclient: _add_conns ranks=[6,7,4,0,8,2,3,5,1] 2021-05-26T16:45:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 10 monclient(hunting): picked mon.noname-d con 0x7f022c064a20 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 10 monclient(hunting): picked mon.noname-i con 0x7f022c063e30 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 10 monclient(hunting): picked mon.noname-c con 0x7f022c0642e0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c059750 con 0x7f022c0642e0 2021-05-26T16:45:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c064e00 con 0x7f022c064a20 2021-05-26T16:45:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c09c770 con 0x7f022c063e30 2021-05-26T16:45:52.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f0230c39700 10 monclient(hunting): authenticate will time out at 1109.887367s 2021-05-26T16:45:52.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f022a59c700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f022c064a20 0x7f022c099f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58762/0 (socket says 172.21.15.3:58762) 2021-05-26T16:45:52.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f022ad9d700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f022c0642e0 0x7f022c1357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38876/0 (socket says 172.21.15.3:38876) 2021-05-26T16:45:52.268 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.256+0000 7f022a59c700 1 -- 172.21.15.3:0/2233798946 learned_addr learned my addr 172.21.15.3:0/2233798946 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.258+0000 7f022ad9d700 1 -- 172.21.15.3:0/2233798946 >> v1:172.21.15.3:6791/0 conn(0x7f022c0642e0 legacy=0x7f022c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.258+0000 7f022a59c700 1 -- 172.21.15.3:0/2233798946 >> v1:172.21.15.3:6792/0 conn(0x7f022c064a20 legacy=0x7f022c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.258+0000 7f0229d9b700 1 -- 172.21.15.3:0/2233798946 >> v1:172.21.15.137:6792/0 conn(0x7f022c063e30 legacy=0x7f022c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265106323 0 0) 0x7f022c064e00 con 0x7f022c064a20 2021-05-26T16:45:52.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.277 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient(hunting): my global_id is 5649 2021-05-26T16:45:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0210003270 con 0x7f022c064a20 2021-05-26T16:45:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467288131 0 0) 0x7f022c059750 con 0x7f022c0642e0 2021-05-26T16:45:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient(hunting): my global_id is 114178 2021-05-26T16:45:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0210003590 con 0x7f022c0642e0 2021-05-26T16:45:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3553155496 0 0) 0x7f0210003590 con 0x7f022c0642e0 2021-05-26T16:45:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 >> v1:172.21.15.137:6792/0 conn(0x7f022c063e30 legacy=0x7f022c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 >> v1:172.21.15.3:6792/0 conn(0x7f022c064a20 legacy=0x7f022c099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 monclient: found mon.noname-c 2021-05-26T16:45:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0977a0 con 0x7f022c0642e0 2021-05-26T16:45:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f021c001de0 con 0x7f022c0642e0 2021-05-26T16:45:52.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:52.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.273+0000 7f022959a700 10 monclient: dump: 2021-05-26T16:45:52.282 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.282 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.286 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f0230c39700 5 monclient: authenticate success, global_id 114178 2021-05-26T16:45:52.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f0230c39700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:52.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f021c0020f0 con 0x7f022c0642e0 2021-05-26T16:45:52.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f022959a700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f022959a700 1 -- 172.21.15.3:0/2233798946 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f021c004bf0 con 0x7f022c0642e0 2021-05-26T16:45:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f0230c39700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f0230c39700 4 set_mon_vals no callback set 2021-05-26T16:45:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f022959a700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f022959a700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:52.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f022959a700 10 monclient: dump: 2021-05-26T16:45:52.288 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.288 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.288 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.289 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.289 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.289 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.290 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.290 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.291 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.291 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.292 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.292 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.292 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.293 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.293 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.294 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f0230c39700 10 monclient: shutdown 2021-05-26T16:45:52.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f0230c39700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.274+0000 7f0230c39700 1 -- 172.21.15.3:0/2233798946 >> v1:172.21.15.3:6791/0 conn(0x7f022c0642e0 legacy=0x7f022c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.276+0000 7f0230c39700 1 -- 172.21.15.3:0/2233798946 shutdown_connections 2021-05-26T16:45:52.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.276+0000 7f0230c39700 1 -- 172.21.15.3:0/2233798946 >> 172.21.15.3:0/2233798946 conn(0x7f022c0a0db0 msgr2=0x7f022c09cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.276+0000 7f0230c39700 1 -- 172.21.15.3:0/2233798946 shutdown_connections 2021-05-26T16:45:52.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.276+0000 7f0230c39700 1 -- 172.21.15.3:0/2233798946 wait complete. 2021-05-26T16:45:52.302 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.276+0000 7f0230c39700 10 monclient: build_initial_monmap 2021-05-26T16:45:52.303 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient: monmap: 2021-05-26T16:45:52.303 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:52.303 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:52.303 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:52.304 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:52.304 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:52.304 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.304 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:52.305 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:52.305 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:52.305 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:52.305 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:52.305 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:52.306 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:52.306 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:52.306 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:52.306 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 1 Processor -- start 2021-05-26T16:45:52.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 1 -- start start 2021-05-26T16:45:52.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient: init 2021-05-26T16:45:52.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:52.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient: _add_conns ranks=[1,6,2,0,5,7,4,3,8] 2021-05-26T16:45:52.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient(hunting): picked mon.noname-f con 0x7f022c063e30 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:52.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient(hunting): picked mon.noname-d con 0x7f022c0642e0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:52.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient(hunting): picked mon.noname-b con 0x7f022c064a20 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:52.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c068ce0 con 0x7f022c063e30 2021-05-26T16:45:52.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c065bd0 con 0x7f022c064a20 2021-05-26T16:45:52.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c065e70 con 0x7f022c0642e0 2021-05-26T16:45:52.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.277+0000 7f0230c39700 10 monclient(hunting): authenticate will time out at 1109.908993s 2021-05-26T16:45:52.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.278+0000 7f0229d9b700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f022c0642e0 0x7f022c1450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58768/0 (socket says 172.21.15.3:58768) 2021-05-26T16:45:52.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.278+0000 7f0229d9b700 1 -- 172.21.15.3:0/95433450 learned_addr learned my addr 172.21.15.3:0/95433450 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f022ad9d700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6790/0 conn(0x7f022c064a20 legacy=0x7f022c148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f022a59c700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.137:6789/0 conn(0x7f022c063e30 legacy=0x7f022c0685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f0229d9b700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6792/0 conn(0x7f022c0642e0 legacy=0x7f022c1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989402932 0 0) 0x7f022c065e70 con 0x7f022c0642e0 2021-05-26T16:45:52.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f021a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f021a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f021a7fc700 10 monclient(hunting): my global_id is 5658 2021-05-26T16:45:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.280+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0208003270 con 0x7f022c0642e0 2021-05-26T16:45:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 835829873 0 0) 0x7f0208003270 con 0x7f022c0642e0 2021-05-26T16:45:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f022c065e70 con 0x7f022c0642e0 2021-05-26T16:45:52.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0220001f00 con 0x7f022c0642e0 2021-05-26T16:45:52.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:52.313 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): dump: 2021-05-26T16:45:52.314 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.314 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.314 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.314 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.315 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.315 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.315 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.315 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.316 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.316 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.316 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.316 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.316 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.317 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935916618 0 0) 0x7f022c065bd0 con 0x7f022c064a20 2021-05-26T16:45:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): my global_id is 5618 2021-05-26T16:45:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0208003270 con 0x7f022c064a20 2021-05-26T16:45:52.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894412695 0 0) 0x7f022c068ce0 con 0x7f022c063e30 2021-05-26T16:45:52.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.319 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient(hunting): my global_id is 5644 2021-05-26T16:45:52.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c065bd0 con 0x7f022c063e30 2021-05-26T16:45:52.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3839078887 0 0) 0x7f022c065e70 con 0x7f022c0642e0 2021-05-26T16:45:52.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6790/0 conn(0x7f022c064a20 legacy=0x7f022c148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.137:6789/0 conn(0x7f022c063e30 legacy=0x7f022c0685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.320 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 monclient: found mon.d 2021-05-26T16:45:52.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:52.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.281+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c066110 con 0x7f022c0642e0 2021-05-26T16:45:52.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f0230c39700 5 monclient: authenticate success, global_id 5658 2021-05-26T16:45:52.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0220002500 con 0x7f022c0642e0 2021-05-26T16:45:52.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f0228d99700 4 set_mon_vals no callback set 2021-05-26T16:45:52.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f02200029b0 con 0x7f022c0642e0 2021-05-26T16:45:52.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:52.323 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.282+0000 7f021a7fc700 10 monclient: dump: 2021-05-26T16:45:52.324 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.324 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.324 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.324 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.325 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.325 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.325 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.325 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.326 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.326 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.326 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.326 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.327 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.327 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.327 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.327 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.283+0000 7f0230c39700 10 monclient: _renew_subs 2021-05-26T16:45:52.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.283+0000 7f0230c39700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:52.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.283+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c12efb0 con 0x7f022c0642e0 2021-05-26T16:45:52.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.283+0000 7f0230c39700 10 monclient: _renew_subs 2021-05-26T16:45:52.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.283+0000 7f0230c39700 10 monclient: _send_mon_message to mon.d at v1:172.21.15.3:6792/0 2021-05-26T16:45:52.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.283+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c069330 con 0x7f022c0642e0 2021-05-26T16:45:52.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.284+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f0220002bd0 con 0x7f022c0642e0 2021-05-26T16:45:52.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.284+0000 7f0230c39700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.284+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f022c05ded0 con 0x7f022c069580 2021-05-26T16:45:52.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.284+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.6 v1:172.21.15.3:6792/0 8 ==== osd_map(208..208 src has 1..208) v4 ==== 3941+0+0 (unknown 3466234645 0 0) 0x7f022003d990 con 0x7f022c0642e0 2021-05-26T16:45:52.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.285+0000 7f022ad9d700 10 monclient: get_auth_request con 0x7f0208032aa0 auth_method 0 2021-05-26T16:45:52.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f022a59c700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6791/0 conn(0x7f022c069580 legacy=0x7f022c093de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95604256 0 0) 0x7f022c05ded0 con 0x7f022c069580 2021-05-26T16:45:52.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 10 monclient(hunting): my global_id is 114187 2021-05-26T16:45:52.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c065e70 con 0x7f022c069580 2021-05-26T16:45:52.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3297364328 0 0) 0x7f022c065e70 con 0x7f022c069580 2021-05-26T16:45:52.331 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f022c05ded0 con 0x7f022c069580 2021-05-26T16:45:52.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0214001ba0 con 0x7f022c069580 2021-05-26T16:45:52.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:52.332 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 10 monclient: dump: 2021-05-26T16:45:52.333 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.333 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.333 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.333 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.333 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.334 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.334 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.334 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.334 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.334 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.335 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.335 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.335 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.336 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.336 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.336 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 699921869 0 0) 0x7f022c05ded0 con 0x7f022c069580 2021-05-26T16:45:52.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.287+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f022c06c030 con 0x7f022c069580 2021-05-26T16:45:52.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.288+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f0214006590 con 0x7f022c069580 2021-05-26T16:45:52.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.288+0000 7f021a7fc700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.288+0000 7f021a7fc700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:52.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.288+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6791/0 conn(0x7f022c069580 legacy=0x7f022c093de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.288+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6791/0 conn(0x7f022c069580 legacy=0x7f022c093de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.294+0000 7f0230c39700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:52.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.294+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f022c069b10 con 0x7f022c027d00 2021-05-26T16:45:52.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f022a59c700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6791/0 conn(0x7f022c027d00 legacy=0x7f022c0944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.338 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874456616 0 0) 0x7f022c069b10 con 0x7f022c027d00 2021-05-26T16:45:52.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient(hunting): my global_id is 114196 2021-05-26T16:45:52.339 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c05ded0 con 0x7f022c027d00 2021-05-26T16:45:52.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 86128440 0 0) 0x7f022c05ded0 con 0x7f022c027d00 2021-05-26T16:45:52.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f022c069b10 con 0x7f022c027d00 2021-05-26T16:45:52.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0214004d90 con 0x7f022c027d00 2021-05-26T16:45:52.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.340 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:52.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient: dump: 2021-05-26T16:45:52.341 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.341 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.341 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.341 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.342 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.342 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.342 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.342 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.343 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.343 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.343 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.343 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.344 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.344 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.344 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.344 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4283035941 0 0) 0x7f022c069b10 con 0x7f022c027d00 2021-05-26T16:45:52.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 --> v1:172.21.15.3:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f022c12de70 con 0x7f022c027d00 2021-05-26T16:45:52.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 <== mon.4 v1:172.21.15.3:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 2318022396) 0x7f0214006310 con 0x7f022c027d00 2021-05-26T16:45:52.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6791/0 conn(0x7f022c027d00 legacy=0x7f022c0944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.297+0000 7f021a7fc700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6791/0 conn(0x7f022c027d00 legacy=0x7f022c0944f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.347 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:52.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:52.347 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:52.347 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:52.348 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:52.348 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:52.348 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:52.348 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:52.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:52.349 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:52.349 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:52.349 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:52.350 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:52.350 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:52.350 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:52.350 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.350 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 6, 2021-05-26T16:45:52.351 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.351 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:52.351 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:52.351 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.352 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.352 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.352 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.352 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.353 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.353 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.353 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.353 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.354 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.354 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:52.354 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:52.354 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.355 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.355 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.355 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.355 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.355 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.356 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.356 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.356 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.357 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.357 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:52.357 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:52.357 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:52.358 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:52.358 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:52.358 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:52.359 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.359 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.360 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:52.360 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:52.360 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:52.361 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:52.361 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:52.361 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.362 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:52.362 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.362 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.362 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.362 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.363 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.363 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.363 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.363 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.364 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.364 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.364 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:52.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.364 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:52.365 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.365 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:52.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:52.366 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.366 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.366 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.367 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.367 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:52.367 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.367 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.368 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.368 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.368 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.368 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.369 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.369 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.369 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.370 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:52.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:52.370 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.370 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.370 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.371 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.371 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:52.371 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.372 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.372 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.372 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.372 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.373 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.373 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.373 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.373 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.374 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:52.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:52.374 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.374 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.375 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.375 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.375 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:52.375 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.376 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.376 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.376 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.376 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.377 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.377 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.377 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.378 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.378 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:52.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:52.379 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.379 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.379 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.379 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.379 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:52.380 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.380 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.380 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.380 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.381 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.381 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.381 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.381 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.382 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.382 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:52.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:52.383 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.383 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.383 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.383 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:52.384 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.384 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.384 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.385 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.385 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.385 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.385 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.385 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.386 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.386 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:52.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:52.386 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.387 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.387 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.387 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.388 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:52.388 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.388 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.388 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.389 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.389 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.389 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.389 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.390 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.390 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.390 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:52.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:52.391 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.391 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.391 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.392 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.392 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:52.392 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.392 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.392 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.393 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.394 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.394 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.395 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.395 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.396 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:52.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:52.397 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.397 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.398 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.398 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:52.399 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.399 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.399 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.400 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.400 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.400 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.400 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.401 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.401 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.401 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:52.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:52.402 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.402 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.402 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.403 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.403 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:52.403 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.403 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.404 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.404 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.404 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.404 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.405 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.405 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.405 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.405 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.406 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:52.406 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:52.406 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.406 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.407 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.407 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:52.407 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.407 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.408 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:52.408 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.408 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.408 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.408 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:52.409 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.409 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.410 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:52.410 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:52.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.137:6812/30003 conn(0x7f0208032aa0 legacy=0x7f0208034f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 10 monclient: shutdown 2021-05-26T16:45:52.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.412 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 >> v1:172.21.15.3:6792/0 conn(0x7f022c0642e0 legacy=0x7f022c1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f022ad9d700 1 -- 172.21.15.3:0/95433450 reap_dead start 2021-05-26T16:45:52.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f022ad9d700 1 -- 172.21.15.3:0/95433450 reap_dead start 2021-05-26T16:45:52.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 shutdown_connections 2021-05-26T16:45:52.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 >> 172.21.15.3:0/95433450 conn(0x7f022c0a0db0 msgr2=0x7f022c099ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.413 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 shutdown_connections 2021-05-26T16:45:52.414 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.298+0000 7f0230c39700 1 -- 172.21.15.3:0/95433450 wait complete. 2021-05-26T16:45:52.414 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2021-05-26T16:45:52.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.528+0000 7f3a63134700 10 monclient: get_monmap_and_config 2021-05-26T16:45:52.530 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.528+0000 7f3a63134700 10 monclient: build_initial_monmap 2021-05-26T16:45:52.531 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.528+0000 7f3a63134700 10 monclient: monmap: 2021-05-26T16:45:52.531 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:52.531 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.531 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:52.528745+0000 2021-05-26T16:45:52.532 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:52.528745+0000 2021-05-26T16:45:52.532 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:52.532 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.532 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:52.533 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:52.533 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:52.533 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:52.533 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:52.533 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:52.534 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:52.534 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:52.534 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:52.534 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.528+0000 7f3a63134700 1 Processor -- start 2021-05-26T16:45:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.528+0000 7f3a63134700 1 -- start start 2021-05-26T16:45:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.528+0000 7f3a63134700 10 monclient: init 2021-05-26T16:45:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 10 monclient: _add_conns ranks=[8,1,2,4,6,0,5,7,3] 2021-05-26T16:45:52.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 10 monclient(hunting): picked mon.noname-e con 0x7f3a5c096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:52.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 10 monclient(hunting): picked mon.noname-f con 0x7f3a5c099db0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:52.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 10 monclient(hunting): picked mon.noname-b con 0x7f3a5c09a260 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:52.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c059750 con 0x7f3a5c099db0 2021-05-26T16:45:52.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c064620 con 0x7f3a5c09a260 2021-05-26T16:45:52.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c064e50 con 0x7f3a5c096ca0 2021-05-26T16:45:52.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a63134700 10 monclient(hunting): authenticate will time out at 1110.160389s 2021-05-26T16:45:52.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a616d1700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f3a5c09a260 0x7f3a5c1357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55420/0 (socket says 172.21.15.3:55420) 2021-05-26T16:45:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a616d1700 1 -- 172.21.15.3:0/2264576245 learned_addr learned my addr 172.21.15.3:0/2264576245 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.529+0000 7f3a60ed0700 1 --1- 172.21.15.3:0/2264576245 >> v1:172.21.15.3:6793/0 conn(0x7f3a5c096ca0 0x7f3a5c063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54458/0 (socket says 172.21.15.3:54458) 2021-05-26T16:45:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a60ed0700 1 -- 172.21.15.3:0/2264576245 >> v1:172.21.15.3:6793/0 conn(0x7f3a5c096ca0 legacy=0x7f3a5c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a616d1700 1 -- 172.21.15.3:0/2264576245 >> v1:172.21.15.3:6790/0 conn(0x7f3a5c09a260 legacy=0x7f3a5c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393667500 0 0) 0x7f3a5c064e50 con 0x7f3a5c096ca0 2021-05-26T16:45:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 10 monclient(hunting): my global_id is 104885 2021-05-26T16:45:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a48003270 con 0x7f3a5c096ca0 2021-05-26T16:45:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568222890 0 0) 0x7f3a5c064620 con 0x7f3a5c09a260 2021-05-26T16:45:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 10 monclient(hunting): my global_id is 5627 2021-05-26T16:45:52.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a53fff700 1 -- 172.21.15.3:0/2264576245 >> v1:172.21.15.137:6789/0 conn(0x7f3a5c099db0 legacy=0x7f3a5c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.531+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c064e50 con 0x7f3a5c09a260 2021-05-26T16:45:52.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 682585178 0 0) 0x7f3a48003270 con 0x7f3a5c096ca0 2021-05-26T16:45:52.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 >> v1:172.21.15.3:6790/0 conn(0x7f3a5c09a260 legacy=0x7f3a5c1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 >> v1:172.21.15.137:6789/0 conn(0x7f3a5c099db0 legacy=0x7f3a5c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 monclient: found mon.noname-e 2021-05-26T16:45:52.556 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:45:52.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c09c390 con 0x7f3a5c096ca0 2021-05-26T16:45:52.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.557 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 5 monclient: authenticate success, global_id 104885 2021-05-26T16:45:52.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a4c001a60 con 0x7f3a5c096ca0 2021-05-26T16:45:52.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:52.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.558 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:52.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: dump: 2021-05-26T16:45:52.559 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.559 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.559 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.559 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.560 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.560 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.560 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.560 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.561 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.561 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.561 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.562 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.562 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.562 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.562 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.562 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:52.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3a4c001d70 con 0x7f3a5c096ca0 2021-05-26T16:45:52.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.563 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:52.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 4 set_mon_vals no callback set 2021-05-26T16:45:52.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 1 -- 172.21.15.3:0/2264576245 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a4c0048b0 con 0x7f3a5c096ca0 2021-05-26T16:45:52.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:52.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a537fe700 10 monclient: dump: 2021-05-26T16:45:52.565 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.565 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.565 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.565 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.566 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.566 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.566 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.566 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.567 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.567 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.567 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.567 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.568 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.568 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.568 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.568 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 10 monclient: shutdown 2021-05-26T16:45:52.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 1 -- 172.21.15.3:0/2264576245 >> v1:172.21.15.3:6793/0 conn(0x7f3a5c096ca0 legacy=0x7f3a5c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 1 -- 172.21.15.3:0/2264576245 shutdown_connections 2021-05-26T16:45:52.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 1 -- 172.21.15.3:0/2264576245 >> 172.21.15.3:0/2264576245 conn(0x7f3a5c09cc00 msgr2=0x7f3a5c09d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 1 -- 172.21.15.3:0/2264576245 shutdown_connections 2021-05-26T16:45:52.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.532+0000 7f3a63134700 1 -- 172.21.15.3:0/2264576245 wait complete. 2021-05-26T16:45:52.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.533+0000 7f3a63134700 10 monclient: build_initial_monmap 2021-05-26T16:45:52.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.533+0000 7f3a63134700 10 monclient: monmap: 2021-05-26T16:45:52.571 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:52.571 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:52.571 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:52.571 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:52.571 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:52.572 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.572 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:52.572 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:52.572 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:52.574 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.533+0000 7f3a63134700 1 Processor -- start 2021-05-26T16:45:52.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.533+0000 7f3a63134700 1 -- start start 2021-05-26T16:45:52.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.533+0000 7f3a63134700 10 monclient: init 2021-05-26T16:45:52.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:52.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 10 monclient: _add_conns ranks=[6,4,0,7,5,8,1,3,2] 2021-05-26T16:45:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 10 monclient(hunting): picked mon.noname-d con 0x7f3a5c096ca0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 10 monclient(hunting): picked mon.noname-c con 0x7f3a5c099db0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 10 monclient(hunting): picked mon.noname-a con 0x7f3a5c09a260 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c116900 con 0x7f3a5c09a260 2021-05-26T16:45:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c116ba0 con 0x7f3a5c099db0 2021-05-26T16:45:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c116e40 con 0x7f3a5c096ca0 2021-05-26T16:45:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a63134700 10 monclient(hunting): authenticate will time out at 1110.165384s 2021-05-26T16:45:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a53fff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f3a5c099db0 0x7f3a5c093630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38898/0 (socket says 172.21.15.3:38898) 2021-05-26T16:45:52.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a53fff700 1 -- 172.21.15.3:0/2075253314 learned_addr learned my addr 172.21.15.3:0/2075253314 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.534+0000 7f3a60ed0700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f3a5c096ca0 0x7f3a5c092f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58784/0 (socket says 172.21.15.3:58784) 2021-05-26T16:45:52.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a616d1700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6789/0 conn(0x7f3a5c09a260 legacy=0x7f3a5c144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a53fff700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6791/0 conn(0x7f3a5c099db0 legacy=0x7f3a5c093630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a60ed0700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a5c096ca0 legacy=0x7f3a5c092f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233386323 0 0) 0x7f3a5c116900 con 0x7f3a5c09a260 2021-05-26T16:45:52.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.579 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): my global_id is 104940 2021-05-26T16:45:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a3c003270 con 0x7f3a5c09a260 2021-05-26T16:45:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777767281 0 0) 0x7f3a5c116ba0 con 0x7f3a5c099db0 2021-05-26T16:45:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): my global_id is 114205 2021-05-26T16:45:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c116900 con 0x7f3a5c099db0 2021-05-26T16:45:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204988063 0 0) 0x7f3a5c116e40 con 0x7f3a5c096ca0 2021-05-26T16:45:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 10 monclient(hunting): my global_id is 5667 2021-05-26T16:45:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.536+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c116ba0 con 0x7f3a5c096ca0 2021-05-26T16:45:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3151716770 0 0) 0x7f3a5c116900 con 0x7f3a5c099db0 2021-05-26T16:45:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a5c116e40 con 0x7f3a5c099db0 2021-05-26T16:45:52.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 616281764 0 0) 0x7f3a3c003270 con 0x7f3a5c09a260 2021-05-26T16:45:52.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a5c116900 con 0x7f3a5c09a260 2021-05-26T16:45:52.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a44001f00 con 0x7f3a5c099db0 2021-05-26T16:45:52.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:52.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): dump: 2021-05-26T16:45:52.584 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.584 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.585 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.585 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.585 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.585 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.586 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.586 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.586 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.586 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.587 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.587 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.587 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.587 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.588 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.588 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:52.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a58001ff0 con 0x7f3a5c09a260 2021-05-26T16:45:52.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:52.589 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): dump: 2021-05-26T16:45:52.589 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.589 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.590 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.590 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.590 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.591 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.591 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.591 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.591 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.592 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.592 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.592 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.592 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.592 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.593 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.593 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3466469088 0 0) 0x7f3a5c116ba0 con 0x7f3a5c096ca0 2021-05-26T16:45:52.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a3c003270 con 0x7f3a5c096ca0 2021-05-26T16:45:52.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a4c001a20 con 0x7f3a5c096ca0 2021-05-26T16:45:52.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:52.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient(hunting): dump: 2021-05-26T16:45:52.594 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.595 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.595 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.595 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.596 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.596 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.596 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.596 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.596 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.597 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.597 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.597 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.597 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.597 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.598 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.598 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1365975558 0 0) 0x7f3a5c116e40 con 0x7f3a5c099db0 2021-05-26T16:45:52.598 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a5c096ca0 legacy=0x7f3a5c092f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6789/0 conn(0x7f3a5c09a260 legacy=0x7f3a5c144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 monclient: found mon.c 2021-05-26T16:45:52.599 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c094ad0 con 0x7f3a5c099db0 2021-05-26T16:45:52.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.600 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a63134700 5 monclient: authenticate success, global_id 114205 2021-05-26T16:45:52.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a63134700 10 monclient: _renew_subs 2021-05-26T16:45:52.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a63134700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c095770 con 0x7f3a5c099db0 2021-05-26T16:45:52.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a63134700 10 monclient: _renew_subs 2021-05-26T16:45:52.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a63134700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c1173c0 con 0x7f3a5c099db0 2021-05-26T16:45:52.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3a44002520 con 0x7f3a5c099db0 2021-05-26T16:45:52.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a440029d0 con 0x7f3a5c099db0 2021-05-26T16:45:52.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a52ffd700 4 set_mon_vals no callback set 2021-05-26T16:45:52.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:52.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.537+0000 7f3a50ff9700 10 monclient: dump: 2021-05-26T16:45:52.604 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.604 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.604 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.604 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.605 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.605 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.605 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.605 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.606 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.606 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.606 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.606 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.607 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.607 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.607 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.607 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.538+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f3a44002bb0 con 0x7f3a5c099db0 2021-05-26T16:45:52.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.538+0000 7f3a63134700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.538+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3a340065a0 con 0x7f3a34002840 2021-05-26T16:45:52.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.538+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(208..208 src has 1..208) v4 ==== 3941+0+0 (unknown 3466234645 0 0) 0x7f3a4403db10 con 0x7f3a5c099db0 2021-05-26T16:45:52.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.538+0000 7f3a616d1700 10 monclient: get_auth_request con 0x7f3a3c0333f0 auth_method 0 2021-05-26T16:45:52.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.540+0000 7f3a60ed0700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a34002840 legacy=0x7f3a34004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.540+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944597143 0 0) 0x7f3a340065a0 con 0x7f3a34002840 2021-05-26T16:45:52.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.540+0000 7f3a50ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.540+0000 7f3a50ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.540+0000 7f3a50ff9700 10 monclient(hunting): my global_id is 5676 2021-05-26T16:45:52.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.540+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c116e40 con 0x7f3a34002840 2021-05-26T16:45:52.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4162626062 0 0) 0x7f3a5c116e40 con 0x7f3a34002840 2021-05-26T16:45:52.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a340065a0 con 0x7f3a34002840 2021-05-26T16:45:52.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a4c001540 con 0x7f3a34002840 2021-05-26T16:45:52.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:52.611 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 10 monclient: dump: 2021-05-26T16:45:52.611 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.611 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.612 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.612 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.612 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.612 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.613 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.613 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.613 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.613 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.614 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.614 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.614 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.614 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.615 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.615 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2869921129 0 0) 0x7f3a340065a0 con 0x7f3a34002840 2021-05-26T16:45:52.615 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a34009e40 con 0x7f3a34002840 2021-05-26T16:45:52.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f3a4c0051f0 con 0x7f3a34002840 2021-05-26T16:45:52.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.616 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:52.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a34002840 legacy=0x7f3a34004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.617 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.541+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a34002840 legacy=0x7f3a34004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.548+0000 7f3a63134700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:52.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.548+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3a34007510 con 0x7f3a340068b0 2021-05-26T16:45:52.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a60ed0700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a340068b0 legacy=0x7f3a34006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206794274 0 0) 0x7f3a34007510 con 0x7f3a340068b0 2021-05-26T16:45:52.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.620 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 10 monclient(hunting): my global_id is 5685 2021-05-26T16:45:52.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a340065a0 con 0x7f3a340068b0 2021-05-26T16:45:52.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2408717588 0 0) 0x7f3a340065a0 con 0x7f3a340068b0 2021-05-26T16:45:52.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a34007510 con 0x7f3a340068b0 2021-05-26T16:45:52.621 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3a4c0059d0 con 0x7f3a340068b0 2021-05-26T16:45:52.622 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.622 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:52.622 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 10 monclient: dump: 2021-05-26T16:45:52.622 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.622 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.623 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.623 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.623 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.623 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.624 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.624 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.624 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.624 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.624 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.625 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.625 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.625 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.625 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.626 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2798853474 0 0) 0x7f3a34007510 con 0x7f3a340068b0 2021-05-26T16:45:52.626 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.550+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 --> v1:172.21.15.3:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3a34008770 con 0x7f3a340068b0 2021-05-26T16:45:52.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 <== mon.6 v1:172.21.15.3:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 1746703233) 0x7f3a4c005e40 con 0x7f3a340068b0 2021-05-26T16:45:52.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a50ff9700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:52.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a50ff9700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:52.627 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a340068b0 legacy=0x7f3a34006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.628 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a50ff9700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6792/0 conn(0x7f3a340068b0 legacy=0x7f3a34006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:52.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:52.629 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:52.629 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:52.629 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:52.629 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:52.629 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:52.630 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:52.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:52.630 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:52.631 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:52.631 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:52.631 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:52.631 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:52.631 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:52.632 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.632 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 6, 2021-05-26T16:45:52.632 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.632 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:52.633 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:52.633 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.633 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.633 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.633 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.634 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.634 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.634 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.634 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.635 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.635 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.635 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:52.635 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:52.635 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.636 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.636 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.636 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.636 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.637 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.637 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.637 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.637 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.638 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.638 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:52.638 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:52.639 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:52.639 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:52.639 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:52.639 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:52.639 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.640 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.640 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:52.640 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:52.640 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:52.641 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:52.641 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:52.641 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.641 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:52.641 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.642 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.642 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.642 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.642 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.642 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.643 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.643 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.643 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.643 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.644 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:52.644 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.644 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:52.644 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.644 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:52.645 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:52.645 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.645 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.645 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.646 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.646 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:52.646 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.646 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.647 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.647 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.647 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.648 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.648 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.648 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.648 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.649 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.649 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:52.649 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:52.650 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.650 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.650 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.650 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.650 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:52.651 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.651 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.651 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.652 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.652 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.652 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.652 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.653 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.653 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.654 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.654 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:52.655 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:52.655 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.655 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.656 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.656 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.656 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:52.657 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.657 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.658 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.658 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.658 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.659 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.659 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.660 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.660 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.661 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.661 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:52.662 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:52.662 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.662 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.663 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.663 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.664 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:52.664 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.664 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.665 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.666 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.666 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.666 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.667 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.667 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.668 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.668 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.668 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:52.669 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:52.669 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.670 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.670 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.670 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.671 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:52.671 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.671 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.671 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.671 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.672 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.672 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.672 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.672 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.673 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.673 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.673 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.673 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:52.673 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:52.674 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.674 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.674 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.674 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.675 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:52.675 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.675 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.675 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.676 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.676 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.676 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.676 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.677 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.677 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.677 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.677 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:52.678 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:52.678 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.678 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.678 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.679 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.679 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:52.679 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.679 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.680 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.680 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.680 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.680 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.680 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.681 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.681 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.681 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.681 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.682 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:52.682 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:52.682 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.682 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.683 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.683 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.683 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:52.683 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.683 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.684 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.684 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.684 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.684 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.685 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.685 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.685 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.685 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.686 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:52.686 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:52.686 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.686 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.687 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.687 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.687 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:52.687 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.687 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.688 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.688 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.688 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.688 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.689 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.689 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.689 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.690 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.690 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.690 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:52.690 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:52.691 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.691 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.691 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.691 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:52.692 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.692 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.692 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:52.692 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.693 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.693 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.693 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:52.693 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.693 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.694 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.694 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:52.694 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:52.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.137:6812/30003 conn(0x7f3a3c0333f0 legacy=0x7f3a3c0358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 10 monclient: shutdown 2021-05-26T16:45:52.696 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 >> v1:172.21.15.3:6791/0 conn(0x7f3a5c099db0 legacy=0x7f3a5c093630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a616d1700 1 -- 172.21.15.3:0/2075253314 reap_dead start 2021-05-26T16:45:52.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a616d1700 1 -- 172.21.15.3:0/2075253314 reap_dead start 2021-05-26T16:45:52.697 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 shutdown_connections 2021-05-26T16:45:52.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 >> 172.21.15.3:0/2075253314 conn(0x7f3a5c09cc00 msgr2=0x7f3a5c09eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 shutdown_connections 2021-05-26T16:45:52.698 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.551+0000 7f3a63134700 1 -- 172.21.15.3:0/2075253314 wait complete. 2021-05-26T16:45:52.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2021-05-26T16:45:52.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.813+0000 7f3f62008700 10 monclient: get_monmap_and_config 2021-05-26T16:45:52.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.813+0000 7f3f62008700 10 monclient: build_initial_monmap 2021-05-26T16:45:52.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.813+0000 7f3f62008700 10 monclient: monmap: 2021-05-26T16:45:52.819 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:52.819 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.820 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:52.814222+0000 2021-05-26T16:45:52.820 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:52.814222+0000 2021-05-26T16:45:52.820 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:52.821 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.821 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:52.822 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:52.822 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:52.822 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:52.823 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:52.823 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:52.824 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:52.824 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:52.825 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:52.825 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 1 Processor -- start 2021-05-26T16:45:52.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 1 -- start start 2021-05-26T16:45:52.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient: init 2021-05-26T16:45:52.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:52.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient: _add_conns ranks=[5,1,4,6,2,7,0,8,3] 2021-05-26T16:45:52.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient(hunting): picked mon.noname-h con 0x7f3f5c12cbd0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:52.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient(hunting): picked mon.noname-f con 0x7f3f5c099a30 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:52.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient(hunting): picked mon.noname-c con 0x7f3f5c099eb0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:52.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c046600 con 0x7f3f5c099a30 2021-05-26T16:45:52.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c09b5e0 con 0x7f3f5c099eb0 2021-05-26T16:45:52.827 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c12d8f0 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f62008700 10 monclient(hunting): authenticate will time out at 1110.445837s 2021-05-26T16:45:52.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f61807700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f3f5c099eb0 0x7f3f5c135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38908/0 (socket says 172.21.15.3:38908) 2021-05-26T16:45:52.828 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.814+0000 7f3f61807700 1 -- 172.21.15.3:0/1302782805 learned_addr learned my addr 172.21.15.3:0/1302782805 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f61807700 1 -- 172.21.15.3:0/1302782805 >> v1:172.21.15.3:6791/0 conn(0x7f3f5c099eb0 legacy=0x7f3f5c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f61006700 1 -- 172.21.15.3:0/1302782805 >> v1:172.21.15.137:6791/0 conn(0x7f3f5c12cbd0 legacy=0x7f3f5c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f60805700 1 -- 172.21.15.3:0/1302782805 >> v1:172.21.15.137:6789/0 conn(0x7f3f5c099a30 legacy=0x7f3f5c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708615087 0 0) 0x7f3f5c09b5e0 con 0x7f3f5c099eb0 2021-05-26T16:45:52.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): my global_id is 114214 2021-05-26T16:45:52.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f44003270 con 0x7f3f5c099eb0 2021-05-26T16:45:52.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544685917 0 0) 0x7f3f5c046600 con 0x7f3f5c099a30 2021-05-26T16:45:52.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): my global_id is 5662 2021-05-26T16:45:52.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c09b5e0 con 0x7f3f5c099a30 2021-05-26T16:45:52.843 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122551272 0 0) 0x7f3f5c12d8f0 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient(hunting): my global_id is 5792 2021-05-26T16:45:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c046600 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148275278 0 0) 0x7f3f44003270 con 0x7f3f5c099eb0 2021-05-26T16:45:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 >> v1:172.21.15.137:6791/0 conn(0x7f3f5c12cbd0 legacy=0x7f3f5c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 >> v1:172.21.15.137:6789/0 conn(0x7f3f5c099a30 legacy=0x7f3f5c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 monclient: found mon.noname-c 2021-05-26T16:45:52.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c09c2b0 con 0x7f3f5c099eb0 2021-05-26T16:45:52.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f58001de0 con 0x7f3f5c099eb0 2021-05-26T16:45:52.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f62008700 5 monclient: authenticate success, global_id 114214 2021-05-26T16:45:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f62008700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: dump: 2021-05-26T16:45:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.852 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.852 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.852 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.852 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f62008700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:52.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 <== mon.4 v1:172.21.15.3:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3f580020f0 con 0x7f3f5c099eb0 2021-05-26T16:45:52.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 1 -- 172.21.15.3:0/1302782805 <== mon.4 v1:172.21.15.3:6791/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f58004cb0 con 0x7f3f5c099eb0 2021-05-26T16:45:52.853 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f62008700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:52.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f62008700 4 set_mon_vals no callback set 2021-05-26T16:45:52.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:52.854 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.817+0000 7f3f4bfff700 10 monclient: dump: 2021-05-26T16:45:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.857 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.857 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.857 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.857 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.857 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.858 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.858 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.858 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.858 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 10 monclient: shutdown 2021-05-26T16:45:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 1 -- 172.21.15.3:0/1302782805 >> v1:172.21.15.3:6791/0 conn(0x7f3f5c099eb0 legacy=0x7f3f5c135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 1 -- 172.21.15.3:0/1302782805 shutdown_connections 2021-05-26T16:45:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 1 -- 172.21.15.3:0/1302782805 >> 172.21.15.3:0/1302782805 conn(0x7f3f5c0a00c0 msgr2=0x7f3f5c0a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 1 -- 172.21.15.3:0/1302782805 shutdown_connections 2021-05-26T16:45:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 1 -- 172.21.15.3:0/1302782805 wait complete. 2021-05-26T16:45:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 10 monclient: build_initial_monmap 2021-05-26T16:45:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.818+0000 7f3f62008700 10 monclient: monmap: 2021-05-26T16:45:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:52.861 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:52.861 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:52.861 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:52.861 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:52.864 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:52.864 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 1 Processor -- start 2021-05-26T16:45:52.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 1 -- start start 2021-05-26T16:45:52.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient: init 2021-05-26T16:45:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient: _add_conns ranks=[1,2,4,7,6,5,0,8,3] 2021-05-26T16:45:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient(hunting): picked mon.noname-f con 0x7f3f5c099a30 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient(hunting): picked mon.noname-b con 0x7f3f5c099eb0 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient(hunting): picked mon.noname-c con 0x7f3f5c12cbd0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c09b850 con 0x7f3f5c099a30 2021-05-26T16:45:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c13ce20 con 0x7f3f5c099eb0 2021-05-26T16:45:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c09bd30 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f62008700 10 monclient(hunting): authenticate will time out at 1110.450795s 2021-05-26T16:45:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f60805700 1 --1- >> v1:172.21.15.3:6790/0 conn(0x7f3f5c099eb0 0x7f3f5c141280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55446/0 (socket says 172.21.15.3:55446) 2021-05-26T16:45:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.819+0000 7f3f60805700 1 -- 172.21.15.3:0/1788718352 learned_addr learned my addr 172.21.15.3:0/1788718352 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f60805700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6790/0 conn(0x7f3f5c099eb0 legacy=0x7f3f5c141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f61807700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6791/0 conn(0x7f3f5c12cbd0 legacy=0x7f3f5c1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f61006700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.137:6789/0 conn(0x7f3f5c099a30 legacy=0x7f3f5c129640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866630201 0 0) 0x7f3f5c13ce20 con 0x7f3f5c099eb0 2021-05-26T16:45:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): my global_id is 5636 2021-05-26T16:45:52.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3c003270 con 0x7f3f5c099eb0 2021-05-26T16:45:52.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770172945 0 0) 0x7f3f5c09bd30 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): my global_id is 114223 2021-05-26T16:45:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c13ce20 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431054640 0 0) 0x7f3f5c09b850 con 0x7f3f5c099a30 2021-05-26T16:45:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): my global_id is 5671 2021-05-26T16:45:52.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c09bd30 con 0x7f3f5c099a30 2021-05-26T16:45:52.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 945340890 0 0) 0x7f3f5c13ce20 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f5c09b850 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f58004bf0 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:52.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): dump: 2021-05-26T16:45:52.874 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.874 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.875 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.875 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.875 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.875 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.875 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.876 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.876 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.876 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.876 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.876 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.877 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.877 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.877 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.877 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:52.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2843125657 0 0) 0x7f3f3c003270 con 0x7f3f5c099eb0 2021-05-26T16:45:52.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f5c13ce20 con 0x7f3f5c099eb0 2021-05-26T16:45:52.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f50001f00 con 0x7f3f5c099eb0 2021-05-26T16:45:52.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:52.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): dump: 2021-05-26T16:45:52.879 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.879 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.879 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.880 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.880 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.880 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.880 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.880 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.882 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 222781801 0 0) 0x7f3f5c09bd30 con 0x7f3f5c099a30 2021-05-26T16:45:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f3c003270 con 0x7f3f5c099a30 2021-05-26T16:45:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f4c001cc0 con 0x7f3f5c099a30 2021-05-26T16:45:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient(hunting): dump: 2021-05-26T16:45:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.887 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.887 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.887 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.887 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1965833376 0 0) 0x7f3f5c09b850 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6790/0 conn(0x7f3f5c099eb0 legacy=0x7f3f5c141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.137:6789/0 conn(0x7f3f5c099a30 legacy=0x7f3f5c129640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient: _finish_hunting 0 2021-05-26T16:45:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 monclient: found mon.c 2021-05-26T16:45:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c116de0 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient: _finish_auth 0 2021-05-26T16:45:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f62008700 5 monclient: authenticate success, global_id 114223 2021-05-26T16:45:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f62008700 10 monclient: _renew_subs 2021-05-26T16:45:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f62008700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.891 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c1170e0 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.891 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f62008700 10 monclient: _renew_subs 2021-05-26T16:45:52.891 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f62008700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:52.891 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c131420 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3f58001dd0 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:52.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f580055a0 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f4b7fe700 4 set_mon_vals no callback set 2021-05-26T16:45:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.822+0000 7f3f497fa700 10 monclient: dump: 2021-05-26T16:45:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.894 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.894 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.894 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.894 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.894 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.895 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.895 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.895 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.895 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.895 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.896 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.896 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.896 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.896 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.823+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f3f5800eb10 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.896 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.823+0000 7f3f62008700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.897 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.823+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3f340065a0 con 0x7f3f34002840 2021-05-26T16:45:52.897 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.823+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(208..208 src has 1..208) v4 ==== 3941+0+0 (unknown 3466234645 0 0) 0x7f3f5803db90 con 0x7f3f5c12cbd0 2021-05-26T16:45:52.897 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.824+0000 7f3f60805700 10 monclient: get_auth_request con 0x7f3f3c0333e0 auth_method 0 2021-05-26T16:45:52.897 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.824+0000 7f3f60805700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.137:6812/30003 conn(0x7f3f3c0333e0 legacy=0x7f3f3c0358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-05-26T16:45:52.898 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.824+0000 7f3f60805700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.137:6812/30003 conn(0x7f3f3c0333e0 legacy=0x7f3f3c0358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:45:52.898 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.824+0000 7f3f60805700 1 --1- 172.21.15.3:0/1788718352 >> v1:172.21.15.137:6812/30003 conn(0x7f3f3c0333e0 0x7f3f3c0358a0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-05-26T16:45:52.898 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.824+0000 7f3f60805700 1 --1- 172.21.15.3:0/1788718352 >> v1:172.21.15.137:6812/30003 conn(0x7f3f3c0333e0 0x7f3f3c0358a0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-05-26T16:45:52.898 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.824+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.137:6812/30003 conn(0x7f3f3c0333e0 legacy=0x7f3f3c0358a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.898 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.825+0000 7f3f61006700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6793/0 conn(0x7f3f34002840 legacy=0x7f3f34004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709241109 0 0) 0x7f3f340065a0 con 0x7f3f34002840 2021-05-26T16:45:52.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.899 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient(hunting): my global_id is 104894 2021-05-26T16:45:52.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c09b850 con 0x7f3f34002840 2021-05-26T16:45:52.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3537052767 0 0) 0x7f3f5c09b850 con 0x7f3f34002840 2021-05-26T16:45:52.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f340065a0 con 0x7f3f34002840 2021-05-26T16:45:52.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f4c0024f0 con 0x7f3f34002840 2021-05-26T16:45:52.900 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:52.901 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient: dump: 2021-05-26T16:45:52.901 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.901 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.901 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.902 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.902 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.902 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.902 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.903 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.903 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.903 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.903 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.904 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.904 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.904 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.904 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.905 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2778844028 0 0) 0x7f3f340065a0 con 0x7f3f34002840 2021-05-26T16:45:52.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f34009e40 con 0x7f3f34002840 2021-05-26T16:45:52.905 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f3f4c002a20 con 0x7f3f34002840 2021-05-26T16:45:52.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:52.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:52.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6793/0 conn(0x7f3f34002840 legacy=0x7f3f34004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.826+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6793/0 conn(0x7f3f34002840 legacy=0x7f3f34004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.906 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.833+0000 7f3f62008700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:52.907 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.833+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3f34007510 con 0x7f3f340068b0 2021-05-26T16:45:52.907 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.835+0000 7f3f61006700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6793/0 conn(0x7f3f340068b0 legacy=0x7f3f34006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:52.907 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.835+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876656001 0 0) 0x7f3f34007510 con 0x7f3f340068b0 2021-05-26T16:45:52.907 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.835+0000 7f3f497fa700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:52.908 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.835+0000 7f3f497fa700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:52.908 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.835+0000 7f3f497fa700 10 monclient(hunting): my global_id is 104903 2021-05-26T16:45:52.908 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.835+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f340065a0 con 0x7f3f340068b0 2021-05-26T16:45:52.908 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2263842259 0 0) 0x7f3f340065a0 con 0x7f3f340068b0 2021-05-26T16:45:52.908 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f34007510 con 0x7f3f340068b0 2021-05-26T16:45:52.909 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f3f4c005850 con 0x7f3f340068b0 2021-05-26T16:45:52.909 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:52.909 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:52.909 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 10 monclient: dump: 2021-05-26T16:45:52.910 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:52.910 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:52.910 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.910 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:52.910 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:52.911 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:52.911 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:52.911 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:52.911 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:52.911 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:52.912 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:52.912 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:52.912 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:52.912 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:52.912 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:52.913 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:52.913 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3407525728 0 0) 0x7f3f34007510 con 0x7f3f340068b0 2021-05-26T16:45:52.913 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 --> v1:172.21.15.3:6793/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3f34008770 con 0x7f3f340068b0 2021-05-26T16:45:52.913 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 <== mon.8 v1:172.21.15.3:6793/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7492 (unknown 0 0 685221279) 0x7f3f4c007ad0 con 0x7f3f340068b0 2021-05-26T16:45:52.914 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:52.914 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:52.914 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6793/0 conn(0x7f3f340068b0 legacy=0x7f3f34006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.914 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f497fa700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6793/0 conn(0x7f3f340068b0 legacy=0x7f3f34006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:52.915 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f61807700 1 -- 172.21.15.3:0/1788718352 reap_dead start 2021-05-26T16:45:52.915 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:52.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:52.915 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:52.916 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:52.916 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:52.916 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:52.916 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:52.917 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:52.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:52.917 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:52.917 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:52.918 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:52.918 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:52.918 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:52.918 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:52.919 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.919 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 6, 2021-05-26T16:45:52.919 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.919 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:52.919 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:52.920 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.920 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.920 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.920 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.921 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.921 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.921 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.921 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.921 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.922 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.922 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:52.922 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:52.922 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.923 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.923 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.923 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.923 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.923 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.924 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.924 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.924 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.924 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.925 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:52.925 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:52.925 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:52.925 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:52.925 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:52.926 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:52.926 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.926 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:52.926 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:52.926 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:52.927 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:52.927 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:52.927 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:52.927 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:52.927 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:52.928 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:52.928 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:52.928 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:52.928 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:52.929 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:52.929 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:52.929 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:52.929 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:52.930 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:52.930 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.930 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:52.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.930 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:52.931 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.931 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:52.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:52.931 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.932 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.932 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.932 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.932 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:52.933 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.933 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.933 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.934 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.934 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:52.934 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.934 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.934 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.935 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.935 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:52.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:52.935 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.936 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.936 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.936 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.936 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:52.936 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.937 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.937 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.937 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.938 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:52.938 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.938 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.938 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.939 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.939 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:52.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:52.939 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.939 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.940 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.940 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.940 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:52.940 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.940 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.941 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.941 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.941 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:52.941 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.942 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.942 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.942 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.943 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:52.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:52.943 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.943 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.943 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.944 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.944 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:52.944 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.944 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.944 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.945 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.945 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:52.945 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.945 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.946 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.946 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.946 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:52.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:52.947 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.947 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.947 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.948 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.948 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:52.948 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.948 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.949 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.949 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.950 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:52.950 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.950 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.950 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.951 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.951 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:52.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:52.951 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.952 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.952 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.952 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.952 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:52.953 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.953 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.953 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.954 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.954 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:52.954 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.954 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.955 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.955 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.955 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:52.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:52.956 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.956 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.956 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.957 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.957 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:52.957 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.957 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.957 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.958 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.958 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:52.958 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.959 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.959 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.959 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.960 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:52.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:52.960 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.960 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.961 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.961 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.961 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:52.961 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.961 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.962 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.962 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.962 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:52.963 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.963 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.963 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.964 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.964 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:52.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:52.964 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:52.965 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:52.965 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.965 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:52.965 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:52.966 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:52.966 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.966 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.967 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.967 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:52.967 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:52.967 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:52.967 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:52.968 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.968 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.968 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:52.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:52.969 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.969 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.969 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.969 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:52.970 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.970 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.970 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:45:52.970 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.971 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.971 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.971 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:52.971 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.971 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:52.972 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:52.972 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:52.972 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:52.972 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:52.973 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:52.973 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:52.973 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:52.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:52.974 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:52.974 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:52.977 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f62008700 10 monclient: shutdown 2021-05-26T16:45:52.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f62008700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:52.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 >> v1:172.21.15.3:6791/0 conn(0x7f3f5c12cbd0 legacy=0x7f3f5c1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:52.978 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 shutdown_connections 2021-05-26T16:45:52.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.836+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 >> 172.21.15.3:0/1788718352 conn(0x7f3f5c0a00c0 msgr2=0x7f3f5c12b690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:52.979 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.837+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 shutdown_connections 2021-05-26T16:45:52.980 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:52.837+0000 7f3f62008700 1 -- 172.21.15.3:0/1788718352 wait complete. 2021-05-26T16:45:52.980 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2021-05-26T16:45:53.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.095+0000 7fd1a6d0c700 10 monclient: get_monmap_and_config 2021-05-26T16:45:53.098 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.095+0000 7fd1a6d0c700 10 monclient: build_initial_monmap 2021-05-26T16:45:53.099 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.095+0000 7fd1a6d0c700 10 monclient: monmap: 2021-05-26T16:45:53.099 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:53.099 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.099 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:53.096250+0000 2021-05-26T16:45:53.099 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:53.096250+0000 2021-05-26T16:45:53.100 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:53.100 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.100 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:53.100 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:53.101 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:53.101 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:53.101 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:53.101 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:53.101 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:53.102 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:53.102 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:53.102 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 1 Processor -- start 2021-05-26T16:45:53.102 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 1 -- start start 2021-05-26T16:45:53.103 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient: init 2021-05-26T16:45:53.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:53.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient: _add_conns ranks=[1,6,8,0,4,5,2,3,7] 2021-05-26T16:45:53.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient(hunting): picked mon.noname-f con 0x7fd1a012cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:53.114 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient(hunting): picked mon.noname-d con 0x7fd1a0099a30 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:53.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient(hunting): picked mon.noname-e con 0x7fd1a0099eb0 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:53.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a0046600 con 0x7fd1a012cbd0 2021-05-26T16:45:53.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a009b5e0 con 0x7fd1a0099a30 2021-05-26T16:45:53.115 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a012d8f0 con 0x7fd1a0099eb0 2021-05-26T16:45:53.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:53.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.096+0000 7fd1a6d0c700 10 monclient(hunting): authenticate will time out at 1110.727857s 2021-05-26T16:45:53.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.097+0000 7fd1a5509700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7fd1a0099a30 0x7fd1a0131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58814/0 (socket says 172.21.15.3:58814) 2021-05-26T16:45:53.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.097+0000 7fd1a5509700 1 -- 172.21.15.3:0/3600690428 learned_addr learned my addr 172.21.15.3:0/3600690428 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:53.116 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.097+0000 7fd1a650b700 1 --1- 172.21.15.3:0/3600690428 >> v1:172.21.15.3:6793/0 conn(0x7fd1a0099eb0 0x7fd1a0135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54494/0 (socket says 172.21.15.3:54494) 2021-05-26T16:45:53.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a5509700 1 -- 172.21.15.3:0/3600690428 >> v1:172.21.15.3:6792/0 conn(0x7fd1a0099a30 legacy=0x7fd1a0131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a650b700 1 -- 172.21.15.3:0/3600690428 >> v1:172.21.15.3:6793/0 conn(0x7fd1a0099eb0 legacy=0x7fd1a0135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586317425 0 0) 0x7fd1a009b5e0 con 0x7fd1a0099a30 2021-05-26T16:45:53.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:53.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:53.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient(hunting): my global_id is 5694 2021-05-26T16:45:53.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd188003270 con 0x7fd1a0099a30 2021-05-26T16:45:53.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855426011 0 0) 0x7fd1a012d8f0 con 0x7fd1a0099eb0 2021-05-26T16:45:53.118 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:53.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:53.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient(hunting): my global_id is 104912 2021-05-26T16:45:53.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a009b5e0 con 0x7fd1a0099eb0 2021-05-26T16:45:53.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a5d0a700 1 -- 172.21.15.3:0/3600690428 >> v1:172.21.15.137:6789/0 conn(0x7fd1a012cbd0 legacy=0x7fd1a012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.119 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778304549 0 0) 0x7fd188003270 con 0x7fd1a0099a30 2021-05-26T16:45:53.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 >> v1:172.21.15.3:6793/0 conn(0x7fd1a0099eb0 legacy=0x7fd1a0135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 >> v1:172.21.15.137:6789/0 conn(0x7fd1a012cbd0 legacy=0x7fd1a012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: _finish_hunting 0 2021-05-26T16:45:53.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 monclient: found mon.noname-d 2021-05-26T16:45:53.120 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:53.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:45:53.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a009c2b0 con 0x7fd1a0099a30 2021-05-26T16:45:53.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: _finish_auth 0 2021-05-26T16:45:53.121 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:53.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd190001b20 con 0x7fd1a0099a30 2021-05-26T16:45:53.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a6d0c700 5 monclient: authenticate success, global_id 5694 2021-05-26T16:45:53.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a6d0c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:53.122 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:53.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:53.123 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: dump: 2021-05-26T16:45:53.123 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:53.123 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.123 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.124 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.124 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:53.124 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.124 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:53.125 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:53.125 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:53.125 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:53.125 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:53.125 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:53.126 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:53.126 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:53.126 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:53.126 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.126 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a6d0c700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:53.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd190001d90 con 0x7fd1a0099a30 2021-05-26T16:45:53.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:53.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 1 -- 172.21.15.3:0/3600690428 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd190004930 con 0x7fd1a0099a30 2021-05-26T16:45:53.127 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a6d0c700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:53.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a6d0c700 4 set_mon_vals no callback set 2021-05-26T16:45:53.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:53.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:53.128 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.099+0000 7fd1a4d08700 10 monclient: dump: 2021-05-26T16:45:53.128 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:53.129 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.129 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.129 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.129 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:53.129 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.130 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:53.130 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:53.130 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:53.130 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:53.131 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:53.131 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:53.131 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:53.131 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:53.131 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:53.132 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 10 monclient: shutdown 2021-05-26T16:45:53.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:53.132 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/3600690428 >> v1:172.21.15.3:6792/0 conn(0x7fd1a0099a30 legacy=0x7fd1a0131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/3600690428 shutdown_connections 2021-05-26T16:45:53.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/3600690428 >> 172.21.15.3:0/3600690428 conn(0x7fd1a00a00c0 msgr2=0x7fd1a00a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:53.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/3600690428 shutdown_connections 2021-05-26T16:45:53.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/3600690428 wait complete. 2021-05-26T16:45:53.133 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 10 monclient: build_initial_monmap 2021-05-26T16:45:53.134 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.100+0000 7fd1a6d0c700 10 monclient: monmap: 2021-05-26T16:45:53.134 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:53.134 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:53.134 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:53.134 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:53.135 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:53.135 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.135 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:53.135 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:53.135 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:53.136 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:53.136 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:53.136 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:53.136 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:53.136 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:53.137 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:53.137 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 1 Processor -- start 2021-05-26T16:45:53.137 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 1 -- start start 2021-05-26T16:45:53.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient: init 2021-05-26T16:45:53.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:53.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient: _add_conns ranks=[4,0,1,8,5,7,3,2,6] 2021-05-26T16:45:53.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient(hunting): picked mon.noname-c con 0x7fd1a0099a30 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:53.138 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient(hunting): picked mon.noname-a con 0x7fd1a0099eb0 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:53.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient(hunting): picked mon.noname-f con 0x7fd1a012cbd0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:53.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a0096950 con 0x7fd1a0099eb0 2021-05-26T16:45:53.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a009f5a0 con 0x7fd1a012cbd0 2021-05-26T16:45:53.139 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a0093de0 con 0x7fd1a0099a30 2021-05-26T16:45:53.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:53.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a6d0c700 10 monclient(hunting): authenticate will time out at 1110.732660s 2021-05-26T16:45:53.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a5d0a700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7fd1a0099a30 0x7fd1a009e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38930/0 (socket says 172.21.15.3:38930) 2021-05-26T16:45:53.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.101+0000 7fd1a5d0a700 1 -- 172.21.15.3:0/4189935601 learned_addr learned my addr 172.21.15.3:0/4189935601 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:53.140 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.103+0000 7fd1a5d0a700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6791/0 conn(0x7fd1a0099a30 legacy=0x7fd1a009e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.103+0000 7fd1a5509700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6789/0 conn(0x7fd1a0099eb0 legacy=0x7fd1a009ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a650b700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a012cbd0 legacy=0x7fd1a01444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444398936 0 0) 0x7fd1a0093de0 con 0x7fd1a0099a30 2021-05-26T16:45:53.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:53.141 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:53.142 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): my global_id is 114232 2021-05-26T16:45:53.142 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180003270 con 0x7fd1a0099a30 2021-05-26T16:45:53.142 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342797287 0 0) 0x7fd1a0096950 con 0x7fd1a0099eb0 2021-05-26T16:45:53.142 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:53.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:53.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): my global_id is 104949 2021-05-26T16:45:53.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a0093de0 con 0x7fd1a0099eb0 2021-05-26T16:45:53.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644596483 0 0) 0x7fd1a009f5a0 con 0x7fd1a012cbd0 2021-05-26T16:45:53.143 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:53.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:53.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): my global_id is 5689 2021-05-26T16:45:53.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a0096950 con 0x7fd1a012cbd0 2021-05-26T16:45:53.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a5d0a700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6791/0 conn(0x7fd1a0099a30 legacy=0x7fd1a009e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-05-26T16:45:53.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a5d0a700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6791/0 conn(0x7fd1a0099a30 legacy=0x7fd1a009e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:45:53.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1703191396 0 0) 0x7fd180003270 con 0x7fd1a0099a30 2021-05-26T16:45:53.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a5d0a700 1 --1- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6791/0 conn(0x7fd1a0099a30 0x7fd1a009e780 :-1 s=OPENED pgs=263 cs=1 l=1).handle_message read tag failed 2021-05-26T16:45:53.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a5d0a700 1 --1- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6791/0 conn(0x7fd1a0099a30 0x7fd1a009e780 :-1 s=OPENED pgs=263 cs=1 l=1).fault on lossy channel, failing 2021-05-26T16:45:53.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1a009f5a0 con 0x7fd1a0099a30 2021-05-26T16:45:53.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.3:6791/0 2021-05-26T16:45:53.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4224150652 0 0) 0x7fd1a0093de0 con 0x7fd1a0099eb0 2021-05-26T16:45:53.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd180003270 con 0x7fd1a0099eb0 2021-05-26T16:45:53.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd190004870 con 0x7fd1a0099eb0 2021-05-26T16:45:53.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:53.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:45:53.147 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): dump: 2021-05-26T16:45:53.147 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:53.148 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.148 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.148 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.148 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:53.148 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.149 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:53.149 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:53.149 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:53.149 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:53.150 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:53.150 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:53.150 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:53.150 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:53.151 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:53.151 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.151 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:53.151 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1297417269 0 0) 0x7fd1a0096950 con 0x7fd1a012cbd0 2021-05-26T16:45:53.152 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1a0093de0 con 0x7fd1a012cbd0 2021-05-26T16:45:53.152 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd19c0016a0 con 0x7fd1a012cbd0 2021-05-26T16:45:53.152 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:53.152 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:53.152 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient(hunting): dump: 2021-05-26T16:45:53.153 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:53.153 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.153 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.153 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.153 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:53.154 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.154 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:53.154 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:53.154 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:53.154 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:53.155 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:53.155 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:53.155 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:53.155 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:53.155 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:53.156 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1970618702 0 0) 0x7fd180003270 con 0x7fd1a0099eb0 2021-05-26T16:45:53.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6791/0 conn(0x7fd1a0099a30 legacy=0x7fd1a009e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:53.156 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a012cbd0 legacy=0x7fd1a01444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 monclient: found mon.a 2021-05-26T16:45:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0094080 con 0x7fd1a0099eb0 2021-05-26T16:45:53.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:53.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:53.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a6d0c700 5 monclient: authenticate success, global_id 104949 2021-05-26T16:45:53.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a6d0c700 10 monclient: _renew_subs 2021-05-26T16:45:53.158 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a6d0c700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a009bd30 con 0x7fd1a0099eb0 2021-05-26T16:45:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd190001b10 con 0x7fd1a0099eb0 2021-05-26T16:45:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd190005290 con 0x7fd1a0099eb0 2021-05-26T16:45:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18dffb700 10 monclient: dump: 2021-05-26T16:45:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:53.163 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:53.163 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:53.163 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:53.163 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:53.164 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a6d0c700 10 monclient: _renew_subs 2021-05-26T16:45:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a6d0c700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd18ffff700 4 set_mon_vals no callback set 2021-05-26T16:45:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.104+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a0092bd0 con 0x7fd1a0099eb0 2021-05-26T16:45:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.105+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7fd19000e800 con 0x7fd1a0099eb0 2021-05-26T16:45:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.105+0000 7fd1a6d0c700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.105+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(208..208 src has 1..208) v4 ==== 3941+0+0 (unknown 3466234645 0 0) 0x7fd19003dab0 con 0x7fd1a0099eb0 2021-05-26T16:45:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.105+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd1a0094820 con 0x7fd1a0094440 2021-05-26T16:45:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.106+0000 7fd1a5d0a700 10 monclient: get_auth_request con 0x7fd180033250 auth_method 0 2021-05-26T16:45:53.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd1a650b700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a0094440 legacy=0x7fd1a0125780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736386439 0 0) 0x7fd1a0093de0 con 0x7fd1a0094440 2021-05-26T16:45:53.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:53.166 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:53.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 10 monclient(hunting): my global_id is 5698 2021-05-26T16:45:53.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180003270 con 0x7fd1a0094440 2021-05-26T16:45:53.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1306316494 0 0) 0x7fd180003270 con 0x7fd1a0094440 2021-05-26T16:45:53.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1a0093de0 con 0x7fd1a0094440 2021-05-26T16:45:53.167 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd19c004f30 con 0x7fd1a0094440 2021-05-26T16:45:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 10 monclient: dump: 2021-05-26T16:45:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:53.171 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:53.171 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:53.172 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:53.172 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:53.172 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:53.173 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:53.173 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.173 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 21826774 0 0) 0x7fd1a0093de0 con 0x7fd1a0094440 2021-05-26T16:45:53.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.108+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1a0098350 con 0x7fd1a0094440 2021-05-26T16:45:53.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.109+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fd19c005250 con 0x7fd1a0094440 2021-05-26T16:45:53.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.109+0000 7fd18dffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:53.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.109+0000 7fd18dffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:53.174 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.109+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a0094440 legacy=0x7fd1a0125780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.175 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.109+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a0094440 legacy=0x7fd1a0125780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:53.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.116+0000 7fd1a6d0c700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:53.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.116+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd1a006c030 con 0x7fd1a0027d00 2021-05-26T16:45:53.177 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.118+0000 7fd1a650b700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a0027d00 legacy=0x7fd1a0125e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.118+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506207491 0 0) 0x7fd1a006c030 con 0x7fd1a0027d00 2021-05-26T16:45:53.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.118+0000 7fd18dffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:53.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.118+0000 7fd18dffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:53.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.118+0000 7fd18dffb700 10 monclient(hunting): my global_id is 5707 2021-05-26T16:45:53.178 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.118+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a0093de0 con 0x7fd1a0027d00 2021-05-26T16:45:53.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 710264469 0 0) 0x7fd1a0093de0 con 0x7fd1a0027d00 2021-05-26T16:45:53.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1a006c030 con 0x7fd1a0027d00 2021-05-26T16:45:53.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7fd19c005ac0 con 0x7fd1a0027d00 2021-05-26T16:45:53.179 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:53.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 10 monclient: got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:53.180 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 10 monclient: dump: 2021-05-26T16:45:53.180 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:53.180 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.180 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.181 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:53.181 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:53.181 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.181 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:53.182 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:53.182 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:53.182 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:53.182 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:53.182 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:53.183 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:53.183 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:53.183 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:53.183 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1401921317 0 0) 0x7fd1a006c030 con 0x7fd1a0027d00 2021-05-26T16:45:53.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 --> v1:172.21.15.137:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd1a0099810 con 0x7fd1a0027d00 2021-05-26T16:45:53.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 <== mon.1 v1:172.21.15.137:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 700058522) 0x7fd19c008200 con 0x7fd1a0027d00 2021-05-26T16:45:53.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:53.184 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a0027d00 legacy=0x7fd1a0125e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.119+0000 7fd18dffb700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6789/0 conn(0x7fd1a0027d00 legacy=0x7fd1a0125e90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:53.185 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:53.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:53.186 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:53.186 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:53.186 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:53.187 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:53.187 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:53.187 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:53.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:53.188 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:53.188 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:53.188 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:53.188 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:53.188 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:53.189 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:53.189 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:53.189 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 6, 2021-05-26T16:45:53.189 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:53.189 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:53.190 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:53.190 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:53.190 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:53.190 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:53.191 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:53.191 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:53.191 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:53.191 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:53.192 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:53.192 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:53.192 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:53.192 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:53.193 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:53.193 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:53.193 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:53.193 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:53.194 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:53.194 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:53.195 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:53.195 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:53.196 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:53.196 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:53.196 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.197 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:53.197 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:53.197 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:53.198 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:53.198 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:53.198 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:53.198 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:53.199 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:53.199 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:53.199 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:53.199 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:53.200 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:53.200 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:53.200 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:53.200 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:53.201 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:53.201 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:53.201 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:53.201 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:53.201 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:53.202 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:53.202 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:53.202 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:53.202 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:53.203 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:53.203 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:53.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.203 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:53.203 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.204 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:53.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:53.204 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.204 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.205 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.205 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.205 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:53.205 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.205 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.206 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.206 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:53.206 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:53.206 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.207 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.207 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.207 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:53.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:53.208 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.208 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.208 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.208 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.209 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:53.209 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.209 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.209 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.210 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:53.210 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:53.210 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.211 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.211 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.212 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:53.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:53.212 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.212 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.213 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.213 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:53.213 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.218 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.218 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.218 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:53.218 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:53.219 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.219 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.219 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.220 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.220 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:53.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:53.220 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.220 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.221 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.221 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.221 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:53.221 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.222 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.222 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.222 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:53.223 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:53.223 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.223 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.223 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.224 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.224 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:53.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:53.224 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.225 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.225 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.225 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.225 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:53.225 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.226 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.226 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.226 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:53.227 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:53.227 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.227 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.227 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.228 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.228 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:53.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:53.228 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.228 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.229 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.229 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.229 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:53.229 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.229 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.230 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.230 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:53.230 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:53.231 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.231 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.231 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.231 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.232 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:53.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:53.232 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.232 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.233 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.233 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.233 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:53.233 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.233 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.234 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.234 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:53.234 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:53.235 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.235 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.235 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.236 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.236 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:53.236 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:53.237 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:53.237 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:53.237 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.237 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:53.238 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:53.238 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:53.238 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.238 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.239 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:53.239 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:53.239 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:53.240 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:53.240 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:53.240 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.240 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.241 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:53.241 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:53.242 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.242 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:53.242 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:53.243 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:53.243 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.244 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:53.244 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:53.245 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:53.245 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:53.245 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:53.246 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 3 2021-05-26T16:45:53.246 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:53.246 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:53.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:53.247 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:53.248 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:53.250 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.137:6812/30003 conn(0x7fd180033250 legacy=0x7fd180035710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.250 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 10 monclient: shutdown 2021-05-26T16:45:53.250 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:53.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 >> v1:172.21.15.3:6789/0 conn(0x7fd1a0099eb0 legacy=0x7fd1a009ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:53.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a650b700 1 -- 172.21.15.3:0/4189935601 reap_dead start 2021-05-26T16:45:53.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 shutdown_connections 2021-05-26T16:45:53.251 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 >> 172.21.15.3:0/4189935601 conn(0x7fd1a00a00c0 msgr2=0x7fd1a012a130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:53.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 shutdown_connections 2021-05-26T16:45:53.252 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.120+0000 7fd1a6d0c700 1 -- 172.21.15.3:0/4189935601 wait complete. 2021-05-26T16:45:53.252 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2021-05-26T16:45:53.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.368+0000 7f0fdd8a7700 10 monclient: get_monmap_and_config 2021-05-26T16:45:53.370 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.368+0000 7f0fdd8a7700 10 monclient: build_initial_monmap 2021-05-26T16:45:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.368+0000 7f0fdd8a7700 10 monclient: monmap: 2021-05-26T16:45:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:53.368859+0000 2021-05-26T16:45:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:53.368859+0000 2021-05-26T16:45:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:53.374 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:53.374 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:53.375 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:53.375 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:53.375 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.368+0000 7f0fdd8a7700 1 Processor -- start 2021-05-26T16:45:53.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.368+0000 7f0fdd8a7700 1 -- start start 2021-05-26T16:45:53.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.368+0000 7f0fdd8a7700 10 monclient: init 2021-05-26T16:45:53.380 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:53.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 10 monclient: _add_conns ranks=[5,7,6,4,8,1,0,2,3] 2021-05-26T16:45:53.381 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 10 monclient(hunting): picked mon.noname-h con 0x7f0fd8096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:53.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 10 monclient(hunting): picked mon.noname-i con 0x7f0fd8099db0 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:53.382 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 10 monclient(hunting): picked mon.noname-d con 0x7f0fd809a260 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:53.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd8059750 con 0x7f0fd8096ca0 2021-05-26T16:45:53.383 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd8064620 con 0x7f0fd809a260 2021-05-26T16:45:53.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd8064e50 con 0x7f0fd8099db0 2021-05-26T16:45:53.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:53.384 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fdd8a7700 10 monclient(hunting): authenticate will time out at 1111.000341s 2021-05-26T16:45:53.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fd77fe700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f0fd809a260 0x7f0fd81357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58838/0 (socket says 172.21.15.3:58838) 2021-05-26T16:45:53.385 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.369+0000 7f0fd77fe700 1 -- 172.21.15.3:0/1602759746 learned_addr learned my addr 172.21.15.3:0/1602759746 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:53.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.371+0000 7f0fd77fe700 1 -- 172.21.15.3:0/1602759746 >> v1:172.21.15.3:6792/0 conn(0x7f0fd809a260 legacy=0x7f0fd81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.386 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.371+0000 7f0fd6ffd700 1 -- 172.21.15.3:0/1602759746 >> v1:172.21.15.137:6791/0 conn(0x7f0fd8096ca0 legacy=0x7f0fd8063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:53.387 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:53.371+0000 7f0fd67fc700 1 -- 172.21.15.3:0/1602759746 >> v1:172.21.15.137:6792/0 conn(0x7f0fd8099db0 legacy=0x7f0fd8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.008 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523157608 0 0) 0x7f0fd8059750 con 0x7f0fd8096ca0 2021-05-26T16:45:54.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.009 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 10 monclient(hunting): my global_id is 5801 2021-05-26T16:45:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc4003270 con 0x7f0fd8096ca0 2021-05-26T16:45:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027324077 0 0) 0x7f0fd8064620 con 0x7f0fd809a260 2021-05-26T16:45:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 10 monclient(hunting): my global_id is 5703 2021-05-26T16:45:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.006+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd8059750 con 0x7f0fd809a260 2021-05-26T16:45:54.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.017+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113351348 0 0) 0x7f0fd8064e50 con 0x7f0fd8099db0 2021-05-26T16:45:54.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.017+0000 7f0fd5ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.019 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.017+0000 7f0fd5ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.017+0000 7f0fd5ffb700 10 monclient(hunting): my global_id is 104749 2021-05-26T16:45:54.020 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.017+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd8064620 con 0x7f0fd8099db0 2021-05-26T16:45:54.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1067849149 0 0) 0x7f0fd8059750 con 0x7f0fd809a260 2021-05-26T16:45:54.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 >> v1:172.21.15.137:6792/0 conn(0x7f0fd8099db0 legacy=0x7f0fd8132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 >> v1:172.21.15.137:6791/0 conn(0x7f0fd8096ca0 legacy=0x7f0fd8063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 1 monclient: found mon.noname-d 2021-05-26T16:45:54.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.027 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.3:6792/0 2021-05-26T16:45:54.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 --> v1:172.21.15.3:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd809c390 con 0x7f0fd809a260 2021-05-26T16:45:54.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0fc8001de0 con 0x7f0fd809a260 2021-05-26T16:45:54.028 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fdd8a7700 5 monclient: authenticate success, global_id 5703 2021-05-26T16:45:54.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fdd8a7700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:54.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2021-05-26T16:45:54.029 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fd5ffb700 10 monclient: dump: 2021-05-26T16:45:54.029 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.030 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.030 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.030 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.030 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.030 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.031 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.031 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.031 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.031 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.031 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.032 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.032 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.032 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.032 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.032 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.022+0000 7f0fdd8a7700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:54.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 <== mon.6 v1:172.21.15.3:6792/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0fc80020f0 con 0x7f0fd809a260 2021-05-26T16:45:54.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fd5ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fd5ffb700 1 -- 172.21.15.3:0/1602759746 <== mon.6 v1:172.21.15.3:6792/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0fc8004cb0 con 0x7f0fd809a260 2021-05-26T16:45:54.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fd5ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fd5ffb700 10 monclient: got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:54.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fd5ffb700 10 monclient: dump: 2021-05-26T16:45:54.034 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.034 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.035 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.035 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.035 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.035 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.036 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.036 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.036 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.036 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.036 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.037 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.037 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.037 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.037 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.038 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fdd8a7700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:54.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.023+0000 7f0fdd8a7700 4 set_mon_vals no callback set 2021-05-26T16:45:54.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.024+0000 7f0fdd8a7700 10 monclient: shutdown 2021-05-26T16:45:54.038 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.024+0000 7f0fdd8a7700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.024+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/1602759746 >> v1:172.21.15.3:6792/0 conn(0x7f0fd809a260 legacy=0x7f0fd81357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.025+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/1602759746 shutdown_connections 2021-05-26T16:45:54.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.025+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/1602759746 >> 172.21.15.3:0/1602759746 conn(0x7f0fd809cc00 msgr2=0x7f0fd809d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.025+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/1602759746 shutdown_connections 2021-05-26T16:45:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.026+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/1602759746 wait complete. 2021-05-26T16:45:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.027+0000 7f0fdd8a7700 10 monclient: build_initial_monmap 2021-05-26T16:45:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.030+0000 7f0fdd8a7700 10 monclient: monmap: 2021-05-26T16:45:54.044 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:54.044 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:54.044 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:54.044 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:54.047 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.030+0000 7f0fdd8a7700 1 Processor -- start 2021-05-26T16:45:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 1 -- start start 2021-05-26T16:45:54.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient: init 2021-05-26T16:45:54.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:54.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient: _add_conns ranks=[5,7,3,4,2,6,1,8,0] 2021-05-26T16:45:54.048 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient(hunting): picked mon.noname-h con 0x7f0fd8096ca0 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:54.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient(hunting): picked mon.noname-i con 0x7f0fd8099db0 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:54.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient(hunting): picked mon.noname-g con 0x7f0fd809a260 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:54.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd8116bd0 con 0x7f0fd809a260 2021-05-26T16:45:54.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd8116e70 con 0x7f0fd8096ca0 2021-05-26T16:45:54.049 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd812f1a0 con 0x7f0fd8099db0 2021-05-26T16:45:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.031+0000 7f0fdd8a7700 10 monclient(hunting): authenticate will time out at 1111.662923s 2021-05-26T16:45:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.032+0000 7f0fd6ffd700 1 --1- >> v1:172.21.15.137:6791/0 conn(0x7f0fd8096ca0 0x7f0fd812d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.137:6791/0 says I am v1:172.21.15.3:58292/0 (socket says 172.21.15.3:58292) 2021-05-26T16:45:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.032+0000 7f0fd6ffd700 1 -- 172.21.15.3:0/2026107423 learned_addr learned my addr 172.21.15.3:0/2026107423 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.034+0000 7f0fd67fc700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6792/0 conn(0x7f0fd8099db0 legacy=0x7f0fd812dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.034+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391491627 0 0) 0x7f0fd812f1a0 con 0x7f0fd8099db0 2021-05-26T16:45:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.034+0000 7f0fbeffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.034+0000 7f0fbeffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.034+0000 7f0fbeffd700 10 monclient(hunting): my global_id is 104758 2021-05-26T16:45:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb8003270 con 0x7f0fd8099db0 2021-05-26T16:45:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fd6ffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6791/0 conn(0x7f0fd8096ca0 legacy=0x7f0fd812d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fd77fe700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd809a260 legacy=0x7f0fd8143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 294231900 0 0) 0x7f0fb8003270 con 0x7f0fd8099db0 2021-05-26T16:45:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fd812f1a0 con 0x7f0fd8099db0 2021-05-26T16:45:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562451150 0 0) 0x7f0fd8116bd0 con 0x7f0fd809a260 2021-05-26T16:45:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 10 monclient(hunting): my global_id is 5574 2021-05-26T16:45:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb8003270 con 0x7f0fd809a260 2021-05-26T16:45:54.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0fcc001d60 con 0x7f0fd8099db0 2021-05-26T16:45:54.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2021-05-26T16:45:54.054 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 10 monclient(hunting): dump: 2021-05-26T16:45:54.055 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.055 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.055 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.055 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.056 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.056 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.056 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.056 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.056 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.057 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.057 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.057 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.057 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.057 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.058 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.058 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.035+0000 7f0fbeffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:54.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1586077748 0 0) 0x7f0fd812f1a0 con 0x7f0fd8099db0 2021-05-26T16:45:54.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6791/0 conn(0x7f0fd8096ca0 legacy=0x7f0fd812d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd809a260 legacy=0x7f0fd8143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 1 monclient: found mon.i 2021-05-26T16:45:54.059 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:45:54.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6792/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd812fe70 con 0x7f0fd8099db0 2021-05-26T16:45:54.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.060 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fdd8a7700 5 monclient: authenticate success, global_id 104758 2021-05-26T16:45:54.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fdd8a7700 10 monclient: _renew_subs 2021-05-26T16:45:54.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fdd8a7700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:45:54.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6792/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd8117230 con 0x7f0fd8099db0 2021-05-26T16:45:54.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fdd8a7700 10 monclient: _renew_subs 2021-05-26T16:45:54.061 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fdd8a7700 10 monclient: _send_mon_message to mon.i at v1:172.21.15.137:6792/0 2021-05-26T16:45:54.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6792/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd81176a0 con 0x7f0fd8099db0 2021-05-26T16:45:54.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0fcc002520 con 0x7f0fd8099db0 2021-05-26T16:45:54.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0fcc0029d0 con 0x7f0fd8099db0 2021-05-26T16:45:54.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:54.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.036+0000 7f0fbeffd700 10 monclient: dump: 2021-05-26T16:45:54.063 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.063 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.064 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.064 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.064 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.064 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.065 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.065 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.065 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.065 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.065 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.066 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.066 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.066 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.066 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.066 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.037+0000 7f0fdd8a7700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.037+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f0fd81169c0 con 0x7f0fd8094a60 2021-05-26T16:45:54.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.037+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f0fcc002bb0 con 0x7f0fd8099db0 2021-05-26T16:45:54.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.038+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.7 v1:172.21.15.137:6792/0 8 ==== osd_map(209..209 src has 1..209) v4 ==== 3941+0+0 (unknown 2580962776 0 0) 0x7f0fcc03dab0 con 0x7f0fd8099db0 2021-05-26T16:45:54.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.038+0000 7f0fd77fe700 10 monclient: get_auth_request con 0x7f0fb8032990 auth_method 0 2021-05-26T16:45:54.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.038+0000 7f0fd57fa700 4 set_mon_vals no callback set 2021-05-26T16:45:54.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fd6ffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd8094a60 legacy=0x7f0fd8094e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016286879 0 0) 0x7f0fd81169c0 con 0x7f0fd8094a60 2021-05-26T16:45:54.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 10 monclient(hunting): my global_id is 5583 2021-05-26T16:45:54.069 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd812f1a0 con 0x7f0fd8094a60 2021-05-26T16:45:54.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3686556206 0 0) 0x7f0fd812f1a0 con 0x7f0fd8094a60 2021-05-26T16:45:54.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fd81169c0 con 0x7f0fd8094a60 2021-05-26T16:45:54.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0fc0001d10 con 0x7f0fd8094a60 2021-05-26T16:45:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.040+0000 7f0fbeffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:45:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 10 monclient: dump: 2021-05-26T16:45:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.074 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.074 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.074 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.074 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.075 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.075 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.075 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.075 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.075 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.076 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.076 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.076 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.076 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.076 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1056176870 0 0) 0x7f0fd81169c0 con 0x7f0fd8094a60 2021-05-26T16:45:54.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fd806c030 con 0x7f0fd8094a60 2021-05-26T16:45:54.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f0fc0005510 con 0x7f0fd8094a60 2021-05-26T16:45:54.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:54.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd8094a60 legacy=0x7f0fd8094e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.041+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd8094a60 legacy=0x7f0fd8094e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.049+0000 7f0fdd8a7700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:54.078 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.049+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f0fd8069b10 con 0x7f0fd8027d00 2021-05-26T16:45:54.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.051+0000 7f0fd6ffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd8027d00 legacy=0x7f0fd8149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696094815 0 0) 0x7f0fd8069b10 con 0x7f0fd8027d00 2021-05-26T16:45:54.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.079 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 10 monclient(hunting): my global_id is 5592 2021-05-26T16:45:54.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd81169c0 con 0x7f0fd8027d00 2021-05-26T16:45:54.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 443833334 0 0) 0x7f0fd81169c0 con 0x7f0fd8027d00 2021-05-26T16:45:54.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fd8069b10 con 0x7f0fd8027d00 2021-05-26T16:45:54.080 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f0fc0002760 con 0x7f0fd8027d00 2021-05-26T16:45:54.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:45:54.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.052+0000 7f0fbeffd700 10 monclient: dump: 2021-05-26T16:45:54.081 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.081 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.082 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.082 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.082 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.082 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.083 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.083 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.083 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.083 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.083 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.084 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.084 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.084 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.084 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.084 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.053+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 527436475 0 0) 0x7f0fd8069b10 con 0x7f0fd8027d00 2021-05-26T16:45:54.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.053+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 --> v1:172.21.15.137:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0fd8095550 con 0x7f0fd8027d00 2021-05-26T16:45:54.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.053+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 <== mon.3 v1:172.21.15.137:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7662 (unknown 0 0 631785596) 0x7f0fc0002d30 con 0x7f0fd8027d00 2021-05-26T16:45:54.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.053+0000 7f0fbeffd700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:54.085 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.053+0000 7f0fbeffd700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:54.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.053+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd8027d00 legacy=0x7f0fd8149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.086 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.053+0000 7f0fbeffd700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6790/0 conn(0x7f0fd8027d00 legacy=0x7f0fd8149650 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.086 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:54.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:54.087 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:54.087 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:54.087 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:54.087 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:54.088 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:54.088 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:54.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:54.088 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:54.088 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:54.089 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:54.089 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:54.089 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:54.089 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:54.090 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.090 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 7, 2021-05-26T16:45:54.090 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:54.090 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:54.091 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:54.091 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.091 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.091 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.091 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.092 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.092 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.092 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.092 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.092 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.093 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.093 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:54.093 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:54.093 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.093 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.094 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.094 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.094 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.094 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.094 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.095 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.095 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.095 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.095 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:54.096 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:54.096 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:54.096 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:54.096 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:54.096 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:54.097 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:54.097 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:54.097 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:54.097 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:54.097 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:54.098 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:54.098 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:54.098 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:54.098 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:54.098 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.099 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.099 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.099 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.099 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.100 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.100 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.100 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.100 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.100 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.101 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:54.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.101 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:54.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.101 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:54.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:54.102 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.102 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.102 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.103 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:54.103 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.103 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.103 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.104 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:54.104 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:54.104 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.104 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.105 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.105 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:54.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:54.106 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.106 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.106 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.106 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.107 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:54.107 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.107 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.107 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.108 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:54.108 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:54.108 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.108 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.108 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.109 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.109 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:54.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:54.112 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:54.112 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.112 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.112 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.113 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.113 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:54.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:54.113 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.114 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.114 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.114 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.114 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:54.114 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.115 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.115 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.115 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:54.115 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:54.116 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.116 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.116 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.116 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.117 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:54.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:54.117 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.117 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.117 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.118 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.118 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:54.118 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.118 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.118 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.119 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:54.119 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:54.119 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.120 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.120 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.120 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:54.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:54.121 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.121 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.121 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.121 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.122 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:54.122 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.122 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.122 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.123 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:54.123 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:54.123 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.123 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.123 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.124 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.124 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:54.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:54.124 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.125 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.125 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.125 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.125 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:54.125 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.126 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.126 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.126 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:54.127 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:54.127 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.127 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.127 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.128 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.128 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:54.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:54.128 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.128 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.129 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.129 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.129 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:54.129 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.130 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.130 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.130 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:54.130 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:54.131 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.131 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.131 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.132 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.132 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:54.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:54.132 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.132 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.133 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.133 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.133 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:54.133 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.133 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.134 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.134 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:54.134 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:54.134 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.135 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.135 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.135 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.135 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.136 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:54.136 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:54.136 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.136 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.136 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.137 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:54.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.137 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.137 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": [ 2021-05-26T16:45:54.137 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.138 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.138 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.138 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:54.138 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.139 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.139 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:54.139 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.139 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.139 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.140 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:54.140 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.140 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.140 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": [ 2021-05-26T16:45:54.140 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.141 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.141 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.141 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:54.141 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.142 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.142 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:54.142 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6812/30003 conn(0x7f0fb8032990 legacy=0x7f0fb8034e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 10 monclient: shutdown 2021-05-26T16:45:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 >> v1:172.21.15.137:6792/0 conn(0x7f0fd8099db0 legacy=0x7f0fd812dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fd77fe700 1 -- 172.21.15.3:0/2026107423 reap_dead start 2021-05-26T16:45:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fd77fe700 1 -- 172.21.15.3:0/2026107423 reap_dead start 2021-05-26T16:45:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 shutdown_connections 2021-05-26T16:45:54.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 >> 172.21.15.3:0/2026107423 conn(0x7f0fd809cc00 msgr2=0x7f0fd8098c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 shutdown_connections 2021-05-26T16:45:54.146 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.054+0000 7f0fdd8a7700 1 -- 172.21.15.3:0/2026107423 wait complete. 2021-05-26T16:45:54.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2021-05-26T16:45:54.181 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:54.181 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36420]: starting. 2021-05-26T16:45:54.181 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36420]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36385 2021-05-26T16:45:54.182 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36420]: created object 0... 2021-05-26T16:45:54.182 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36420]: created object 25... 2021-05-26T16:45:54.182 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36420]: created object 49... 2021-05-26T16:45:54.182 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36420]: finishing. 2021-05-26T16:45:54.183 INFO:teuthology.orchestra.run.smithi137.stdout:process_3_[36420]: shutting down. 2021-05-26T16:45:54.220 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:45:54.220 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36422]: starting. 2021-05-26T16:45:54.220 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36422]: listing objects. 2021-05-26T16:45:54.221 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36422]: listed object 0... 2021-05-26T16:45:54.221 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36422]: listed object 25... 2021-05-26T16:45:54.221 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36422]: saw 50 objects 2021-05-26T16:45:54.221 INFO:teuthology.orchestra.run.smithi137.stdout:process_5_[36422]: shutting down. 2021-05-26T16:45:54.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.264+0000 7f848a582700 10 monclient: get_monmap_and_config 2021-05-26T16:45:54.266 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.264+0000 7f848a582700 10 monclient: build_initial_monmap 2021-05-26T16:45:54.267 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.264+0000 7f848a582700 10 monclient: monmap: 2021-05-26T16:45:54.267 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:54.267 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.267 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:54.265042+0000 2021-05-26T16:45:54.267 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:54.265042+0000 2021-05-26T16:45:54.268 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:54.268 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.268 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:54.268 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:54.269 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:54.269 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:54.269 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:54.269 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:54.269 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:54.270 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:54.270 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:54.270 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 1 Processor -- start 2021-05-26T16:45:54.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 1 -- start start 2021-05-26T16:45:54.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient: init 2021-05-26T16:45:54.280 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:54.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient: _add_conns ranks=[3,7,8,0,1,2,4,6,5] 2021-05-26T16:45:54.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient(hunting): picked mon.noname-g con 0x7f8484096ca0 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:54.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient(hunting): picked mon.noname-i con 0x7f8484099db0 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:54.281 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient(hunting): picked mon.noname-e con 0x7f848409a260 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:54.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8484059750 con 0x7f8484096ca0 2021-05-26T16:45:54.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8484064620 con 0x7f8484099db0 2021-05-26T16:45:54.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8484064e50 con 0x7f848409a260 2021-05-26T16:45:54.282 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:54.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f848a582700 10 monclient(hunting): authenticate will time out at 1111.896659s 2021-05-26T16:45:54.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f8488b1f700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f848409a260 0x7f84841357b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54538/0 (socket says 172.21.15.3:54538) 2021-05-26T16:45:54.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.265+0000 7f8488b1f700 1 -- 172.21.15.3:0/1628764594 learned_addr learned my addr 172.21.15.3:0/1628764594 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:54.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.267+0000 7f8488b1f700 1 -- 172.21.15.3:0/1628764594 >> v1:172.21.15.3:6793/0 conn(0x7f848409a260 legacy=0x7f84841357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.283 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669018724 0 0) 0x7f8484064e50 con 0x7f848409a260 2021-05-26T16:45:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient(hunting): my global_id is 104921 2021-05-26T16:45:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8468003270 con 0x7f848409a260 2021-05-26T16:45:54.284 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8483fff700 1 -- 172.21.15.3:0/1628764594 >> v1:172.21.15.137:6790/0 conn(0x7f8484096ca0 legacy=0x7f8484063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f84837fe700 1 -- 172.21.15.3:0/1628764594 >> v1:172.21.15.137:6792/0 conn(0x7f8484099db0 legacy=0x7f8484132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785371423 0 0) 0x7f8484059750 con 0x7f8484096ca0 2021-05-26T16:45:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.285 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient(hunting): my global_id is 5601 2021-05-26T16:45:54.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8484064e50 con 0x7f8484096ca0 2021-05-26T16:45:54.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279249065 0 0) 0x7f8468003270 con 0x7f848409a260 2021-05-26T16:45:54.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 >> v1:172.21.15.137:6792/0 conn(0x7f8484099db0 legacy=0x7f8484132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.286 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 >> v1:172.21.15.137:6790/0 conn(0x7f8484096ca0 legacy=0x7f8484063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 monclient: found mon.noname-e 2021-05-26T16:45:54.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:45:54.287 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848409c390 con 0x7f848409a260 2021-05-26T16:45:54.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8478001de0 con 0x7f848409a260 2021-05-26T16:45:54.288 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f848a582700 5 monclient: authenticate success, global_id 104921 2021-05-26T16:45:54.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f848a582700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:54.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:54.289 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: dump: 2021-05-26T16:45:54.289 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.290 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.290 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.290 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.290 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.291 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.291 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.291 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.291 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.291 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.292 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.292 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.292 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.292 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.293 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.293 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f848a582700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:54.293 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f84780020f0 con 0x7f848409a260 2021-05-26T16:45:54.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 1 -- 172.21.15.3:0/1628764594 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8478004cb0 con 0x7f848409a260 2021-05-26T16:45:54.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f848a582700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:54.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f848a582700 4 set_mon_vals no callback set 2021-05-26T16:45:54.294 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:54.295 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f8482ffd700 10 monclient: dump: 2021-05-26T16:45:54.295 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.295 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.295 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.296 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.296 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.296 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.296 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.297 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.297 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.297 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.297 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.297 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.298 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.298 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.298 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.298 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.298 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f848a582700 10 monclient: shutdown 2021-05-26T16:45:54.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.268+0000 7f848a582700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 1 -- 172.21.15.3:0/1628764594 >> v1:172.21.15.3:6793/0 conn(0x7f848409a260 legacy=0x7f84841357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 1 -- 172.21.15.3:0/1628764594 shutdown_connections 2021-05-26T16:45:54.299 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 1 -- 172.21.15.3:0/1628764594 >> 172.21.15.3:0/1628764594 conn(0x7f848409cc00 msgr2=0x7f848409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 1 -- 172.21.15.3:0/1628764594 shutdown_connections 2021-05-26T16:45:54.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 1 -- 172.21.15.3:0/1628764594 wait complete. 2021-05-26T16:45:54.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 10 monclient: build_initial_monmap 2021-05-26T16:45:54.300 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 10 monclient: monmap: 2021-05-26T16:45:54.300 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.302 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:54.302 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:54.302 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:54.302 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:54.304 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.269+0000 7f848a582700 1 Processor -- start 2021-05-26T16:45:54.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 1 -- start start 2021-05-26T16:45:54.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient: init 2021-05-26T16:45:54.304 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient: _add_conns ranks=[8,6,0,1,3,2,5,7,4] 2021-05-26T16:45:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient(hunting): picked mon.noname-e con 0x7f8484096ca0 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient(hunting): picked mon.noname-d con 0x7f8484099db0 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient(hunting): picked mon.noname-a con 0x7f848409a260 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8484116af0 con 0x7f848409a260 2021-05-26T16:45:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8484116d20 con 0x7f8484099db0 2021-05-26T16:45:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8484116fc0 con 0x7f8484096ca0 2021-05-26T16:45:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f848a582700 10 monclient(hunting): authenticate will time out at 1111.901702s 2021-05-26T16:45:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f8483fff700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f8484096ca0 0x7f848413c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54540/0 (socket says 172.21.15.3:54540) 2021-05-26T16:45:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.270+0000 7f8483fff700 1 -- 172.21.15.3:0/1159630927 learned_addr learned my addr 172.21.15.3:0/1159630927 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.272+0000 7f8483fff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.3:6793/0 conn(0x7f8484096ca0 legacy=0x7f848413c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.272+0000 7f84837fe700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.3:6792/0 conn(0x7f8484099db0 legacy=0x7f84841410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.272+0000 7f8488b1f700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.3:6789/0 conn(0x7f848409a260 legacy=0x7f8484144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427801986 0 0) 0x7f8484116fc0 con 0x7f8484096ca0 2021-05-26T16:45:54.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): my global_id is 104930 2021-05-26T16:45:54.308 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8464003270 con 0x7f8484096ca0 2021-05-26T16:45:54.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019193506 0 0) 0x7f8484116af0 con 0x7f848409a260 2021-05-26T16:45:54.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.309 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): my global_id is 104958 2021-05-26T16:45:54.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8484116fc0 con 0x7f848409a260 2021-05-26T16:45:54.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532094048 0 0) 0x7f8484116d20 con 0x7f8484099db0 2021-05-26T16:45:54.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.310 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): my global_id is 5712 2021-05-26T16:45:54.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8484116af0 con 0x7f8484099db0 2021-05-26T16:45:54.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 885969799 0 0) 0x7f8484116fc0 con 0x7f848409a260 2021-05-26T16:45:54.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8484116d20 con 0x7f848409a260 2021-05-26T16:45:54.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8478001dd0 con 0x7f848409a260 2021-05-26T16:45:54.311 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:45:54.312 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): dump: 2021-05-26T16:45:54.312 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.312 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.313 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.313 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.313 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.313 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.313 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.314 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.314 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.314 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.314 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.315 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3536172040 0 0) 0x7f8464003270 con 0x7f8484096ca0 2021-05-26T16:45:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8484116fc0 con 0x7f8484096ca0 2021-05-26T16:45:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.6 v1:172.21.15.3:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1964102919 0 0) 0x7f8484116af0 con 0x7f8484099db0 2021-05-26T16:45:54.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8464003270 con 0x7f8484099db0 2021-05-26T16:45:54.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8470001f00 con 0x7f8484096ca0 2021-05-26T16:45:54.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:54.317 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): dump: 2021-05-26T16:45:54.318 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.318 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.318 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.318 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.318 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.321 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.6 v1:172.21.15.3:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8474001c10 con 0x7f8484099db0 2021-05-26T16:45:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2021-05-26T16:45:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient(hunting): dump: 2021-05-26T16:45:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.323 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.323 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.323 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.323 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.324 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.324 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.324 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.324 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.324 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.325 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.325 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.325 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2426003986 0 0) 0x7f8484116d20 con 0x7f848409a260 2021-05-26T16:45:54.325 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.3:6793/0 conn(0x7f8484096ca0 legacy=0x7f848413c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.3:6792/0 conn(0x7f8484099db0 legacy=0x7f84841410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 monclient: found mon.a 2021-05-26T16:45:54.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.326 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:54.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848409bfb0 con 0x7f848409a260 2021-05-26T16:45:54.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f846ffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f848a582700 5 monclient: authenticate success, global_id 104958 2021-05-26T16:45:54.327 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f848a582700 10 monclient: _renew_subs 2021-05-26T16:45:54.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f848a582700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:54.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848412f290 con 0x7f848409a260 2021-05-26T16:45:54.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f848a582700 10 monclient: _renew_subs 2021-05-26T16:45:54.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f848a582700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:54.328 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.273+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f848413ca50 con 0x7f848409a260 2021-05-26T16:45:54.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.274+0000 7f848a582700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.274+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f848413cd00 con 0x7f8484130df0 2021-05-26T16:45:54.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f84780018c0 con 0x7f848409a260 2021-05-26T16:45:54.329 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f84780052a0 con 0x7f848409a260 2021-05-26T16:45:54.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:54.330 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 10 monclient: dump: 2021-05-26T16:45:54.330 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.331 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.331 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.331 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.331 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.331 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.332 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.332 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.332 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.332 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.333 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.333 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.333 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.333 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.333 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.334 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f8478005400 con 0x7f848409a260 2021-05-26T16:45:54.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f84827fc700 4 set_mon_vals no callback set 2021-05-26T16:45:54.334 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(209..209 src has 1..209) v4 ==== 3941+0+0 (unknown 2580962776 0 0) 0x7f847803cf00 con 0x7f848409a260 2021-05-26T16:45:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.275+0000 7f84837fe700 10 monclient: get_auth_request con 0x7f8464033460 auth_method 0 2021-05-26T16:45:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f8483fff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.137:6791/0 conn(0x7f8484130df0 legacy=0x7f8484058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132557250 0 0) 0x7f848413cd00 con 0x7f8484130df0 2021-05-26T16:45:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 10 monclient(hunting): my global_id is 5819 2021-05-26T16:45:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8484116d20 con 0x7f8484130df0 2021-05-26T16:45:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2025146030 0 0) 0x7f8484116d20 con 0x7f8484130df0 2021-05-26T16:45:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f848413cd00 con 0x7f8484130df0 2021-05-26T16:45:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8470002af0 con 0x7f8484130df0 2021-05-26T16:45:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:45:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 10 monclient: dump: 2021-05-26T16:45:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.338 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.338 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.338 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.338 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.339 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.339 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.339 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.339 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.339 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.340 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.340 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.340 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.340 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.340 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.341 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2271296594 0 0) 0x7f848413cd00 con 0x7f8484130df0 2021-05-26T16:45:54.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.277+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f848406c030 con 0x7f8484130df0 2021-05-26T16:45:54.341 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.278+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f8470005510 con 0x7f8484130df0 2021-05-26T16:45:54.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.278+0000 7f846ffff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.278+0000 7f846ffff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:54.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.278+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.137:6791/0 conn(0x7f8484130df0 legacy=0x7f8484058d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.342 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.278+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.137:6791/0 conn(0x7f8484130df0 legacy=0x7f8484058d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.284+0000 7f848a582700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:54.344 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.284+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8484099bd0 con 0x7f84841298e0 2021-05-26T16:45:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f8483fff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.137:6791/0 conn(0x7f84841298e0 legacy=0x7f8484094ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992758454 0 0) 0x7f8484099bd0 con 0x7f84841298e0 2021-05-26T16:45:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 10 monclient(hunting): my global_id is 5828 2021-05-26T16:45:54.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f848413cd00 con 0x7f84841298e0 2021-05-26T16:45:54.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4093903102 0 0) 0x7f848413cd00 con 0x7f84841298e0 2021-05-26T16:45:54.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8484099bd0 con 0x7f84841298e0 2021-05-26T16:45:54.346 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f8470005c50 con 0x7f84841298e0 2021-05-26T16:45:54.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 10 monclient: got monmap 1 from mon.h (according to old e1) 2021-05-26T16:45:54.347 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 10 monclient: dump: 2021-05-26T16:45:54.347 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.347 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.348 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.348 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.348 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.348 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.349 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.349 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.349 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.349 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.349 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.350 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.350 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.350 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.350 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.351 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2021898576 0 0) 0x7f8484099bd0 con 0x7f84841298e0 2021-05-26T16:45:54.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.287+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 --> v1:172.21.15.137:6791/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8484129cc0 con 0x7f84841298e0 2021-05-26T16:45:54.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 <== mon.5 v1:172.21.15.137:6791/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 44963520) 0x7f8470008010 con 0x7f84841298e0 2021-05-26T16:45:54.351 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f846ffff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:54.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f846ffff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:54.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.137:6791/0 conn(0x7f84841298e0 legacy=0x7f8484094ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.352 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f846ffff700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.137:6791/0 conn(0x7f84841298e0 legacy=0x7f8484094ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.352 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:54.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:54.353 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:54.353 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:54.353 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:54.354 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:54.354 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:54.354 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:54.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:54.355 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:54.355 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:54.355 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:54.355 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:54.355 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:54.356 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:54.356 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.356 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 8, 2021-05-26T16:45:54.356 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:54.357 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:54.357 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:54.357 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.357 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.357 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.358 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.358 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.358 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.358 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.359 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.359 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.359 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.359 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:54.359 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:54.360 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.360 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.360 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.360 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.360 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.361 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.361 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.361 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.361 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.362 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.362 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:54.362 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:54.362 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:54.363 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:54.363 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:54.363 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:54.363 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:54.364 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:54.364 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:54.364 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:54.364 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:54.364 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:54.365 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:54.365 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:54.365 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:54.365 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.366 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.366 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.366 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.366 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.366 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.367 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.367 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.367 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.367 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.368 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:54.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.368 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:54.368 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.368 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:54.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:54.369 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.369 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.369 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.370 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.370 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:54.370 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.370 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.370 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.371 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:54.371 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:54.371 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.371 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.372 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.372 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.372 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:54.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:54.373 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.373 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.373 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.373 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.374 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:54.374 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.374 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.374 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.375 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:54.375 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:54.375 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.375 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.376 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.376 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.376 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:54.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:54.377 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.377 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.377 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.377 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.378 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:54.378 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.378 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.378 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.379 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:54.379 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:54.379 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.379 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.380 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.380 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.380 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:54.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:54.381 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.381 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.381 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.381 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.382 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:54.382 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.382 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.382 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.383 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:54.383 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:54.383 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.383 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.384 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.384 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.384 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:54.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:54.385 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.385 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.385 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.385 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.385 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:54.386 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.386 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.386 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.387 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:54.387 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:54.387 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.387 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.387 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.388 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.388 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:54.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:54.388 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.389 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.389 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.389 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.389 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:54.390 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.390 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.390 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.391 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:54.391 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:54.391 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.391 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.391 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.392 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.392 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:54.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:54.393 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.393 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.393 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.393 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.393 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:54.394 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.394 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.394 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.395 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:54.395 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:54.395 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.395 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.395 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.396 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:54.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:54.396 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.397 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.397 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.397 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.397 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:54.397 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.398 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.398 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.398 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:54.398 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:54.399 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.399 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.399 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.399 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.400 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:54.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:54.400 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.400 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.400 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.401 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.401 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:54.401 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.401 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.401 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.402 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:54.402 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:54.402 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.403 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.403 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.403 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.403 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.404 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:54.404 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:54.404 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.404 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.404 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.405 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:54.405 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.405 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.405 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:54.405 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.406 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.406 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.406 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 2 2021-05-26T16:45:54.406 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.406 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.407 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:54.407 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.137:6812/30003 conn(0x7f8464033460 legacy=0x7f8464035920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 10 monclient: shutdown 2021-05-26T16:45:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 >> v1:172.21.15.3:6789/0 conn(0x7f848409a260 legacy=0x7f8484144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f8488b1f700 1 -- 172.21.15.3:0/1159630927 reap_dead start 2021-05-26T16:45:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f8488b1f700 1 -- 172.21.15.3:0/1159630927 reap_dead start 2021-05-26T16:45:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 shutdown_connections 2021-05-26T16:45:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 >> 172.21.15.3:0/1159630927 conn(0x7f848409cc00 msgr2=0x7f848409f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 shutdown_connections 2021-05-26T16:45:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.288+0000 7f848a582700 1 -- 172.21.15.3:0/1159630927 wait complete. 2021-05-26T16:45:54.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2021-05-26T16:45:54.527 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.525+0000 7f33ea7c8700 10 monclient: get_monmap_and_config 2021-05-26T16:45:54.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.525+0000 7f33ea7c8700 10 monclient: build_initial_monmap 2021-05-26T16:45:54.528 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.525+0000 7f33ea7c8700 10 monclient: monmap: 2021-05-26T16:45:54.528 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:54.528 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.529 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:54.526043+0000 2021-05-26T16:45:54.529 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:54.526043+0000 2021-05-26T16:45:54.529 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:54.529 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.530 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:54.530 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:54.530 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:54.530 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:54.531 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:54.531 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:54.531 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:54.531 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:54.531 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:54.532 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 1 Processor -- start 2021-05-26T16:45:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 1 -- start start 2021-05-26T16:45:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient: init 2021-05-26T16:45:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:54.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient: _add_conns ranks=[0,1,5,7,4,8,6,2,3] 2021-05-26T16:45:54.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient(hunting): picked mon.noname-a con 0x7f33e4096ca0 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:54.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient(hunting): picked mon.noname-f con 0x7f33e4099db0 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:54.545 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient(hunting): picked mon.noname-h con 0x7f33e409a260 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:54.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4059750 con 0x7f33e4096ca0 2021-05-26T16:45:54.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4064620 con 0x7f33e4099db0 2021-05-26T16:45:54.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4064e50 con 0x7f33e409a260 2021-05-26T16:45:54.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:54.546 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33ea7c8700 10 monclient(hunting): authenticate will time out at 1112.157649s 2021-05-26T16:45:54.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33e3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f33e4096ca0 0x7f33e4063f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53472/0 (socket says 172.21.15.3:53472) 2021-05-26T16:45:54.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.526+0000 7f33e3fff700 1 -- 172.21.15.3:0/3599246922 learned_addr learned my addr 172.21.15.3:0/3599246922 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:54.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.528+0000 7f33e3fff700 1 -- 172.21.15.3:0/3599246922 >> v1:172.21.15.3:6789/0 conn(0x7f33e4096ca0 legacy=0x7f33e4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.547 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e37fe700 1 -- 172.21.15.3:0/3599246922 >> v1:172.21.15.137:6789/0 conn(0x7f33e4099db0 legacy=0x7f33e4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e8d65700 1 -- 172.21.15.3:0/3599246922 >> v1:172.21.15.137:6791/0 conn(0x7f33e409a260 legacy=0x7f33e41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558892706 0 0) 0x7f33e4059750 con 0x7f33e4096ca0 2021-05-26T16:45:54.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.548 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): my global_id is 104967 2021-05-26T16:45:54.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c8003270 con 0x7f33e4096ca0 2021-05-26T16:45:54.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 <== mon.5 v1:172.21.15.137:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978716778 0 0) 0x7f33e4064e50 con 0x7f33e409a260 2021-05-26T16:45:54.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.549 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): my global_id is 5837 2021-05-26T16:45:54.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 --> v1:172.21.15.137:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4059750 con 0x7f33e409a260 2021-05-26T16:45:54.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102642595 0 0) 0x7f33e4064620 con 0x7f33e4099db0 2021-05-26T16:45:54.550 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient(hunting): my global_id is 5716 2021-05-26T16:45:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4064e50 con 0x7f33e4099db0 2021-05-26T16:45:54.551 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232060822 0 0) 0x7f33c8003270 con 0x7f33e4096ca0 2021-05-26T16:45:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 >> v1:172.21.15.137:6791/0 conn(0x7f33e409a260 legacy=0x7f33e41357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 >> v1:172.21.15.137:6789/0 conn(0x7f33e4099db0 legacy=0x7f33e4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 monclient: found mon.noname-a 2021-05-26T16:45:54.552 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.3:6789/0 2021-05-26T16:45:54.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e409c390 con 0x7f33e4096ca0 2021-05-26T16:45:54.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.553 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33ea7c8700 5 monclient: authenticate success, global_id 104967 2021-05-26T16:45:54.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33ea7c8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:54.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d4001a50 con 0x7f33e4096ca0 2021-05-26T16:45:54.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.554 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:45:54.555 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: dump: 2021-05-26T16:45:54.555 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.555 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.555 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.556 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.556 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.556 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.556 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.557 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.557 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.557 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.557 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.557 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.558 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.558 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.558 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.558 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33ea7c8700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:54.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 <== mon.0 v1:172.21.15.3:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f33d4001d60 con 0x7f33e4096ca0 2021-05-26T16:45:54.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33ea7c8700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:54.559 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33ea7c8700 4 set_mon_vals no callback set 2021-05-26T16:45:54.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 1 -- 172.21.15.3:0/3599246922 <== mon.0 v1:172.21.15.3:6789/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d4004930 con 0x7f33e4096ca0 2021-05-26T16:45:54.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:54.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.529+0000 7f33e2ffd700 10 monclient: dump: 2021-05-26T16:45:54.561 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.561 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.561 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.561 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.561 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.562 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.562 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.562 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.562 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.562 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.563 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.563 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.563 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.563 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.564 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.564 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 10 monclient: shutdown 2021-05-26T16:45:54.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.564 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 1 -- 172.21.15.3:0/3599246922 >> v1:172.21.15.3:6789/0 conn(0x7f33e4096ca0 legacy=0x7f33e4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 1 -- 172.21.15.3:0/3599246922 shutdown_connections 2021-05-26T16:45:54.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 1 -- 172.21.15.3:0/3599246922 >> 172.21.15.3:0/3599246922 conn(0x7f33e409cc00 msgr2=0x7f33e409d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 1 -- 172.21.15.3:0/3599246922 shutdown_connections 2021-05-26T16:45:54.565 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 1 -- 172.21.15.3:0/3599246922 wait complete. 2021-05-26T16:45:54.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 10 monclient: build_initial_monmap 2021-05-26T16:45:54.566 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 10 monclient: monmap: 2021-05-26T16:45:54.566 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:54.566 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:54.566 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:54.567 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:54.567 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:54.567 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.567 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:54.568 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:54.568 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:54.568 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:54.568 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:54.568 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:54.569 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:54.569 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:54.569 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:54.569 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.569 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.530+0000 7f33ea7c8700 1 Processor -- start 2021-05-26T16:45:54.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 1 -- start start 2021-05-26T16:45:54.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient: init 2021-05-26T16:45:54.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:54.570 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient: _add_conns ranks=[4,2,8,7,6,5,3,1,0] 2021-05-26T16:45:54.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient(hunting): picked mon.noname-c con 0x7f33e4096ca0 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:54.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient(hunting): picked mon.noname-b con 0x7f33e4099db0 addr v1:172.21.15.3:6790/0 2021-05-26T16:45:54.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient(hunting): picked mon.noname-e con 0x7f33e409a260 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:54.571 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 1 -- --> v1:172.21.15.3:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4116eb0 con 0x7f33e4099db0 2021-05-26T16:45:54.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4117150 con 0x7f33e4096ca0 2021-05-26T16:45:54.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e412ff40 con 0x7f33e409a260 2021-05-26T16:45:54.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:54.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33ea7c8700 10 monclient(hunting): authenticate will time out at 1112.162621s 2021-05-26T16:45:54.572 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33e3fff700 1 --1- >> v1:172.21.15.3:6791/0 conn(0x7f33e4096ca0 0x7f33e4129710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6791/0 says I am v1:172.21.15.3:38990/0 (socket says 172.21.15.3:38990) 2021-05-26T16:45:54.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33e3fff700 1 -- 172.21.15.3:0/1767833867 learned_addr learned my addr 172.21.15.3:0/1767833867 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:54.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.531+0000 7f33e37fe700 1 --1- 172.21.15.3:0/1767833867 >> v1:172.21.15.3:6790/0 conn(0x7f33e4099db0 0x7f33e41411e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6790/0 says I am v1:172.21.15.3:55522/0 (socket says 172.21.15.3:55522) 2021-05-26T16:45:54.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.533+0000 7f33e8d65700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.3:6793/0 conn(0x7f33e409a260 legacy=0x7f33e4144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.573 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.533+0000 7f33e37fe700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.3:6790/0 conn(0x7f33e4099db0 legacy=0x7f33e41411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.533+0000 7f33e3fff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.3:6791/0 conn(0x7f33e4096ca0 legacy=0x7f33e4129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868583974 0 0) 0x7f33e412ff40 con 0x7f33e409a260 2021-05-26T16:45:54.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.574 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): my global_id is 104939 2021-05-26T16:45:54.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c4003270 con 0x7f33e409a260 2021-05-26T16:45:54.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.2 v1:172.21.15.3:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064805151 0 0) 0x7f33e4116eb0 con 0x7f33e4099db0 2021-05-26T16:45:54.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.575 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): my global_id is 5645 2021-05-26T16:45:54.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e412ff40 con 0x7f33e4099db0 2021-05-26T16:45:54.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951164019 0 0) 0x7f33e4117150 con 0x7f33e4096ca0 2021-05-26T16:45:54.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.576 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): my global_id is 114241 2021-05-26T16:45:54.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4116eb0 con 0x7f33e4096ca0 2021-05-26T16:45:54.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1608007079 0 0) 0x7f33c4003270 con 0x7f33e409a260 2021-05-26T16:45:54.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f33e4117150 con 0x7f33e409a260 2021-05-26T16:45:54.577 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d8002080 con 0x7f33e409a260 2021-05-26T16:45:54.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:54.578 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): dump: 2021-05-26T16:45:54.578 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.578 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.579 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.579 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.579 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.579 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.580 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.580 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.580 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.580 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.580 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.581 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.581 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.581 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.581 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.582 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:54.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3057604880 0 0) 0x7f33e4116eb0 con 0x7f33e4096ca0 2021-05-26T16:45:54.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f33c4003270 con 0x7f33e4096ca0 2021-05-26T16:45:54.582 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.2 v1:172.21.15.3:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 519158204 0 0) 0x7f33e412ff40 con 0x7f33e4099db0 2021-05-26T16:45:54.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f33e4116eb0 con 0x7f33e4099db0 2021-05-26T16:45:54.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d4004870 con 0x7f33e4096ca0 2021-05-26T16:45:54.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.583 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:54.584 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): dump: 2021-05-26T16:45:54.584 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.584 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.584 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.585 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.585 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.585 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.585 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.585 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.587 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.2 v1:172.21.15.3:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d0001d20 con 0x7f33e4099db0 2021-05-26T16:45:54.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2021-05-26T16:45:54.588 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient(hunting): dump: 2021-05-26T16:45:54.588 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.588 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.589 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.589 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.589 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.589 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.590 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.590 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.590 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.590 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.592 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1315997279 0 0) 0x7f33e4117150 con 0x7f33e409a260 2021-05-26T16:45:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.3:6791/0 conn(0x7f33e4096ca0 legacy=0x7f33e4129710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.3:6790/0 conn(0x7f33e4099db0 legacy=0x7f33e41411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 monclient: found mon.e 2021-05-26T16:45:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e413cca0 con 0x7f33e409a260 2021-05-26T16:45:54.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33ea7c8700 5 monclient: authenticate success, global_id 104939 2021-05-26T16:45:54.594 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33ea7c8700 10 monclient: _renew_subs 2021-05-26T16:45:54.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33ea7c8700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:54.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6793/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e412f460 con 0x7f33e409a260 2021-05-26T16:45:54.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33ea7c8700 10 monclient: _renew_subs 2021-05-26T16:45:54.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33ea7c8700 10 monclient: _send_mon_message to mon.e at v1:172.21.15.3:6793/0 2021-05-26T16:45:54.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.3:6793/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4131540 con 0x7f33e409a260 2021-05-26T16:45:54.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f33d8002680 con 0x7f33e409a260 2021-05-26T16:45:54.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d8002b30 con 0x7f33e409a260 2021-05-26T16:45:54.596 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33e27fc700 4 set_mon_vals no callback set 2021-05-26T16:45:54.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:54.597 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.534+0000 7f33cffff700 10 monclient: dump: 2021-05-26T16:45:54.597 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.597 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.598 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.598 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.598 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.598 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.598 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.599 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.599 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.599 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.599 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.599 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.600 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.600 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.600 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.600 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.535+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f33d8002c90 con 0x7f33e409a260 2021-05-26T16:45:54.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.535+0000 7f33ea7c8700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.535+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f33bc0065a0 con 0x7f33bc002840 2021-05-26T16:45:54.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.535+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.8 v1:172.21.15.3:6793/0 8 ==== osd_map(209..209 src has 1..209) v4 ==== 3941+0+0 (unknown 2580962776 0 0) 0x7f33d803dc80 con 0x7f33e409a260 2021-05-26T16:45:54.601 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.535+0000 7f33e37fe700 10 monclient: get_auth_request con 0x7f33c40335b0 auth_method 0 2021-05-26T16:45:54.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.536+0000 7f33e37fe700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6812/30003 conn(0x7f33c40335b0 legacy=0x7f33c4035a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-05-26T16:45:54.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.536+0000 7f33e37fe700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6812/30003 conn(0x7f33c40335b0 legacy=0x7f33c4035a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-05-26T16:45:54.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.536+0000 7f33e37fe700 1 --1- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6812/30003 conn(0x7f33c40335b0 0x7f33c4035a70 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-05-26T16:45:54.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.536+0000 7f33e37fe700 1 --1- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6812/30003 conn(0x7f33c40335b0 0x7f33c4035a70 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-05-26T16:45:54.602 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.536+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6812/30003 conn(0x7f33c40335b0 legacy=0x7f33c4035a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33e3fff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6792/0 conn(0x7f33bc002840 legacy=0x7f33bc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956415145 0 0) 0x7f33bc0065a0 con 0x7f33bc002840 2021-05-26T16:45:54.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.603 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 10 monclient(hunting): my global_id is 104776 2021-05-26T16:45:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4117150 con 0x7f33bc002840 2021-05-26T16:45:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 725738319 0 0) 0x7f33e4117150 con 0x7f33bc002840 2021-05-26T16:45:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f33bc0065a0 con 0x7f33bc002840 2021-05-26T16:45:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d4001320 con 0x7f33bc002840 2021-05-26T16:45:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.605 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:54.605 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 10 monclient: dump: 2021-05-26T16:45:54.605 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.605 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.605 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.608 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.608 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.608 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.608 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 7705576 0 0) 0x7f33bc0065a0 con 0x7f33bc002840 2021-05-26T16:45:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.538+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33bc009e40 con 0x7f33bc002840 2021-05-26T16:45:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.539+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f33d4006f80 con 0x7f33bc002840 2021-05-26T16:45:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.539+0000 7f33cffff700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.539+0000 7f33cffff700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.539+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6792/0 conn(0x7f33bc002840 legacy=0x7f33bc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.610 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.539+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6792/0 conn(0x7f33bc002840 legacy=0x7f33bc004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.545+0000 7f33ea7c8700 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2021-05-26T16:45:54.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.545+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f33bc007510 con 0x7f33bc0068b0 2021-05-26T16:45:54.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33e3fff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6792/0 conn(0x7f33bc0068b0 legacy=0x7f33bc006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.612 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127907467 0 0) 0x7f33bc007510 con 0x7f33bc0068b0 2021-05-26T16:45:54.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 10 monclient(hunting): my global_id is 104785 2021-05-26T16:45:54.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33bc0065a0 con 0x7f33bc0068b0 2021-05-26T16:45:54.613 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 652000765 0 0) 0x7f33bc0065a0 con 0x7f33bc0068b0 2021-05-26T16:45:54.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f33bc007510 con 0x7f33bc0068b0 2021-05-26T16:45:54.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f33d40055f0 con 0x7f33bc0068b0 2021-05-26T16:45:54.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:54.614 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 10 monclient: dump: 2021-05-26T16:45:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.617 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.617 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.617 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.617 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.617 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.618 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3456831758 0 0) 0x7f33bc007510 con 0x7f33bc0068b0 2021-05-26T16:45:54.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.548+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 --> v1:172.21.15.137:6792/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f33bc008770 con 0x7f33bc0068b0 2021-05-26T16:45:54.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7322 (unknown 0 0 3214913280) 0x7f33d4007190 con 0x7f33bc0068b0 2021-05-26T16:45:54.618 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33cffff700 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2021-05-26T16:45:54.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33cffff700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:54.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6792/0 conn(0x7f33bc0068b0 legacy=0x7f33bc006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33cffff700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.137:6792/0 conn(0x7f33bc0068b0 legacy=0x7f33bc006d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.619 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33e8d65700 1 -- 172.21.15.3:0/1767833867 reap_dead start 2021-05-26T16:45:54.620 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:54.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:54.620 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:54.620 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "peon", 2021-05-26T16:45:54.621 INFO:teuthology.orchestra.run.smithi003.stdout: "election_epoch": 30, 2021-05-26T16:45:54.621 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum": [ 2021-05-26T16:45:54.621 INFO:teuthology.orchestra.run.smithi003.stdout: 0, 2021-05-26T16:45:54.621 INFO:teuthology.orchestra.run.smithi003.stdout: 1, 2021-05-26T16:45:54.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2, 2021-05-26T16:45:54.622 INFO:teuthology.orchestra.run.smithi003.stdout: 3, 2021-05-26T16:45:54.622 INFO:teuthology.orchestra.run.smithi003.stdout: 4, 2021-05-26T16:45:54.622 INFO:teuthology.orchestra.run.smithi003.stdout: 5, 2021-05-26T16:45:54.622 INFO:teuthology.orchestra.run.smithi003.stdout: 6, 2021-05-26T16:45:54.622 INFO:teuthology.orchestra.run.smithi003.stdout: 7, 2021-05-26T16:45:54.623 INFO:teuthology.orchestra.run.smithi003.stdout: 8 2021-05-26T16:45:54.623 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.623 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_age": 8, 2021-05-26T16:45:54.623 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:54.624 INFO:teuthology.orchestra.run.smithi003.stdout: "required_con": "2449958755906961412", 2021-05-26T16:45:54.624 INFO:teuthology.orchestra.run.smithi003.stdout: "required_mon": [ 2021-05-26T16:45:54.624 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.624 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.624 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.625 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.625 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.625 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.625 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.625 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.626 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.626 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.626 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_con": "4540138303579357183", 2021-05-26T16:45:54.626 INFO:teuthology.orchestra.run.smithi003.stdout: "quorum_mon": [ 2021-05-26T16:45:54.627 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.627 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.627 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.627 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.627 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.628 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.628 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.628 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.628 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.628 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.629 INFO:teuthology.orchestra.run.smithi003.stdout: "outside_quorum": [], 2021-05-26T16:45:54.629 INFO:teuthology.orchestra.run.smithi003.stdout: "extra_probe_peers": [], 2021-05-26T16:45:54.629 INFO:teuthology.orchestra.run.smithi003.stdout: "sync_provider": [], 2021-05-26T16:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": { 2021-05-26T16:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 1, 2021-05-26T16:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "1c28cdc4-a665-4986-9729-a987ae3508f4", 2021-05-26T16:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: "modified": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: "created": "2021-05-26T16:40:21.025302Z", 2021-05-26T16:45:54.631 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release": 17, 2021-05-26T16:45:54.631 INFO:teuthology.orchestra.run.smithi003.stdout: "min_mon_release_name": "quincy", 2021-05-26T16:45:54.631 INFO:teuthology.orchestra.run.smithi003.stdout: "election_strategy": 1, 2021-05-26T16:45:54.631 INFO:teuthology.orchestra.run.smithi003.stdout: "disallowed_leaders: ": "", 2021-05-26T16:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false, 2021-05-26T16:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: "features": { 2021-05-26T16:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: "persistent": [ 2021-05-26T16:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: "kraken", 2021-05-26T16:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: "luminous", 2021-05-26T16:45:54.633 INFO:teuthology.orchestra.run.smithi003.stdout: "mimic", 2021-05-26T16:45:54.633 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap-prune", 2021-05-26T16:45:54.633 INFO:teuthology.orchestra.run.smithi003.stdout: "nautilus", 2021-05-26T16:45:54.633 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus", 2021-05-26T16:45:54.633 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific", 2021-05-26T16:45:54.633 INFO:teuthology.orchestra.run.smithi003.stdout: "elector-pinging", 2021-05-26T16:45:54.634 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy" 2021-05-26T16:45:54.634 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.634 INFO:teuthology.orchestra.run.smithi003.stdout: "optional": [] 2021-05-26T16:45:54.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.635 INFO:teuthology.orchestra.run.smithi003.stdout: "mons": [ 2021-05-26T16:45:54.635 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.635 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 0, 2021-05-26T16:45:54.635 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "a", 2021-05-26T16:45:54.635 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.636 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.636 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.636 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.636 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789", 2021-05-26T16:45:54.637 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.637 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.637 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.637 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.637 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6789/0", 2021-05-26T16:45:54.638 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6789/0", 2021-05-26T16:45:54.638 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.638 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.638 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.639 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.639 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 1, 2021-05-26T16:45:54.639 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "f", 2021-05-26T16:45:54.639 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.640 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.640 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.640 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.640 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789", 2021-05-26T16:45:54.640 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6789/0", 2021-05-26T16:45:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6789/0", 2021-05-26T16:45:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 2, 2021-05-26T16:45:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "b", 2021-05-26T16:45:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.644 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.644 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790", 2021-05-26T16:45:54.644 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.644 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.644 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.645 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.645 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6790/0", 2021-05-26T16:45:54.645 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6790/0", 2021-05-26T16:45:54.645 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.645 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.646 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.646 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.646 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.646 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 3, 2021-05-26T16:45:54.647 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "g", 2021-05-26T16:45:54.647 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.647 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.647 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.647 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.648 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790", 2021-05-26T16:45:54.648 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.648 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.648 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.648 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.648 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6790/0", 2021-05-26T16:45:54.649 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6790/0", 2021-05-26T16:45:54.649 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.649 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.649 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.650 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.650 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 4, 2021-05-26T16:45:54.650 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "c", 2021-05-26T16:45:54.650 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.650 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.651 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.651 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.651 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791", 2021-05-26T16:45:54.651 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.652 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.652 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.652 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.652 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6791/0", 2021-05-26T16:45:54.652 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6791/0", 2021-05-26T16:45:54.653 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.653 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.653 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.653 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.654 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.654 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 5, 2021-05-26T16:45:54.654 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "h", 2021-05-26T16:45:54.654 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.654 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.655 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.655 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.655 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791", 2021-05-26T16:45:54.655 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.655 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.656 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.656 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.656 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6791/0", 2021-05-26T16:45:54.656 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6791/0", 2021-05-26T16:45:54.656 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.657 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.657 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.657 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.657 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.657 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 6, 2021-05-26T16:45:54.658 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "d", 2021-05-26T16:45:54.658 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.658 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.658 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.659 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.659 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792", 2021-05-26T16:45:54.659 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.659 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.660 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.660 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6792/0", 2021-05-26T16:45:54.660 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6792/0", 2021-05-26T16:45:54.660 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.661 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.661 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.661 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.661 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 7, 2021-05-26T16:45:54.662 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "i", 2021-05-26T16:45:54.662 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.662 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.662 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.662 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.663 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792", 2021-05-26T16:45:54.663 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.663 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.663 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.663 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.664 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.137:6792/0", 2021-05-26T16:45:54.664 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.137:6792/0", 2021-05-26T16:45:54.664 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.664 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.664 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.665 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.665 INFO:teuthology.orchestra.run.smithi003.stdout: "rank": 8, 2021-05-26T16:45:54.665 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "e", 2021-05-26T16:45:54.666 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrs": { 2021-05-26T16:45:54.666 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2021-05-26T16:45:54.666 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.666 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2021-05-26T16:45:54.666 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793", 2021-05-26T16:45:54.667 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 0 2021-05-26T16:45:54.667 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.667 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.667 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.667 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6793/0", 2021-05-26T16:45:54.668 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "172.21.15.3:6793/0", 2021-05-26T16:45:54.668 INFO:teuthology.orchestra.run.smithi003.stdout: "priority": 0, 2021-05-26T16:45:54.668 INFO:teuthology.orchestra.run.smithi003.stdout: "weight": 0, 2021-05-26T16:45:54.668 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "{}" 2021-05-26T16:45:54.668 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.669 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.669 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.669 INFO:teuthology.orchestra.run.smithi003.stdout: "feature_map": { 2021-05-26T16:45:54.669 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": [ 2021-05-26T16:45:54.669 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.670 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.670 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.670 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:54.670 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.671 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2021-05-26T16:45:54.671 INFO:teuthology.orchestra.run.smithi003.stdout: "client": [ 2021-05-26T16:45:54.671 INFO:teuthology.orchestra.run.smithi003.stdout: { 2021-05-26T16:45:54.671 INFO:teuthology.orchestra.run.smithi003.stdout: "features": "0x3f01cfbb7ffdffff", 2021-05-26T16:45:54.671 INFO:teuthology.orchestra.run.smithi003.stdout: "release": "luminous", 2021-05-26T16:45:54.672 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 1 2021-05-26T16:45:54.672 INFO:teuthology.orchestra.run.smithi003.stdout: } 2021-05-26T16:45:54.672 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2021-05-26T16:45:54.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2021-05-26T16:45:54.673 INFO:teuthology.orchestra.run.smithi003.stdout: "stretch_mode": false 2021-05-26T16:45:54.673 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33ea7c8700 10 monclient: shutdown 2021-05-26T16:45:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33ea7c8700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 >> v1:172.21.15.3:6793/0 conn(0x7f33e409a260 legacy=0x7f33e4144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 shutdown_connections 2021-05-26T16:45:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 >> 172.21.15.3:0/1767833867 conn(0x7f33e409cc00 msgr2=0x7f33e409df10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 shutdown_connections 2021-05-26T16:45:54.676 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.549+0000 7f33ea7c8700 1 -- 172.21.15.3:0/1767833867 wait complete. 2021-05-26T16:45:54.676 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['i', 'c', 'd'] 2021-05-26T16:45:54.676 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['f'] 2021-05-26T16:45:54.677 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2021-05-26T16:45:54.677 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i store 2021-05-26T16:45:54.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i sync_force --yes-i-really-mean-it 2021-05-26T16:45:54.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.793+0000 7f59e7aa1700 10 monclient: get_monmap_and_config 2021-05-26T16:45:54.795 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.793+0000 7f59e7aa1700 10 monclient: build_initial_monmap 2021-05-26T16:45:54.796 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.793+0000 7f59e7aa1700 10 monclient: monmap: 2021-05-26T16:45:54.796 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:54.796 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.796 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:54.793937+0000 2021-05-26T16:45:54.797 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:54.793937+0000 2021-05-26T16:45:54.797 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:54.797 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.797 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:54.797 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:54.798 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:54.798 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:54.798 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:54.798 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:54.799 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:54.799 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:54.799 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:54.799 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.793+0000 7f59e7aa1700 1 Processor -- start 2021-05-26T16:45:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 1 -- start start 2021-05-26T16:45:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient: init 2021-05-26T16:45:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient: _add_conns ranks=[8,6,0,4,7,5,3,2,1] 2021-05-26T16:45:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient(hunting): picked mon.noname-e con 0x7f59e0095700 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient(hunting): picked mon.noname-d con 0x7f59e0093760 addr v1:172.21.15.3:6792/0 2021-05-26T16:45:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient(hunting): picked mon.noname-a con 0x7f59e012f750 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:54.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e0059750 con 0x7f59e012f750 2021-05-26T16:45:54.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 1 -- --> v1:172.21.15.3:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e0093f50 con 0x7f59e0093760 2021-05-26T16:45:54.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e00941f0 con 0x7f59e0095700 2021-05-26T16:45:54.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:54.812 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e7aa1700 10 monclient(hunting): authenticate will time out at 1112.425573s 2021-05-26T16:45:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e503c700 1 --1- >> v1:172.21.15.3:6792/0 conn(0x7f59e0093760 0x7f59e0095ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6792/0 says I am v1:172.21.15.3:58890/0 (socket says 172.21.15.3:58890) 2021-05-26T16:45:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e503c700 1 -- 172.21.15.3:0/3107670199 learned_addr learned my addr 172.21.15.3:0/3107670199 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e603e700 1 --1- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6789/0 conn(0x7f59e012f750 0x7f59e0131b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53490/0 (socket says 172.21.15.3:53490) 2021-05-26T16:45:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.794+0000 7f59e583d700 1 --1- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6793/0 conn(0x7f59e0095700 0x7f59e0094d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54570/0 (socket says 172.21.15.3:54570) 2021-05-26T16:45:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.796+0000 7f59e503c700 1 -- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6792/0 conn(0x7f59e0093760 legacy=0x7f59e0095ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.796+0000 7f59e603e700 1 -- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6789/0 conn(0x7f59e012f750 legacy=0x7f59e0131b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.796+0000 7f59e583d700 1 -- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6793/0 conn(0x7f59e0095700 legacy=0x7f59e0094d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720456839 0 0) 0x7f59e0059750 con 0x7f59e012f750 2021-05-26T16:45:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): my global_id is 104976 2021-05-26T16:45:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c8003270 con 0x7f59e012f750 2021-05-26T16:45:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329127144 0 0) 0x7f59e00941f0 con 0x7f59e0095700 2021-05-26T16:45:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): my global_id is 104948 2021-05-26T16:45:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e0059750 con 0x7f59e0095700 2021-05-26T16:45:54.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 <== mon.6 v1:172.21.15.3:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725257603 0 0) 0x7f59e0093f50 con 0x7f59e0093760 2021-05-26T16:45:54.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient(hunting): my global_id is 5721 2021-05-26T16:45:54.817 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 --> v1:172.21.15.3:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e00941f0 con 0x7f59e0093760 2021-05-26T16:45:54.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1095775492 0 0) 0x7f59e0059750 con 0x7f59e0095700 2021-05-26T16:45:54.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6792/0 conn(0x7f59e0093760 legacy=0x7f59e0095ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6789/0 conn(0x7f59e012f750 legacy=0x7f59e0131b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.818 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 monclient: found mon.noname-e 2021-05-26T16:45:54.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.3:6793/0 2021-05-26T16:45:54.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 --> v1:172.21.15.3:6793/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0094490 con 0x7f59e0095700 2021-05-26T16:45:54.819 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59d4001990 con 0x7f59e0095700 2021-05-26T16:45:54.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2021-05-26T16:45:54.821 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: dump: 2021-05-26T16:45:54.821 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.821 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.821 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.821 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.822 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.822 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.822 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.822 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.822 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.823 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.823 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.823 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.823 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.824 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.824 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.824 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e7aa1700 5 monclient: authenticate success, global_id 104948 2021-05-26T16:45:54.824 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e7aa1700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:54.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 <== mon.8 v1:172.21.15.3:6793/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f59d4001cb0 con 0x7f59e0095700 2021-05-26T16:45:54.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 1 -- 172.21.15.3:0/3107670199 <== mon.8 v1:172.21.15.3:6793/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59d4005980 con 0x7f59e0095700 2021-05-26T16:45:54.825 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e7aa1700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:54.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e7aa1700 4 set_mon_vals no callback set 2021-05-26T16:45:54.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:54.826 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.797+0000 7f59e483b700 10 monclient: dump: 2021-05-26T16:45:54.826 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.827 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.827 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.827 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.827 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.828 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.830 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 10 monclient: shutdown 2021-05-26T16:45:54.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.830 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3107670199 >> v1:172.21.15.3:6793/0 conn(0x7f59e0095700 legacy=0x7f59e0094d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3107670199 shutdown_connections 2021-05-26T16:45:54.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3107670199 >> 172.21.15.3:0/3107670199 conn(0x7f59e005d960 msgr2=0x7f59e005dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3107670199 shutdown_connections 2021-05-26T16:45:54.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3107670199 wait complete. 2021-05-26T16:45:54.831 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 10 monclient: build_initial_monmap 2021-05-26T16:45:54.832 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 10 monclient: monmap: 2021-05-26T16:45:54.832 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:54.832 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:54.832 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:54.835 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:54.835 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:54.835 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.835 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.798+0000 7f59e7aa1700 1 Processor -- start 2021-05-26T16:45:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 1 -- start start 2021-05-26T16:45:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient: init 2021-05-26T16:45:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient: _add_conns ranks=[1,4,8,0,5,2,7,3,6] 2021-05-26T16:45:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient(hunting): picked mon.noname-f con 0x7f59e0093760 addr v1:172.21.15.137:6789/0 2021-05-26T16:45:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient(hunting): picked mon.noname-c con 0x7f59e0095700 addr v1:172.21.15.3:6791/0 2021-05-26T16:45:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient(hunting): picked mon.noname-e con 0x7f59e012f750 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e0115410 con 0x7f59e0093760 2021-05-26T16:45:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 1 -- --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e01156b0 con 0x7f59e0095700 2021-05-26T16:45:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e0115950 con 0x7f59e012f750 2021-05-26T16:45:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e7aa1700 10 monclient(hunting): authenticate will time out at 1112.430441s 2021-05-26T16:45:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e603e700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7f59e012f750 0x7f59e0140520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54580/0 (socket says 172.21.15.3:54580) 2021-05-26T16:45:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.799+0000 7f59e603e700 1 -- 172.21.15.3:0/3082164758 learned_addr learned my addr 172.21.15.3:0/3082164758 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:54.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59e503c700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.3:6791/0 conn(0x7f59e0095700 legacy=0x7f59e013cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59e603e700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.3:6793/0 conn(0x7f59e012f750 legacy=0x7f59e0140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59e583d700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6789/0 conn(0x7f59e0093760 legacy=0x7f59e0138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.839 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011832944 0 0) 0x7f59e01156b0 con 0x7f59e0095700 2021-05-26T16:45:54.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 10 monclient(hunting): my global_id is 114250 2021-05-26T16:45:54.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.3:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c0003270 con 0x7f59e0095700 2021-05-26T16:45:54.840 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.8 v1:172.21.15.3:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624439740 0 0) 0x7f59e0115950 con 0x7f59e012f750 2021-05-26T16:45:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 10 monclient(hunting): my global_id is 104957 2021-05-26T16:45:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.801+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.3:6793/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e01156b0 con 0x7f59e012f750 2021-05-26T16:45:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369789772 0 0) 0x7f59e0115410 con 0x7f59e0093760 2021-05-26T16:45:54.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.845 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): my global_id is 5725 2021-05-26T16:45:54.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e0115950 con 0x7f59e0093760 2021-05-26T16:45:54.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 280314246 0 0) 0x7f59c0003270 con 0x7f59e0095700 2021-05-26T16:45:54.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.3:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59e0115410 con 0x7f59e0095700 2021-05-26T16:45:54.846 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59d0001cb0 con 0x7f59e0095700 2021-05-26T16:45:54.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2021-05-26T16:45:54.847 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): dump: 2021-05-26T16:45:54.847 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.847 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.851 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.8 v1:172.21.15.3:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3707914322 0 0) 0x7f59e01156b0 con 0x7f59e012f750 2021-05-26T16:45:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.3:6793/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59c0003270 con 0x7f59e012f750 2021-05-26T16:45:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.8 v1:172.21.15.3:6793/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59dc0048b0 con 0x7f59e012f750 2021-05-26T16:45:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2021-05-26T16:45:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): dump: 2021-05-26T16:45:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.856 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2884921820 0 0) 0x7f59e0115950 con 0x7f59e0093760 2021-05-26T16:45:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59e01156b0 con 0x7f59e0093760 2021-05-26T16:45:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59d4005980 con 0x7f59e0093760 2021-05-26T16:45:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2021-05-26T16:45:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient(hunting): dump: 2021-05-26T16:45:54.858 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.858 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.858 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.858 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.858 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.859 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.859 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.859 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.859 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.861 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3501027978 0 0) 0x7f59e0115410 con 0x7f59e0095700 2021-05-26T16:45:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.3:6793/0 conn(0x7f59e012f750 legacy=0x7f59e0140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6789/0 conn(0x7f59e0093760 legacy=0x7f59e0138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 monclient: found mon.c 2021-05-26T16:45:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:54.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:54.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.3:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0113a80 con 0x7f59e0095700 2021-05-26T16:45:54.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:54.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:54.863 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59e7aa1700 5 monclient: authenticate success, global_id 114250 2021-05-26T16:45:54.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59e7aa1700 10 monclient: _renew_subs 2021-05-26T16:45:54.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59e7aa1700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:54.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.3:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e0114750 con 0x7f59e0095700 2021-05-26T16:45:54.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f59d0001970 con 0x7f59e0095700 2021-05-26T16:45:54.864 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59d0004e60 con 0x7f59e0095700 2021-05-26T16:45:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient: got monmap 1 from mon.c (according to old e1) 2021-05-26T16:45:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cdffb700 10 monclient: dump: 2021-05-26T16:45:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.869 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59cffff700 4 set_mon_vals no callback set 2021-05-26T16:45:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59e7aa1700 10 monclient: _renew_subs 2021-05-26T16:45:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59e7aa1700 10 monclient: _send_mon_message to mon.c at v1:172.21.15.3:6791/0 2021-05-26T16:45:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.802+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.3:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e0138920 con 0x7f59e0095700 2021-05-26T16:45:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.803+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7f59d000e3d0 con 0x7f59e0095700 2021-05-26T16:45:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.803+0000 7f59e7aa1700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.803+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f59e005ded0 con 0x7f59e012fb30 2021-05-26T16:45:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.803+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.4 v1:172.21.15.3:6791/0 8 ==== osd_map(209..209 src has 1..209) v4 ==== 3941+0+0 (unknown 2580962776 0 0) 0x7f59d003d900 con 0x7f59e0095700 2021-05-26T16:45:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.803+0000 7f59e603e700 10 monclient: get_auth_request con 0x7f59c0033310 auth_method 0 2021-05-26T16:45:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.805+0000 7f59e583d700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6792/0 conn(0x7f59e012fb30 legacy=0x7f59e0064250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046275815 0 0) 0x7f59e005ded0 con 0x7f59e012fb30 2021-05-26T16:45:54.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient(hunting): my global_id is 104794 2021-05-26T16:45:54.872 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e0115410 con 0x7f59e012fb30 2021-05-26T16:45:54.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2296617718 0 0) 0x7f59e0115410 con 0x7f59e012fb30 2021-05-26T16:45:54.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59e005ded0 con 0x7f59e012fb30 2021-05-26T16:45:54.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59d4004a80 con 0x7f59e012fb30 2021-05-26T16:45:54.873 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:54.874 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient: dump: 2021-05-26T16:45:54.874 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.874 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.874 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.875 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.875 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.875 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.875 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.877 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1870815157 0 0) 0x7f59e005ded0 con 0x7f59e012fb30 2021-05-26T16:45:54.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59e006c030 con 0x7f59e012fb30 2021-05-26T16:45:54.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f59d4004d60 con 0x7f59e012fb30 2021-05-26T16:45:54.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:54.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 10 monclient: _finish_command 1 = system:0 2021-05-26T16:45:54.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6792/0 conn(0x7f59e012fb30 legacy=0x7f59e0064250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.806+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6792/0 conn(0x7f59e012fb30 legacy=0x7f59e0064250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.814+0000 7f59e7aa1700 10 start_mon_command cmd=[{"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}] 2021-05-26T16:45:54.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.814+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f59e00952f0 con 0x7f59e0027d00 2021-05-26T16:45:54.881 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59e583d700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6792/0 conn(0x7f59e0027d00 legacy=0x7f59e0064960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:54.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481108013 0 0) 0x7f59e00952f0 con 0x7f59e0027d00 2021-05-26T16:45:54.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:54.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:54.882 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 10 monclient(hunting): my global_id is 104803 2021-05-26T16:45:54.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e005ded0 con 0x7f59e0027d00 2021-05-26T16:45:54.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1596779791 0 0) 0x7f59e005ded0 con 0x7f59e0027d00 2021-05-26T16:45:54.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59e00952f0 con 0x7f59e0027d00 2021-05-26T16:45:54.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7f59d4006000 con 0x7f59e0027d00 2021-05-26T16:45:54.883 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:54.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 10 monclient: got monmap 1 from mon.i (according to old e1) 2021-05-26T16:45:54.884 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 10 monclient: dump: 2021-05-26T16:45:54.884 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:54.884 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:54.885 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.885 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:54.885 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:54.885 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:54.885 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:54.887 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:54.887 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:54.887 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:54.887 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:54.887 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 186814078 0 0) 0x7f59e00952f0 con 0x7f59e0027d00 2021-05-26T16:45:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.817+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 --> v1:172.21.15.137:6792/0 -- command(tid 2: {"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}) v1 -- 0x7f59e0065070 con 0x7f59e0027d00 2021-05-26T16:45:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 <== mon.7 v1:172.21.15.137:6792/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+83 (unknown 0 0 2946029456) 0x7f59d4006350 con 0x7f59e0027d00 2021-05-26T16:45:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59cdffb700 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "validate": "--yes-i-really-mean-it"}] 2021-05-26T16:45:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59cdffb700 10 monclient: _finish_command 2 = system:0 2021-05-26T16:45:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6792/0 conn(0x7f59e0027d00 legacy=0x7f59e0064960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59cdffb700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6792/0 conn(0x7f59e0027d00 legacy=0x7f59e0064960 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:54.889 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2021-05-26T16:45:54.890 INFO:teuthology.orchestra.run.smithi003.stdout: "ret": 0, 2021-05-26T16:45:54.890 INFO:teuthology.orchestra.run.smithi003.stdout: "msg": "forcing store sync the next time the monitor starts" 2021-05-26T16:45:54.890 INFO:teuthology.orchestra.run.smithi003.stdout:} 2021-05-26T16:45:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.137:6812/30003 conn(0x7f59c0033310 legacy=0x7f59c00357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e7aa1700 10 monclient: shutdown 2021-05-26T16:45:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e7aa1700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 >> v1:172.21.15.3:6791/0 conn(0x7f59e0095700 legacy=0x7f59e013cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:54.893 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e603e700 1 -- 172.21.15.3:0/3082164758 reap_dead start 2021-05-26T16:45:54.893 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e603e700 1 -- 172.21.15.3:0/3082164758 reap_dead start 2021-05-26T16:45:54.893 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 shutdown_connections 2021-05-26T16:45:54.893 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 >> 172.21.15.3:0/3082164758 conn(0x7f59e005d960 msgr2=0x7f59e012e750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:54.894 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.818+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 shutdown_connections 2021-05-26T16:45:54.894 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:54.819+0000 7f59e7aa1700 1 -- 172.21.15.3:0/3082164758 wait complete. 2021-05-26T16:45:54.894 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2021-05-26T16:45:54.895 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2021-05-26T16:45:54.895 INFO:teuthology.orchestra.run:waiting for 300 2021-05-26T16:45:54.906 INFO:tasks.ceph.mon.i:Stopped 2021-05-26T16:45:54.907 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2021-05-26T16:45:54.907 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c store 2021-05-26T16:45:54.907 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c sync_force --yes-i-really-mean-it 2021-05-26T16:45:55.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.023+0000 7ff8d7fff700 10 monclient: get_monmap_and_config 2021-05-26T16:45:55.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.023+0000 7ff8d7fff700 10 monclient: build_initial_monmap 2021-05-26T16:45:55.026 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.023+0000 7ff8d7fff700 10 monclient: monmap: 2021-05-26T16:45:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:45:55.024423+0000 2021-05-26T16:45:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:45:55.024423+0000 2021-05-26T16:45:55.027 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:55.030 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 1 Processor -- start 2021-05-26T16:45:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 1 -- start start 2021-05-26T16:45:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 10 monclient: init 2021-05-26T16:45:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 10 monclient: _add_conns ranks=[7,8,3,0,6,1,4,5,2] 2021-05-26T16:45:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 10 monclient(hunting): picked mon.noname-i con 0x7ff8d8129770 addr v1:172.21.15.137:6792/0 2021-05-26T16:45:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 10 monclient(hunting): picked mon.noname-e con 0x7ff8d8096d10 addr v1:172.21.15.3:6793/0 2021-05-26T16:45:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 10 monclient(hunting): picked mon.noname-g con 0x7ff8d812a050 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d8046600 con 0x7ff8d812a050 2021-05-26T16:45:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.024+0000 7ff8d7fff700 1 -- --> v1:172.21.15.137:6792/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d809c5d0 con 0x7ff8d8129770 2021-05-26T16:45:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.025+0000 7ff8d7fff700 1 -- --> v1:172.21.15.3:6793/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d812a4c0 con 0x7ff8d8096d10 2021-05-26T16:45:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.025+0000 7ff8d7fff700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.025+0000 7ff8d7fff700 10 monclient(hunting): authenticate will time out at 1112.656018s 2021-05-26T16:45:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.025+0000 7ff8d6ffd700 1 -- >> v1:172.21.15.137:6792/0 conn(0x7ff8d8129770 legacy=0x7ff8d8099ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6792/0 2021-05-26T16:45:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.025+0000 7ff8d67fc700 1 --1- >> v1:172.21.15.3:6793/0 conn(0x7ff8d8096d10 0x7ff8d8132020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6793/0 says I am v1:172.21.15.3:54592/0 (socket says 172.21.15.3:54592) 2021-05-26T16:45:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.025+0000 7ff8d67fc700 1 -- 172.21.15.3:0/717151059 learned_addr learned my addr 172.21.15.3:0/717151059 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.027+0000 7ff8d67fc700 1 -- 172.21.15.3:0/717151059 >> v1:172.21.15.3:6793/0 conn(0x7ff8d8096d10 legacy=0x7ff8d8132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.027+0000 7ff8d77fe700 1 -- 172.21.15.3:0/717151059 >> v1:172.21.15.137:6790/0 conn(0x7ff8d812a050 legacy=0x7ff8d8135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.027+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 <== mon.3 v1:172.21.15.137:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559283170 0 0) 0x7ff8d8046600 con 0x7ff8d812a050 2021-05-26T16:45:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.027+0000 7ff8d5ffb700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.027+0000 7ff8d5ffb700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.027+0000 7ff8d5ffb700 10 monclient(hunting): my global_id is 5610 2021-05-26T16:45:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.027+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 --> v1:172.21.15.137:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c4003270 con 0x7ff8d812a050 2021-05-26T16:45:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 <== mon.3 v1:172.21.15.137:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2704065159 0 0) 0x7ff8c4003270 con 0x7ff8d812a050 2021-05-26T16:45:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 >> v1:172.21.15.3:6793/0 conn(0x7ff8d8096d10 legacy=0x7ff8d8132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:55.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 >> v1:172.21.15.137:6792/0 conn(0x7ff8d8129770 legacy=0x7ff8d8099ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-05-26T16:45:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: _finish_hunting 0 2021-05-26T16:45:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 monclient: found mon.noname-g 2021-05-26T16:45:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.137:6790/0 2021-05-26T16:45:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 --> v1:172.21.15.137:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8097580 con 0x7ff8d812a050 2021-05-26T16:45:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: _finish_auth 0 2021-05-26T16:45:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 <== mon.3 v1:172.21.15.137:6790/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff8c8001ef0 con 0x7ff8d812a050 2021-05-26T16:45:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 5 monclient: authenticate success, global_id 5610 2021-05-26T16:45:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2021-05-26T16:45:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: dump: 2021-05-26T16:45:55.047 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:55.050 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:55.051 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 20 monclient: get_monmap_and_config waiting for monmap|config 2021-05-26T16:45:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 <== mon.3 v1:172.21.15.137:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff8c8002280 con 0x7ff8d812a050 2021-05-26T16:45:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 10 monclient: get_monmap_and_config success 2021-05-26T16:45:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 4 set_mon_vals no callback set 2021-05-26T16:45:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 1 -- 172.21.15.3:0/717151059 <== mon.3 v1:172.21.15.137:6790/0 5 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff8c80027b0 con 0x7ff8d812a050 2021-05-26T16:45:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: got monmap 1 from mon.g (according to old e1) 2021-05-26T16:45:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d5ffb700 10 monclient: dump: 2021-05-26T16:45:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:55.053 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:55.054 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:55.056 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:55.056 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 10 monclient: shutdown 2021-05-26T16:45:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 20 monclient: shutdown discarding 0 pending message(s) 2021-05-26T16:45:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 1 -- 172.21.15.3:0/717151059 >> v1:172.21.15.137:6790/0 conn(0x7ff8d812a050 legacy=0x7ff8d8135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 1 -- 172.21.15.3:0/717151059 shutdown_connections 2021-05-26T16:45:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 1 -- 172.21.15.3:0/717151059 >> 172.21.15.3:0/717151059 conn(0x7ff8d809ff30 msgr2=0x7ff8d80a0340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-05-26T16:45:55.057 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 1 -- 172.21.15.3:0/717151059 shutdown_connections 2021-05-26T16:45:55.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.028+0000 7ff8d7fff700 1 -- 172.21.15.3:0/717151059 wait complete. 2021-05-26T16:45:55.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.029+0000 7ff8d7fff700 10 monclient: build_initial_monmap 2021-05-26T16:45:55.058 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.029+0000 7ff8d7fff700 10 monclient: monmap: 2021-05-26T16:45:55.058 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 0 2021-05-26T16:45:55.059 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2021-05-26T16:45:55.059 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 0.000000 2021-05-26T16:45:55.059 INFO:teuthology.orchestra.run.smithi003.stderr:created 0.000000 2021-05-26T16:45:55.059 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 0 (unknown) 2021-05-26T16:45:55.059 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:55.060 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.noname-a 2021-05-26T16:45:55.060 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.noname-f 2021-05-26T16:45:55.060 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.noname-b 2021-05-26T16:45:55.060 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.noname-g 2021-05-26T16:45:55.061 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.noname-c 2021-05-26T16:45:55.061 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.noname-h 2021-05-26T16:45:55.061 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.noname-d 2021-05-26T16:45:55.061 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.noname-i 2021-05-26T16:45:55.061 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.noname-e 2021-05-26T16:45:55.062 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:55.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.029+0000 7ff8d7fff700 1 Processor -- start 2021-05-26T16:45:55.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.029+0000 7ff8d7fff700 1 -- start start 2021-05-26T16:45:55.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.029+0000 7ff8d7fff700 10 monclient: init 2021-05-26T16:45:55.062 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 10 monclient: _reopen_session rank -1 2021-05-26T16:45:55.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 10 monclient: _add_conns ranks=[0,3,5,1,8,2,7,4,6] 2021-05-26T16:45:55.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 10 monclient(hunting): picked mon.noname-a con 0x7ff8d8096d10 addr v1:172.21.15.3:6789/0 2021-05-26T16:45:55.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 10 monclient(hunting): picked mon.noname-g con 0x7ff8d8129770 addr v1:172.21.15.137:6790/0 2021-05-26T16:45:55.063 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 10 monclient(hunting): picked mon.noname-h con 0x7ff8d812a050 addr v1:172.21.15.137:6791/0 2021-05-26T16:45:55.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d809bb50 con 0x7ff8d8096d10 2021-05-26T16:45:55.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 1 -- --> v1:172.21.15.137:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d8117410 con 0x7ff8d8129770 2021-05-26T16:45:55.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 1 -- --> v1:172.21.15.137:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d8118bf0 con 0x7ff8d812a050 2021-05-26T16:45:55.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 10 monclient(hunting): _renew_subs 2021-05-26T16:45:55.064 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d7fff700 10 monclient(hunting): authenticate will time out at 1112.661278s 2021-05-26T16:45:55.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d6ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff8d8096d10 0x7ff8d81165d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53516/0 (socket says 172.21.15.3:53516) 2021-05-26T16:45:55.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.030+0000 7ff8d6ffd700 1 -- 172.21.15.3:0/2620311604 learned_addr learned my addr 172.21.15.3:0/2620311604 (peer_addr_for_me v1:172.21.15.3:0/0) 2021-05-26T16:45:55.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8d6ffd700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6789/0 conn(0x7ff8d8096d10 legacy=0x7ff8d81165d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:55.065 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8d77fe700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.137:6791/0 conn(0x7ff8d812a050 legacy=0x7ff8d8144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:55.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8d67fc700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.137:6790/0 conn(0x7ff8d8129770 legacy=0x7ff8d8116ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:55.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300759267 0 0) 0x7ff8d809bb50 con 0x7ff8d8096d10 2021-05-26T16:45:55.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8beffd700 10 monclient(hunting): _init_auth method 2 2021-05-26T16:45:55.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8beffd700 10 monclient(hunting): _init_auth creating new auth 2021-05-26T16:45:55.066 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8beffd700 10 monclient(hunting): my global_id is 104985 2021-05-26T16:45:55.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b8003270 con 0x7ff8d8096d10 2021-05-26T16:45:55.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.032+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3152411998 0 0) 0x7ff8b8003270 con 0x7ff8d8096d10 2021-05-26T16:45:55.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8d809bb50 con 0x7ff8d8096d10 2021-05-26T16:45:55.067 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff8c0004350 con 0x7ff8d8096d10 2021-05-26T16:45:55.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:55.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2021-05-26T16:45:55.068 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient(hunting): dump: 2021-05-26T16:45:55.068 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:55.068 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:55.069 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.069 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.069 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:55.069 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:55.070 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:55.070 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:55.070 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:55.070 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:55.070 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:55.071 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:55.071 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:55.071 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:55.071 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:55.071 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:55.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient(hunting): _finish_auth 0 2021-05-26T16:45:55.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2989010321 0 0) 0x7ff8d809bb50 con 0x7ff8d8096d10 2021-05-26T16:45:55.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.137:6791/0 conn(0x7ff8d812a050 legacy=0x7ff8d8144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:55.072 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.137:6790/0 conn(0x7ff8d8129770 legacy=0x7ff8d8116ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:55.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient: _finish_hunting 0 2021-05-26T16:45:55.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 monclient: found mon.a 2021-05-26T16:45:55.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:55.073 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8118e90 con 0x7ff8d8096d10 2021-05-26T16:45:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient: _finish_auth 0 2021-05-26T16:45:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d7fff700 5 monclient: authenticate success, global_id 104985 2021-05-26T16:45:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d7fff700 10 monclient: _renew_subs 2021-05-26T16:45:55.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d7fff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:55.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d7fff700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d8119880 con 0x7ff8d8096d10 2021-05-26T16:45:55.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d7fff700 10 monclient: _renew_subs 2021-05-26T16:45:55.075 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d7fff700 10 monclient: _send_mon_message to mon.a at v1:172.21.15.3:6789/0 2021-05-26T16:45:55.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d7fff700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d8095870 con 0x7ff8d8096d10 2021-05-26T16:45:55.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff8c0004ae0 con 0x7ff8d8096d10 2021-05-26T16:45:55.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient: handle_config config(0 keys) v1 2021-05-26T16:45:55.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 6 ==== mon_map magic: 0 v1 ==== 722+0+0 (unknown 2806611953 0 0) 0x7ff8c0004f90 con 0x7ff8d8096d10 2021-05-26T16:45:55.076 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient: handle_monmap mon_map magic: 0 v1 2021-05-26T16:45:55.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient: got monmap 1 from mon.a (according to old e1) 2021-05-26T16:45:55.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8d57fa700 4 set_mon_vals no callback set 2021-05-26T16:45:55.077 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 10 monclient: dump: 2021-05-26T16:45:55.077 INFO:teuthology.orchestra.run.smithi003.stderr:epoch 1 2021-05-26T16:45:55.077 INFO:teuthology.orchestra.run.smithi003.stderr:fsid 1c28cdc4-a665-4986-9729-a987ae3508f4 2021-05-26T16:45:55.078 INFO:teuthology.orchestra.run.smithi003.stderr:last_changed 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.078 INFO:teuthology.orchestra.run.smithi003.stderr:created 2021-05-26T16:40:21.025302+0000 2021-05-26T16:45:55.078 INFO:teuthology.orchestra.run.smithi003.stderr:min_mon_release 17 (quincy) 2021-05-26T16:45:55.078 INFO:teuthology.orchestra.run.smithi003.stderr:election_strategy: 1 2021-05-26T16:45:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:0: v1:172.21.15.3:6789/0 mon.a 2021-05-26T16:45:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:1: v1:172.21.15.137:6789/0 mon.f 2021-05-26T16:45:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:2: v1:172.21.15.3:6790/0 mon.b 2021-05-26T16:45:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:3: v1:172.21.15.137:6790/0 mon.g 2021-05-26T16:45:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:4: v1:172.21.15.3:6791/0 mon.c 2021-05-26T16:45:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:5: v1:172.21.15.137:6791/0 mon.h 2021-05-26T16:45:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:6: v1:172.21.15.3:6792/0 mon.d 2021-05-26T16:45:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:7: v1:172.21.15.137:6792/0 mon.i 2021-05-26T16:45:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:8: v1:172.21.15.3:6793/0 mon.e 2021-05-26T16:45:55.080 INFO:teuthology.orchestra.run.smithi003.stderr: 2021-05-26T16:45:55.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.033+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 7 ==== mgrmap(e 4) v1 ==== 37896+0+0 (unknown 1175683802 0 0) 0x7ff8c000e500 con 0x7ff8d8096d10 2021-05-26T16:45:55.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.034+0000 7ff8d7fff700 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2021-05-26T16:45:55.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.034+0000 7ff8d7fff700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff8b00065a0 con 0x7ff8b0002840 2021-05-26T16:45:55.081 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.034+0000 7ff8beffd700 1 -- 172.21.15.3:0/2620311604 <== mon.0 v1:172.21.15.3:6789/0 8 ==== osd_map(209..209 src has 1..209) v4 ==== 3941+0+0 (unknown 2580962776 0 0) 0x7ff8c003db90 con 0x7ff8d8096d10 2021-05-26T16:45:55.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.034+0000 7ff8d77fe700 10 monclient: get_auth_request con 0x7ff8b80328a0 auth_method 0 2021-05-26T16:45:55.082 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:55.036+0000 7ff8d67fc700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b0002840 legacy=0x7ff8b0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:45:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:58.030+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:45:58.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:58.030+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:58.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:58.030+0000 7ff8bdffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:45:59.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:59.030+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:45:59.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:59.030+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:45:59.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:59.030+0000 7ff8bdffb700 5 monclient: _check_tell_commands timeout tell command 1 2021-05-26T16:45:59.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:59.030+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b0002840 legacy=0x7ff8b0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:45:59.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:59.030+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b0002840 legacy=0x7ff8b0004ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:45:59.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:59.030+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff8b4007090 con 0x7ff8b4003310 2021-05-26T16:45:59.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:45:59.032+0000 7ff8d67fc700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4003310 legacy=0x7ff8b40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:46:00.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:00.030+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:00.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:00.030+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:01.032 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:01.030+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:01.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:01.030+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:02.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:02.030+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:02.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:02.030+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:02.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:02.030+0000 7ff8bdffb700 5 monclient: _check_tell_commands timeout tell command 1 2021-05-26T16:46:02.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:02.030+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4003310 legacy=0x7ff8b40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:46:02.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:02.030+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4003310 legacy=0x7ff8b40057d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:46:02.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:02.030+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff8b400b470 con 0x7ff8b4007380 2021-05-26T16:46:02.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:02.033+0000 7ff8d67fc700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4007380 legacy=0x7ff8b4007830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:46:03.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:03.030+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:03.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:03.030+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:04.026 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:04.027 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.027 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.027 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.027 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.028 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:46:04.028 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.029 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.029 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.029 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.029 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:46:04.030 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.030 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.030 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.030 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.031 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:04.031 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.032 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.032 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.032 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.033 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:46:04.033 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.033 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.033 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.034 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.034 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:46:04.034 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.034 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.035 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.035 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.035 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:46:04.035 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.036 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.036 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.036 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.037 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:04.037 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.037 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.037 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.038 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.038 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:46:04.038 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.039 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.039 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.039 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.039 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:46:04.040 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.040 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.040 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.040 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.041 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:46:04.041 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.041 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.042 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.042 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.042 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:04.043 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.043 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.043 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.043 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:04.030+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:04.044 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:04.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:04.045 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:46:04.045 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.045 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.045 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.045 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.046 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:46:04.046 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.046 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.046 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.047 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.047 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:46:04.047 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.048 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:04.048 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:04.048 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:04.049 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:46:04.049 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.050 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:04.050 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:04.050 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:04.050 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:46:04.051 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.051 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:04.051 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:04.051 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:04.051 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:46:04.052 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.052 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:04.052 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:04.052 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:04.053 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:46:04.053 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.053 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:04.053 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:04.054 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:04.054 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:46:04.054 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.055 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:04.055 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:04.055 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:04.055 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:46:04.056 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:04.056 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:04.056 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:04.056 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:05.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.031+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:05.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:05.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.031+0000 7ff8bdffb700 5 monclient: _check_tell_commands timeout tell command 1 2021-05-26T16:46:05.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4007380 legacy=0x7ff8b4007830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:46:05.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4007380 legacy=0x7ff8b4007830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:46:05.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.031+0000 7ff8d77fe700 1 -- 172.21.15.3:0/2620311604 reap_dead start 2021-05-26T16:46:05.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff8b400c380 con 0x7ff8b400b6e0 2021-05-26T16:46:05.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:05.033+0000 7ff8d67fc700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b400b6e0 legacy=0x7ff8b400baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:46:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:06.031+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:06.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:07.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:07.031+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:07.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:07.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:08.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.031+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.031+0000 7ff8bdffb700 5 monclient: _check_tell_commands timeout tell command 1 2021-05-26T16:46:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b400b6e0 legacy=0x7ff8b400baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:46:08.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b400b6e0 legacy=0x7ff8b400baf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:46:08.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 --> v1:172.21.15.3:6791/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff8b4007db0 con 0x7ff8b4007930 2021-05-26T16:46:08.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.031+0000 7ff8bdffb700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-05-26T16:46:08.036 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:08.033+0000 7ff8d67fc700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4007930 legacy=0x7ff8b40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-05-26T16:46:09.032 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:46:09.032 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.033 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.033 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.033 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:09.034 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:09.034 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.034 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.034 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.035 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:09.031+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:09.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:09.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:09.036 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:46:09.036 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.036 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.037 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.037 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.037 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:46:09.037 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.038 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.038 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.039 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.039 INFO:tasks.ceph.mon.a.smithi003.stdout: vendor '' 2021-05-26T16:46:09.039 INFO:tasks.ceph.mon.a.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.040 INFO:tasks.ceph.mon.a.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.040 INFO:tasks.ceph.mon.a.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.040 INFO:tasks.ceph.mon.a.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.040 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:09.041 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.041 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.041 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.041 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.042 INFO:tasks.ceph.mon.b.smithi003.stdout: vendor '' 2021-05-26T16:46:09.042 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:46:09.043 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.043 INFO:tasks.ceph.mon.b.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.043 INFO:tasks.ceph.mon.b.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.044 INFO:tasks.ceph.mon.b.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.044 INFO:tasks.ceph.mon.b.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.044 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.045 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.045 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.045 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:46:09.045 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.046 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.046 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.046 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.047 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:09.047 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.047 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.047 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.047 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.048 INFO:tasks.ceph.mon.d.smithi003.stdout: vendor '' 2021-05-26T16:46:09.048 INFO:tasks.ceph.mon.d.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.049 INFO:tasks.ceph.mon.d.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.049 INFO:tasks.ceph.mon.d.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.049 INFO:tasks.ceph.mon.d.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.050 INFO:tasks.ceph.mon.e.smithi003.stdout: vendor '' 2021-05-26T16:46:09.050 INFO:tasks.ceph.mon.e.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.050 INFO:tasks.ceph.mon.e.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.051 INFO:tasks.ceph.mon.e.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.051 INFO:tasks.ceph.mon.e.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.052 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:46:09.052 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.052 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.052 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.053 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.053 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:46:09.053 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.053 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.054 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.054 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.054 INFO:tasks.ceph.mon.c.smithi003.stdout: vendor '' 2021-05-26T16:46:09.054 INFO:tasks.ceph.mon.c.smithi003.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.054 INFO:tasks.ceph.mon.c.smithi003.stdout: serial_short 'CVFT5330009Z400BGN' 2021-05-26T16:46:09.055 INFO:tasks.ceph.mon.c.smithi003.stdout: scsi_serial '' 2021-05-26T16:46:09.055 INFO:tasks.ceph.mon.c.smithi003.stdout: serial 'INTEL SSDPEDMD400G4_CVFT5330009Z400BGN' 2021-05-26T16:46:09.055 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:46:09.056 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.056 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.056 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.056 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:09.057 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:46:09.057 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.057 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.057 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.058 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:09.058 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:46:09.058 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.059 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.059 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.060 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:09.060 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:46:09.060 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.061 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.061 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.061 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:09.061 INFO:tasks.ceph.mon.h.smithi137.stdout: vendor '' 2021-05-26T16:46:09.062 INFO:tasks.ceph.mon.h.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.062 INFO:tasks.ceph.mon.h.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.062 INFO:tasks.ceph.mon.h.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.062 INFO:tasks.ceph.mon.h.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:09.063 INFO:tasks.ceph.mon.f.smithi137.stdout: vendor '' 2021-05-26T16:46:09.063 INFO:tasks.ceph.mon.f.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.063 INFO:tasks.ceph.mon.f.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.064 INFO:tasks.ceph.mon.f.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.064 INFO:tasks.ceph.mon.f.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:09.064 INFO:tasks.ceph.mon.g.smithi137.stdout: vendor '' 2021-05-26T16:46:09.064 INFO:tasks.ceph.mon.g.smithi137.stdout: model 'INTEL SSDPEDMD400G4' 2021-05-26T16:46:09.065 INFO:tasks.ceph.mon.g.smithi137.stdout: serial_short 'CVFT6233004A400BGN' 2021-05-26T16:46:09.065 INFO:tasks.ceph.mon.g.smithi137.stdout: scsi_serial '' 2021-05-26T16:46:09.065 INFO:tasks.ceph.mon.g.smithi137.stdout: serial 'INTEL SSDPEDMD400G4_CVFT6233004A400BGN' 2021-05-26T16:46:10.033 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:10.031+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:10.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:10.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:11.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:11.031+0000 7ff8bdffb700 10 monclient: tick 2021-05-26T16:46:11.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:11.031+0000 7ff8bdffb700 20 monclient: _check_auth_rotating not needed by client.admin 2021-05-26T16:46:11.034 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:11.031+0000 7ff8bdffb700 5 monclient: _check_tell_commands timeout tell command 1 2021-05-26T16:46:11.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:11.031+0000 7ff8bdffb700 10 monclient: _finish_command 1 = monc:6 mon unavailable 2021-05-26T16:46:11.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:11.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4007930 legacy=0x7ff8b40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-05-26T16:46:11.035 INFO:teuthology.orchestra.run.smithi003.stderr:2021-05-26T16:46:11.031+0000 7ff8bdffb700 1 -- 172.21.15.3:0/2620311604 >> v1:172.21.15.3:6791/0 conn(0x7ff8b4007930 legacy=0x7ff8b40057d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-26T16:46:11.035 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from mon.c 2021-05-26T16:46:11.037 DEBUG:teuthology.orchestra.run:got remote process result: 6 2021-05-26T16:46:11.038 ERROR:tasks.mon_thrash.mon_thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa/tasks/mon_thrash.py", line 232, in do_thrash self._do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa/tasks/mon_thrash.py", line 285, in _do_thrash self.thrash_store(mon) File "/home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa/tasks/mon_thrash.py", line 175, in thrash_store '--yes-i-really-mean-it') File "/home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa/tasks/ceph_manager.py", line 1585, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ed4edd0b7e1e319db25251072e10833142271766/qa/tasks/ceph_manager.py", line 1576, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 6: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c sync_force --yes-i-really-mean-it' 2021-05-26T16:46:15.060 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:46:15.060 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36421]: starting. 2021-05-26T16:46:15.061 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36421]: deleting pool ceph_test_rados_delete_pools_parallel.smithi137-36385 2021-05-26T16:46:15.061 INFO:teuthology.orchestra.run.smithi137.stdout:process_4_[36421]: shutting down. 2021-05-26T16:46:15.061 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:46:15.062 INFO:teuthology.orchestra.run.smithi137.stdout:******************************* 2021-05-26T16:46:15.062 INFO:teuthology.orchestra.run.smithi137.stdout:******* SUCCESS ********** 2021-05-26T16:46:15.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2021-05-26T16:46:16.366 INFO:tasks.daemonwatchdog.daemon_watchdog:MonitorThrasher failed 2021-05-26T16:46:16.367 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-05-26T16:46:17.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36489]: starting. 2021-05-26T16:46:17.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36489]: creating pool ceph_test_rados_delete_pools_parallel.smithi137-36488 2021-05-26T16:46:17.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36489]: created object 0... 2021-05-26T16:46:17.195 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36489]: created object 25... 2021-05-26T16:46:17.196 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36489]: created object 49... 2021-05-26T16:46:17.196 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36489]: finishing. 2021-05-26T16:46:17.196 INFO:teuthology.orchestra.run.smithi137.stdout:process_1_[36489]: shutting down. 2021-05-26T16:46:17.877 INFO:tasks.ceph.osd.0:Sent signal 15 2021-05-26T16:46:17.964 INFO:tasks.ceph.osd.1:Sent signal 15 2021-05-26T16:46:17.964 INFO:tasks.ceph.osd.2:Sent signal 15 2021-05-26T16:46:17.965 INFO:tasks.ceph.osd.3:Sent signal 15 2021-05-26T16:46:17.965 INFO:tasks.ceph.osd.4:Sent signal 15 2021-05-26T16:46:17.966 INFO:tasks.ceph.osd.5:Sent signal 15 2021-05-26T16:46:17.966 INFO:tasks.ceph.mon.a:Sent signal 15 2021-05-26T16:46:17.966 INFO:tasks.ceph.mon.b:Sent signal 15 2021-05-26T16:46:17.967 INFO:tasks.ceph.mon.c:Sent signal 15 2021-05-26T16:46:17.967 INFO:tasks.ceph.mon.d:Sent signal 15 2021-05-26T16:46:17.968 INFO:tasks.ceph.mon.e:Sent signal 15 2021-05-26T16:46:17.968 INFO:tasks.ceph.mon.f:Sent signal 15 2021-05-26T16:46:17.968 INFO:tasks.ceph.mon.g:Sent signal 15 2021-05-26T16:46:17.969 INFO:tasks.ceph.mon.h:Sent signal 15 2021-05-26T16:46:17.969 INFO:tasks.ceph.mgr.x:Sent signal 15 2021-05-26T16:46:17.971 INFO:tasks.ceph.osd.3.smithi137.stderr:2021-05-26T16:46:17.963+0000 7fb03132c700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 30471) UID: 0 2021-05-26T16:46:17.971 INFO:tasks.ceph.osd.3.smithi137.stderr:2021-05-26T16:46:17.963+0000 7fb03132c700 -1 osd.3 212 *** Got signal Terminated *** 2021-05-26T16:46:17.971 INFO:tasks.ceph.osd.3.smithi137.stderr:2021-05-26T16:46:17.963+0000 7fb03132c700 -1 osd.3 212 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-05-26T16:46:17.972 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-05-26T16:46:17.875+0000 7f73167a1700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30451) UID: 0 2021-05-26T16:46:17.972 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-05-26T16:46:17.875+0000 7f73167a1700 -1 osd.0 212 *** Got signal Terminated *** 2021-05-26T16:46:17.972 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-05-26T16:46:17.875+0000 7f73167a1700 -1 osd.0 212 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-05-26T16:46:17.973 INFO:tasks.ceph.osd.4.smithi137.stderr:2021-05-26T16:46:17.963+0000 7fb28b982700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 30475) UID: 0 2021-05-26T16:46:17.973 INFO:tasks.ceph.osd.4.smithi137.stderr:2021-05-26T16:46:17.963+0000 7fb28b982700 -1 osd.4 212 *** Got signal Terminated *** 2021-05-26T16:46:17.973 INFO:tasks.ceph.osd.4.smithi137.stderr:2021-05-26T16:46:17.963+0000 7fb28b982700 -1 osd.4 212 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-05-26T16:46:17.974 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-05-26T16:46:17.962+0000 7f745e97b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30454) UID: 0 2021-05-26T16:46:17.974 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-05-26T16:46:17.962+0000 7f745e97b700 -1 osd.1 212 *** Got signal Terminated *** 2021-05-26T16:46:17.975 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-05-26T16:46:17.962+0000 7f745e97b700 -1 osd.1 212 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-05-26T16:46:17.975 INFO:tasks.ceph.osd.5.smithi137.stderr:2021-05-26T16:46:17.964+0000 7feed28d3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 30477) UID: 0 2021-05-26T16:46:17.975 INFO:tasks.ceph.osd.5.smithi137.stderr:2021-05-26T16:46:17.964+0000 7feed28d3700 -1 osd.5 212 *** Got signal Terminated *** 2021-05-26T16:46:17.975 INFO:tasks.ceph.osd.5.smithi137.stderr:2021-05-26T16:46:17.964+0000 7feed28d3700 -1 osd.5 212 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-05-26T16:46:17.976 INFO:tasks.ceph.mon.f.smithi137.stderr:2021-05-26T16:46:17.966+0000 7f793eec7700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i f (PID: 29904) UID: 0 2021-05-26T16:46:17.976 INFO:tasks.ceph.mon.f.smithi137.stderr:2021-05-26T16:46:17.966+0000 7f793eec7700 -1 mon.f@1(peon) e1 *** Got Signal Terminated *** 2021-05-26T16:46:17.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-05-26T16:46:17.962+0000 7fa17f444700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30456) UID: 0 2021-05-26T16:46:17.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-05-26T16:46:17.962+0000 7fa17f444700 -1 osd.2 212 *** Got signal Terminated *** 2021-05-26T16:46:17.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-05-26T16:46:17.962+0000 7fa17f444700 -1 osd.2 212 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-05-26T16:46:17.978 INFO:tasks.ceph.mon.g.smithi137.stderr:2021-05-26T16:46:17.967+0000 7f688f29b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i g (PID: 29910) UID: 0 2021-05-26T16:46:17.978 INFO:tasks.ceph.mon.g.smithi137.stderr:2021-05-26T16:46:17.967+0000 7f688f29b700 -1 mon.g@3(peon) e1 *** Got Signal Terminated *** 2021-05-26T16:46:17.979 INFO:tasks.ceph.mon.h.smithi137.stderr:2021-05-26T16:46:17.967+0000 7ff42e87a700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i h (PID: 29912) UID: 0 2021-05-26T16:46:17.979 INFO:tasks.ceph.mon.h.smithi137.stderr:2021-05-26T16:46:17.967+0000 7ff42e87a700 -1 mon.h@5(peon) e1 *** Got Signal Terminated *** 2021-05-26T16:46:17.979 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:46:17.964+0000 7f789ffdd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 35191) UID: 0 2021-05-26T16:46:17.980 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-05-26T16:46:17.964+0000 7f789ffdd700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-05-26T16:46:17.980 INFO:tasks.ceph.mgr.x.smithi137.stderr:2021-05-26T16:46:17.967+0000 7f9de9de2700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 29918) UID: 0 2021-05-26T16:46:17.981 INFO:tasks.ceph.mgr.x.smithi137.stderr:2021-05-26T16:46:17.968+0000 7f9de9de2700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2021-05-26T16:46:17.981 INFO:tasks.ceph.mon.b.smithi003.stderr:2021-05-26T16:46:17.964+0000 7f5232759700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 30100) UID: 0 2021-05-26T16:46:17.981 INFO:tasks.ceph.mon.b.smithi003.stderr:2021-05-26T16:46:17.964+0000 7f5232759700 -1 mon.b@2(peon) e1 *** Got Signal Terminated *** 2021-05-26T16:46:17.982 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-05-26T16:46:17.965+0000 7f82874cc700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 36614) UID: 0 2021-05-26T16:46:17.982 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-05-26T16:46:17.965+0000 7f82874cc700 -1 mon.c@4(peon) e1 *** Got Signal Terminated *** 2021-05-26T16:46:17.982 INFO:tasks.ceph.mon.d.smithi003.stderr:2021-05-26T16:46:17.965+0000 7faf25b99700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i d (PID: 30106) UID: 0 2021-05-26T16:46:17.983 INFO:tasks.ceph.mon.d.smithi003.stderr:2021-05-26T16:46:17.965+0000 7faf25b99700 -1 mon.d@6(peon) e1 *** Got Signal Terminated *** 2021-05-26T16:46:17.983 INFO:tasks.ceph.mon.e.smithi003.stderr:2021-05-26T16:46:17.966+0000 7fcd86162700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i e (PID: 35188) UID: 0 2021-05-26T16:46:17.984 INFO:tasks.ceph.mon.e.smithi003.stderr:2021-05-26T16:46:17.966+0000 7fcd86162700 -1 mon.e@8(peon) e1 *** Got Signal Terminated *** 2021-05-27T04:30:20.669 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-05-27T04:30:20.704 DEBUG:teuthology.task.console_log:Killing console logger for smithi003 2021-05-27T04:30:20.706 DEBUG:teuthology.task.console_log:Killing console logger for smithi137 2021-05-27T04:30:20.706 DEBUG:teuthology.exit:Finished running handlers